[2025-10-17T17:00:01.962634] [INFO ] [MAIN ] Using last completed trading day: 2025-10-17 [2025-10-17T17:00:02.174128] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-17T17:00:02.174360] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-17T17:00:02.246809] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-17T17:00:02.247332] [WARN ] [STATE ] State set to: RUNNING [2025-10-17T17:00:02.247424] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-17T17:00:02.247480] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-17T17:00:02.247618] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-17T17:00:02.247729] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-17T17:00:03.872845] [DEBUG] [SYMBOL ] Found 2420 valid NYSE symbols. [2025-10-17T17:00:03.872987] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-17T17:00:03.873191] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-17T17:00:03.873703] [INFO ] [LOCAL ] Symbols cache updated with 2368 symbols. [2025-10-17T17:00:03.873760] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-17T17:00:03.873791] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-17T17:00:03.873846] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-17T17:00:03.873879] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-17T17:00:03.873908] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-17T17:00:03.874282] [DEBUG] [LOCAL ] Found 2368 symbols in cached list. [2025-10-17T17:00:03.874349] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-17T17:00:03.874547] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-17T17:00:03.874605] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2368 valid symbols. [2025-10-17T17:00:03.874638] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-17T17:00:03.874719] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-17T17:00:03.884949] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/WNS.csv (symbol WNS no longer active). [2025-10-17T17:00:03.897037] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-17T17:00:03.907045] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/WNS.csv (symbol WNS no longer active). [2025-10-17T17:00:03.919966] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-10-17T17:00:03.920030] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-17T17:00:03.920065] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-17T17:00:03.920092] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-17T17:00:03.920145] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-17T17:00:03.920480] [DEBUG] [LOCAL ] Found 2368 symbols in cached list. [2025-10-17T17:00:03.920512] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-17T17:00:03.920544] [INFO ] [MAIN ] Starting incremental update for 2368 symbols. [2025-10-17T17:00:03.920571] [INFO ] [MAIN ] Running in parallel mode [2025-10-17T17:00:03.920748] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2368 symbols [2025-10-17T17:00:04.558440] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.582774] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.593919] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.636637] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-17T17:00:04.645375] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.637239] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-17T17:00:04.647410] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-17T17:00:04.647594] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-17T17:00:04.647693] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-17T17:00:04.647835] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-17T17:00:04.647953] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-17T17:00:04.647899] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-17T17:00:04.648033] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-17T17:00:04.648136] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-17T17:00:04.648271] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-17T17:00:04.648217] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-17T17:00:05.323384] [DEBUG] [LOCAL ] A: Loaded 51164 existing records from primary storage. [2025-10-17T17:00:05.356774] [INFO ] [MAIN ] A: Loaded 51164 existing records. [2025-10-17T17:00:05.340729] [DEBUG] [LOCAL ] AA: Loaded 54011 existing records from primary storage. [2025-10-17T17:00:05.485453] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:05.557908] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-17T17:00:05.601507] [INFO ] [MAIN ] AA: Loaded 54011 existing records. [2025-10-17T17:00:05.629393] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:05.668277] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-17T17:00:05.874772] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:05.880170] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-17T17:00:05.890484] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-17T17:00:05.908939] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-17T17:00:05.926446] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-17T17:00:06.009781] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:00:05.996271] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:06.025080] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-17T17:00:06.035323] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-17T17:00:06.046092] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-17T17:00:06.040627] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:00:06.060097] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-17T17:00:06.064875] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-17T17:00:06.064717] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-17T17:00:06.077026] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:00:06.128407] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-17T17:00:06.159863] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T17:00:06.199598] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-17T17:00:06.211724] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-17T17:00:06.220541] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-17T17:00:06.342863] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-17T17:00:06.413108] [INFO ] [MAIN ] Update Progress: 1/2368 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 38m 20s. Rate: 24.1 symbols/min [2025-10-17T17:00:06.570368] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T17:00:06.593026] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-17T17:00:06.811040] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:06.828186] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-17T17:00:06.965687] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:06.981918] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-17T17:00:07.020415] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:07.068348] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T17:00:07.070079] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-17T17:00:07.087568] [DEBUG] [LOCAL ] AAP: Loaded 52218 existing records from primary storage. [2025-10-17T17:00:07.088219] [INFO ] [MAIN ] AAP: Loaded 52218 existing records. [2025-10-17T17:00:07.268546] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:07.268814] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-17T17:00:07.268881] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-17T17:00:07.269205] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-17T17:00:07.269264] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-17T17:00:07.450403] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-17T17:00:07.519222] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-17T17:00:07.637054] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:07.637379] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-17T17:00:07.941056] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T17:00:07.942071] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-17T17:00:08.172168] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-17T17:00:08.173037] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-17T17:00:08.609692] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T17:00:08.610843] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-17T17:00:08.651456] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:00:08.662230] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-17T17:00:08.828046] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T17:00:08.837972] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-17T17:00:08.879219] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-17T17:00:08.880132] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-17T17:00:09.145938] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-17T17:00:09.147020] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-17T17:00:09.391490] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T17:00:09.401938] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-17T17:00:09.404936] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-17T17:00:09.405718] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-17T17:00:09.932511] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T17:00:09.933268] [INFO ] [REMOTE ] AAM: Full fetch complete (921 records). [2025-10-17T17:00:09.933344] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-17T17:00:10.127799] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-17T17:00:10.128003] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:00:10.128075] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:00:10.128154] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-17T17:00:10.128249] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-17T17:00:10.128322] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-17T17:00:10.128389] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-17T17:00:10.128513] [INFO ] [MAIN ] Update Progress: 2/2368 symbols completed. AAM took 6.2s. Estimated remaining: 2h 2m 24s. Rate: 19.3 symbols/min [2025-10-17T17:00:10.333074] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:10.366738] [DEBUG] [LOCAL ] AAT: Loaded 30661 existing records from primary storage. [2025-10-17T17:00:10.367030] [INFO ] [MAIN ] AAT: Loaded 30661 existing records. [2025-10-17T17:00:10.546575] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:10.546978] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-17T17:00:10.547055] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-17T17:00:10.547538] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-17T17:00:10.547603] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-17T17:00:10.894885] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T17:00:10.941119] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-17T17:00:10.946518] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:10.948070] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-17T17:00:11.527840] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-17T17:00:11.538266] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-17T17:00:11.711040] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T17:00:11.716869] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-17T17:00:11.817458] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-17T17:00:11.827764] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-17T17:00:12.905295] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T17:00:12.915580] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-17T17:00:13.053205] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:00:13.060920] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-17T17:00:13.444763] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:00:13.454379] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-17T17:00:14.443468] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:00:14.449717] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-17T17:00:15.003709] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:00:15.015948] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-17T17:00:15.063772] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T17:00:15.078154] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-17T17:00:15.719804] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (4.18 seconds). [2025-10-17T17:00:15.729931] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-17T17:00:16.124769] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T17:00:16.131417] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-17T17:00:16.822932] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:00:16.834387] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-17T17:00:16.952769] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:00:16.963930] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-17T17:00:17.267486] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T17:00:17.275092] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-17T17:00:17.334892] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T17:00:17.345882] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-17T17:00:18.512913] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:00:18.523892] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-17T17:00:18.674739] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T17:00:18.681439] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-17T17:00:18.794995] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:00:18.807187] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-17T17:00:19.066101] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T17:00:19.077217] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-17T17:00:19.892891] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:00:19.899956] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-17T17:00:19.999823] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T17:00:20.010281] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-17T17:00:20.521731] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:00:20.557937] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-17T17:00:20.559512] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T17:00:20.571088] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-17T17:00:21.208443] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:00:21.216141] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-17T17:00:21.906294] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:00:21.919478] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-17T17:00:22.243809] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:00:22.253096] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-17T17:00:22.284989] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:00:22.297367] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-17T17:00:22.497683] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T17:00:22.509436] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-17T17:00:23.170235] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T17:00:23.176681] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-17T17:00:23.388235] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:00:23.401211] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-17T17:00:23.880121] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:00:23.898256] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-17T17:00:24.359460] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:00:24.371799] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-17T17:00:24.392060] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T17:00:24.396695] [INFO ] [REMOTE ] AAT: Full fetch complete (43029 records). [2025-10-17T17:00:24.396856] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-17T17:00:24.786440] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-17T17:00:24.786686] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-17T17:00:24.787175] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-17T17:00:24.787257] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-17T17:00:24.788464] [DEBUG] [LOCAL ] AAT: Trimmed 43029 records to 30862 (keeping 200 days of data) [2025-10-17T17:00:24.978223] [DEBUG] [LOCAL ] AAT: Primary data saved (30862 records). [2025-10-17T17:00:24.978595] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-17T17:00:24.978756] [INFO ] [MAIN ] Update Progress: 3/2368 symbols completed. AAT took 14.9s. Estimated remaining: 4h 36m 41s. Rate: 8.5 symbols/min [2025-10-17T17:00:25.087183] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:00:25.138412] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-17T17:00:25.204725] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:25.204901] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-17T17:00:25.204940] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-17T17:00:25.205052] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-17T17:00:25.205093] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-17T17:00:25.205134] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-17T17:00:25.205168] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-17T17:00:25.566120] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:25.566465] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-17T17:00:25.832211] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:00:25.832902] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-17T17:00:25.833428] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:00:25.834491] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:00:25.834699] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-17T17:00:25.845135] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:00:25.845685] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-17T17:00:25.845973] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-17T17:00:25.846046] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-17T17:00:25.846094] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-17T17:00:25.846148] [INFO ] [MAIN ] Update Progress: 4/2368 symbols completed. AAUC took 0.9s. Estimated remaining: 3h 35m 58s. Rate: 10.9 symbols/min [2025-10-17T17:00:25.881441] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-17T17:00:26.027872] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:26.058534] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:00:26.069870] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-17T17:00:26.088712] [DEBUG] [LOCAL ] AB: Loaded 25663 existing records from primary storage. [2025-10-17T17:00:26.088977] [INFO ] [MAIN ] AB: Loaded 25663 existing records. [2025-10-17T17:00:26.268634] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:26.268870] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-17T17:00:26.268919] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-17T17:00:26.269146] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-17T17:00:26.269202] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-17T17:00:26.653612] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:26.660625] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-17T17:00:26.673533] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T17:00:26.681414] [INFO ] [REMOTE ] A: Full fetch complete (73507 records). [2025-10-17T17:00:26.681549] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-17T17:00:27.075162] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-17T17:00:27.075261] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-17T17:00:27.075953] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-17T17:00:27.076026] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-17T17:00:27.077617] [DEBUG] [LOCAL ] A: Trimmed 73507 records to 51523 (keeping 200 days of data) [2025-10-17T17:00:27.397633] [DEBUG] [LOCAL ] A: Primary data saved (51523 records). [2025-10-17T17:00:27.397852] [INFO ] [MAIN ] A: Full history saved. [2025-10-17T17:00:27.398186] [INFO ] [MAIN ] Update Progress: 5/2368 symbols completed. A took 23.5s. Estimated remaining: 3h 4m 55s. Rate: 12.8 symbols/min [2025-10-17T17:00:27.573949] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:27.574340] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-17T17:00:27.574413] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-17T17:00:27.574576] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-17T17:00:27.574622] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-17T17:00:27.574712] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-17T17:00:27.574760] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-17T17:00:28.026978] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-17T17:00:28.031247] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:28.038971] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-17T17:00:28.051744] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-17T17:00:28.081439] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T17:00:28.091485] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-17T17:00:28.093395] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T17:00:28.102046] [INFO ] [REMOTE ] AAP: Full fetch complete (75190 records). [2025-10-17T17:00:28.102189] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-17T17:00:28.491239] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-17T17:00:28.491329] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-17T17:00:28.492074] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-17T17:00:28.492144] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-17T17:00:28.494848] [DEBUG] [LOCAL ] AAP: Trimmed 75190 records to 52578 (keeping 200 days of data) [2025-10-17T17:00:28.808024] [DEBUG] [LOCAL ] AAP: Primary data saved (52578 records). [2025-10-17T17:00:28.808169] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-17T17:00:28.808528] [INFO ] [MAIN ] Update Progress: 6/2368 symbols completed. AAP took 22.4s. Estimated remaining: 2h 43m 18s. Rate: 14.5 symbols/min [2025-10-17T17:00:28.976244] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:29.005847] [DEBUG] [LOCAL ] ABCB: Loaded 30801 existing records from primary storage. [2025-10-17T17:00:29.006141] [INFO ] [MAIN ] ABCB: Loaded 30801 existing records. [2025-10-17T17:00:29.180923] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:29.181168] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-17T17:00:29.181219] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-17T17:00:29.182243] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-17T17:00:29.182303] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-17T17:00:29.537111] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:29.537634] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-17T17:00:29.639845] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:00:29.650617] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-17T17:00:29.898133] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T17:00:29.909247] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-17T17:00:30.187190] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T17:00:30.195038] [INFO ] [REMOTE ] AA: Full fetch complete (77728 records). [2025-10-17T17:00:30.195237] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-17T17:00:30.598491] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-17T17:00:30.598610] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-17T17:00:30.599378] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-17T17:00:30.599565] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-17T17:00:30.602195] [DEBUG] [LOCAL ] AA: Trimmed 77728 records to 54401 (keeping 200 days of data) [2025-10-17T17:00:30.833554] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:00:30.847172] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-17T17:00:30.981045] [DEBUG] [LOCAL ] AA: Primary data saved (54401 records). [2025-10-17T17:00:30.981827] [INFO ] [MAIN ] AA: Full history saved. [2025-10-17T17:00:30.982915] [INFO ] [MAIN ] Update Progress: 7/2368 symbols completed. AA took 27.0s. Estimated remaining: 2h 32m 8s. Rate: 15.5 symbols/min [2025-10-17T17:00:30.982569] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T17:00:31.058497] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-17T17:00:31.168211] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:31.215934] [DEBUG] [LOCAL ] ABEV: Loaded 53668 existing records from primary storage. [2025-10-17T17:00:31.216275] [INFO ] [MAIN ] ABEV: Loaded 53668 existing records. [2025-10-17T17:00:31.393878] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:31.394097] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-17T17:00:31.394192] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-17T17:00:31.394758] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-17T17:00:31.394818] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-17T17:00:31.758848] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:31.759286] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-17T17:00:31.789597] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:00:31.800116] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-17T17:00:32.018910] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T17:00:32.025574] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-17T17:00:32.804055] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T17:00:32.813592] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-17T17:00:33.430408] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:00:33.436900] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-17T17:00:33.498864] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:00:33.510480] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-17T17:00:33.808033] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T17:00:33.817990] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-17T17:00:34.254785] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T17:00:34.263315] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-17T17:00:34.772031] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T17:00:34.780086] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-17T17:00:35.339673] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T17:00:35.351036] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-17T17:00:35.503258] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T17:00:35.509800] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-17T17:00:36.145155] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:00:36.153108] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-17T17:00:36.303579] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-17T17:00:36.315197] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-17T17:00:36.328219] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:00:36.333053] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-17T17:00:37.107053] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:00:37.122149] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-17T17:00:37.322629] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T17:00:37.328334] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-17T17:00:37.403464] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T17:00:37.410071] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-17T17:00:38.224474] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:00:38.248437] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-17T17:00:38.249488] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T17:00:38.255845] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-17T17:00:38.295770] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:00:38.302157] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-17T17:00:39.143033] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:00:39.154129] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-17T17:00:39.387127] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:00:39.392598] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-17T17:00:39.539893] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:00:39.547211] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-17T17:00:40.351378] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:00:40.354582] [INFO ] [REMOTE ] AB: Full fetch complete (44208 records). [2025-10-17T17:00:40.354722] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-17T17:00:40.355377] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:00:40.355471] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:00:40.355517] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:00:40.355585] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-17T17:00:40.355704] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-17T17:00:40.355775] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-17T17:00:40.355947] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-17T17:00:40.356047] [INFO ] [MAIN ] Update Progress: 8/2368 symbols completed. AB took 14.5s. Estimated remaining: 2h 59m 8s. Rate: 13.2 symbols/min [2025-10-17T17:00:40.544636] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:40.584137] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T17:00:40.602142] [DEBUG] [LOCAL ] ABG: Loaded 18453 existing records from primary storage. [2025-10-17T17:00:40.602525] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-17T17:00:40.602884] [INFO ] [MAIN ] ABG: Loaded 18453 existing records. [2025-10-17T17:00:40.768551] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T17:00:40.827390] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:40.834402] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-17T17:00:40.834904] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-17T17:00:40.835057] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-17T17:00:40.836079] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-17T17:00:40.836161] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-17T17:00:41.037264] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T17:00:41.069777] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-17T17:00:41.257079] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:41.257407] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-17T17:00:42.113790] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T17:00:42.118634] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-17T17:00:42.270300] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:00:42.281608] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-17T17:00:42.482165] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:00:42.499319] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-17T17:00:42.676300] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T17:00:42.693993] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-17T17:00:42.797917] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:00:42.802321] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-17T17:00:43.523922] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T17:00:43.528508] [INFO ] [REMOTE ] ABCB: Full fetch complete (44863 records). [2025-10-17T17:00:43.528605] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-17T17:00:43.915822] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T17:00:43.916084] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-17T17:00:43.920185] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-17T17:00:43.919435] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-17T17:00:43.921723] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-17T17:00:43.921795] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-17T17:00:43.922813] [DEBUG] [LOCAL ] ABCB: Trimmed 44863 records to 31020 (keeping 200 days of data) [2025-10-17T17:00:44.107259] [DEBUG] [LOCAL ] ABCB: Primary data saved (31020 records). [2025-10-17T17:00:44.107490] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-17T17:00:44.108983] [INFO ] [MAIN ] Update Progress: 9/2368 symbols completed. ABCB took 15.3s. Estimated remaining: 2h 55m 34s. Rate: 13.4 symbols/min [2025-10-17T17:00:44.280344] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:44.316461] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:00:44.327423] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-17T17:00:44.353559] [DEBUG] [LOCAL ] ABM: Loaded 32403 existing records from primary storage. [2025-10-17T17:00:44.353876] [INFO ] [MAIN ] ABM: Loaded 32403 existing records. [2025-10-17T17:00:44.533174] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:44.534071] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-17T17:00:44.534136] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-17T17:00:44.534339] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-17T17:00:44.534396] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-17T17:00:44.887396] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:44.887817] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-17T17:00:44.922635] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-17T17:00:44.934494] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-17T17:00:45.010044] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:00:45.014891] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-17T17:00:45.815158] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T17:00:45.827241] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-17T17:00:46.281408] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T17:00:46.282831] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T17:00:46.289568] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-17T17:00:46.297961] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-17T17:00:46.827371] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T17:00:46.839244] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-17T17:00:47.334136] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T17:00:47.338309] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-17T17:00:47.420466] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:00:47.426344] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-17T17:00:47.735349] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:00:47.749001] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-17T17:00:47.906747] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T17:00:47.910633] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-17T17:00:48.260576] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T17:00:48.266099] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-17T17:00:48.639446] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T17:00:48.651768] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-17T17:00:48.667947] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:00:48.673339] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-17T17:00:49.634439] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T17:00:49.645788] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-17T17:00:49.674876] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:00:49.681891] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-17T17:00:49.704318] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:00:49.709238] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-17T17:00:50.471539] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T17:00:50.481191] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:00:50.492558] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-17T17:00:50.492702] [INFO ] [REMOTE ] ABBV: Full fetch complete (77847 records). [2025-10-17T17:00:50.493709] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-17T17:00:50.901482] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-17T17:00:50.901683] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-17T17:00:50.902433] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-17T17:00:50.902500] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-17T17:00:50.904190] [DEBUG] [LOCAL ] ABBV: Trimmed 77847 records to 54465 (keeping 200 days of data) [2025-10-17T17:00:51.256092] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:00:51.273627] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-17T17:00:51.279308] [DEBUG] [LOCAL ] ABBV: Primary data saved (54465 records). [2025-10-17T17:00:51.280310] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-17T17:00:51.280422] [INFO ] [MAIN ] Update Progress: 10/2368 symbols completed. ABBV took 23.9s. Estimated remaining: 3h 6m 7s. Rate: 12.7 symbols/min [2025-10-17T17:00:51.430274] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:00:51.481678] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:51.481859] [INFO ] [REMOTE ] ABEV: Full fetch complete (77350 records). [2025-10-17T17:00:51.482457] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-17T17:00:51.843090] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T17:00:51.892467] [DEBUG] [LOCAL ] ABR: Loaded 52354 existing records from primary storage. [2025-10-17T17:00:51.897803] [INFO ] [REMOTE ] ABG: Full fetch complete (26725 records). [2025-10-17T17:00:51.917734] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-17T17:00:51.937176] [INFO ] [MAIN ] ABR: Loaded 52354 existing records. [2025-10-17T17:00:52.042573] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-17T17:00:52.099739] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-17T17:00:52.111169] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-17T17:00:52.186035] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-17T17:00:52.265392] [DEBUG] [LOCAL ] ABEV: Trimmed 77350 records to 54055 (keeping 200 days of data) [2025-10-17T17:00:52.324815] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:52.475934] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-17T17:00:52.487840] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:00:52.487166] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-17T17:00:52.544068] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-17T17:00:52.556292] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-17T17:00:52.567589] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-17T17:00:52.982400] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-17T17:00:53.001794] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-17T17:00:53.002265] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-17T17:00:53.010401] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-17T17:00:53.059555] [DEBUG] [LOCAL ] ABG: Trimmed 26725 records to 18603 (keeping 200 days of data) [2025-10-17T17:00:53.429820] [DEBUG] [LOCAL ] ABEV: Primary data saved (54055 records). [2025-10-17T17:00:53.436819] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-17T17:00:53.436516] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:53.437145] [INFO ] [MAIN ] Update Progress: 11/2368 symbols completed. ABEV took 22.5s. Estimated remaining: 2h 56m 50s. Rate: 13.3 symbols/min [2025-10-17T17:00:53.442990] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-17T17:00:53.409256] [DEBUG] [LOCAL ] ABG: Primary data saved (18603 records). [2025-10-17T17:00:53.467166] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-17T17:00:53.476560] [INFO ] [MAIN ] Update Progress: 12/2368 symbols completed. ABG took 13.1s. Estimated remaining: 2h 42m 9s. Rate: 14.5 symbols/min [2025-10-17T17:00:53.794463] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:53.860156] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:53.860539] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-17T17:00:53.860596] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-17T17:00:53.860746] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-17T17:00:53.860798] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-17T17:00:53.860843] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-17T17:00:53.860882] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-17T17:00:54.292392] [DEBUG] [LOCAL ] ABT: Loaded 54011 existing records from primary storage. [2025-10-17T17:00:54.292829] [INFO ] [MAIN ] ABT: Loaded 54011 existing records. [2025-10-17T17:00:54.291323] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:54.315323] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:00:54.360778] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-17T17:00:54.370535] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-17T17:00:54.490970] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:54.491150] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-17T17:00:54.491205] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-17T17:00:54.491588] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-17T17:00:54.491675] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-17T17:00:54.845452] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:54.845790] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-17T17:00:55.416158] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:00:55.426381] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-17T17:00:55.635394] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:00:55.639968] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-17T17:00:55.705027] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T17:00:55.712180] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-17T17:00:56.617897] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:00:56.629522] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-17T17:00:56.697779] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T17:00:56.705508] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-17T17:00:56.734798] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:00:56.739806] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-17T17:00:57.050938] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:00:57.061154] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-17T17:00:57.813611] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:00:57.818675] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-17T17:00:58.184322] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:00:58.210677] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-17T17:00:58.212259] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T17:00:58.224282] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-17T17:00:58.895456] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:00:58.906857] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-17T17:00:58.977158] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T17:00:58.984263] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-17T17:00:59.582374] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:00:59.587316] [INFO ] [REMOTE ] ABM: Full fetch complete (45009 records). [2025-10-17T17:00:59.587427] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-17T17:00:59.972037] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-17T17:00:59.972214] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-17T17:00:59.972909] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-17T17:00:59.972993] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-17T17:00:59.983835] [DEBUG] [LOCAL ] ABM: Trimmed 45009 records to 32640 (keeping 200 days of data) [2025-10-17T17:01:00.003574] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T17:01:00.078275] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-17T17:01:00.220268] [DEBUG] [LOCAL ] ABM: Primary data saved (32640 records). [2025-10-17T17:01:00.220458] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-17T17:01:00.220621] [INFO ] [MAIN ] Update Progress: 13/2368 symbols completed. ABM took 16.1s. Estimated remaining: 2h 49m 59s. Rate: 13.9 symbols/min [2025-10-17T17:01:00.396785] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:00.413871] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T17:01:00.420521] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-17T17:01:00.450317] [DEBUG] [LOCAL ] ACCO: Loaded 37310 existing records from primary storage. [2025-10-17T17:01:00.450729] [INFO ] [MAIN ] ACCO: Loaded 37310 existing records. [2025-10-17T17:01:00.668209] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:00.669056] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-17T17:01:00.670537] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:01:00.670729] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-17T17:01:00.681830] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-17T17:01:00.681787] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-17T17:01:00.682790] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-17T17:01:01.041755] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:01.042225] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-17T17:01:01.600011] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T17:01:01.605504] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-17T17:01:02.014569] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:01:02.026617] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-17T17:01:02.424879] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:01:02.430249] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-17T17:01:02.696319] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:01:02.703571] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-17T17:01:02.794360] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T17:01:02.805863] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-17T17:01:03.564885] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T17:01:03.570337] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-17T17:01:03.795413] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:01:03.797002] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T17:01:03.815392] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-17T17:01:03.816937] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-17T17:01:04.622697] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T17:01:04.633579] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-17T17:01:04.812838] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:01:04.818505] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-17T17:01:05.171453] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T17:01:05.558101] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-17T17:01:05.768702] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T17:01:05.997865] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T17:01:06.060538] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:01:06.358065] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-17T17:01:07.003903] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:01:07.158027] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-17T17:01:07.873996] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T17:01:07.958020] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-17T17:01:08.702691] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T17:01:08.758036] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-17T17:01:09.037750] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T17:01:09.041022] [INFO ] [REMOTE ] ACA: Full fetch complete (34274 records). [2025-10-17T17:01:09.041135] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-17T17:01:09.409724] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-17T17:01:09.409821] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-17T17:01:09.410213] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-17T17:01:09.410259] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-17T17:01:09.411080] [DEBUG] [LOCAL ] ACA: Trimmed 34274 records to 23255 (keeping 200 days of data) [2025-10-17T17:01:09.548066] [DEBUG] [LOCAL ] ACA: Primary data saved (23255 records). [2025-10-17T17:01:09.548198] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-17T17:01:09.548285] [INFO ] [MAIN ] Update Progress: 14/2368 symbols completed. ACA took 16.1s. Estimated remaining: 3h 3m 55s. Rate: 12.8 symbols/min [2025-10-17T17:01:09.563158] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-17T17:01:09.719342] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:09.749152] [DEBUG] [LOCAL ] ACEL: Loaded 26895 existing records from primary storage. [2025-10-17T17:01:09.749542] [INFO ] [MAIN ] ACEL: Loaded 26895 existing records. [2025-10-17T17:01:09.937920] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:09.938168] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-17T17:01:09.938245] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-17T17:01:09.938546] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-17T17:01:09.938606] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-17T17:01:10.310458] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:10.358002] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-17T17:01:10.407257] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:01:11.157999] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-17T17:01:11.560780] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T17:01:11.906473] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:01:11.963093] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-17T17:01:11.972182] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T17:01:12.758031] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-17T17:01:13.558026] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-17T17:01:13.767226] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T17:01:14.358059] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-17T17:01:14.953804] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T17:01:15.143001] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T17:01:15.157989] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-17T17:01:15.252937] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T17:01:15.958049] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-17T17:01:16.631840] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:01:16.758041] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-17T17:01:17.558018] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-17T17:01:17.862312] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T17:01:17.894133] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T17:01:18.358063] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-17T17:01:19.158033] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-17T17:01:19.481714] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T17:01:19.489481] [INFO ] [REMOTE ] ABR: Full fetch complete (75436 records). [2025-10-17T17:01:19.489680] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-17T17:01:19.946869] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-17T17:01:19.946962] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-17T17:01:19.947728] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-17T17:01:19.947831] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-17T17:01:19.949480] [DEBUG] [LOCAL ] ABR: Trimmed 75436 records to 52735 (keeping 200 days of data) [2025-10-17T17:01:20.002203] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-17T17:01:20.284695] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T17:01:20.297398] [DEBUG] [LOCAL ] ABR: Primary data saved (52735 records). [2025-10-17T17:01:20.297697] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-17T17:01:20.297919] [INFO ] [MAIN ] Update Progress: 15/2368 symbols completed. ABR took 29.0s. Estimated remaining: 3h 19m 41s. Rate: 11.8 symbols/min [2025-10-17T17:01:20.502406] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T17:01:20.505456] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:20.568215] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-17T17:01:20.568540] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-10-17T17:01:20.741077] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:20.741333] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-17T17:01:20.741394] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-17T17:01:20.741837] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-17T17:01:20.741906] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-17T17:01:20.763124] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-17T17:01:21.102203] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:21.243477] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T17:01:21.558038] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-17T17:01:22.078881] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T17:01:22.358094] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-17T17:01:23.158075] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-17T17:01:23.958045] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-17T17:01:24.065418] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-17T17:01:24.101028] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:01:24.107930] [INFO ] [REMOTE ] ABT: Full fetch complete (77377 records). [2025-10-17T17:01:24.108104] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-17T17:01:24.108976] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:01:24.109075] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:01:24.109119] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:01:24.109209] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-17T17:01:24.109304] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-17T17:01:24.109373] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-17T17:01:24.109551] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-17T17:01:24.109783] [INFO ] [MAIN ] Update Progress: 16/2368 symbols completed. ABT took 30.7s. Estimated remaining: 3h 16m 28s. Rate: 12.0 symbols/min [2025-10-17T17:01:24.291696] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:24.344767] [DEBUG] [LOCAL ] ACI: Loaded 53672 existing records from primary storage. [2025-10-17T17:01:24.345097] [INFO ] [MAIN ] ACI: Loaded 53672 existing records. [2025-10-17T17:01:24.537223] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:24.537707] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-17T17:01:24.537773] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-17T17:01:24.538151] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-17T17:01:24.538193] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-17T17:01:24.729779] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:01:24.765883] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-17T17:01:24.970722] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:25.558073] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-17T17:01:25.767925] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:01:25.775359] [INFO ] [REMOTE ] ACCO: Full fetch complete (54042 records). [2025-10-17T17:01:25.775555] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-17T17:01:26.185306] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-17T17:01:26.185389] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-17T17:01:26.185973] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-17T17:01:26.186039] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-17T17:01:26.187214] [DEBUG] [LOCAL ] ACCO: Trimmed 54042 records to 37509 (keeping 200 days of data) [2025-10-17T17:01:26.375536] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-17T17:01:26.408843] [DEBUG] [LOCAL ] ACCO: Primary data saved (37509 records). [2025-10-17T17:01:26.409012] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-17T17:01:26.409127] [INFO ] [MAIN ] Update Progress: 17/2368 symbols completed. ACCO took 26.2s. Estimated remaining: 3h 10m 8s. Rate: 12.4 symbols/min [2025-10-17T17:01:26.604084] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:26.646118] [DEBUG] [LOCAL ] ACM: Loaded 43294 existing records from primary storage. [2025-10-17T17:01:26.646484] [INFO ] [MAIN ] ACM: Loaded 43294 existing records. [2025-10-17T17:01:26.833080] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:26.833314] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-17T17:01:26.833366] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-17T17:01:26.833577] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-17T17:01:26.833637] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-17T17:01:27.227610] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:27.228166] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-17T17:01:27.434158] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-17T17:01:27.481899] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T17:01:27.959840] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-17T17:01:27.962598] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T17:01:28.758004] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-17T17:01:28.995998] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:01:29.558083] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-17T17:01:30.358007] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-17T17:01:30.465241] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:01:30.531782] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-17T17:01:30.940772] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T17:01:31.158003] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-17T17:01:31.471581] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:01:31.958082] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-17T17:01:32.758010] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-17T17:01:32.806673] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:01:33.352200] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:01:33.558059] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-17T17:01:34.358273] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-17T17:01:35.168542] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-17T17:01:35.173627] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T17:01:35.250094] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:01:35.458597] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T17:01:35.958044] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-17T17:01:36.758004] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-17T17:01:37.000295] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:01:37.076926] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T17:01:37.558050] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-17T17:01:38.358077] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-17T17:01:38.644952] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T17:01:39.158035] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-17T17:01:39.300315] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-17T17:01:39.958015] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-17T17:01:40.265582] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:01:40.758063] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-17T17:01:40.947484] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:01:41.558042] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-17T17:01:41.719603] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:01:41.723496] [INFO ] [REMOTE ] ACEL: Full fetch complete (38901 records). [2025-10-17T17:01:41.723602] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-17T17:01:42.102987] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-17T17:01:42.103075] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-17T17:01:42.103604] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-17T17:01:42.103694] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-17T17:01:42.104632] [DEBUG] [LOCAL ] ACEL: Trimmed 38901 records to 27028 (keeping 200 days of data) [2025-10-17T17:01:42.276080] [DEBUG] [LOCAL ] ACEL: Primary data saved (27028 records). [2025-10-17T17:01:42.276275] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-17T17:01:42.276437] [INFO ] [MAIN ] Update Progress: 18/2368 symbols completed. ACEL took 32.7s. Estimated remaining: 3h 34m 1s. Rate: 11.0 symbols/min [2025-10-17T17:01:42.361393] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-17T17:01:42.476782] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:42.536995] [DEBUG] [LOCAL ] ACN: Loaded 53829 existing records from primary storage. [2025-10-17T17:01:42.537486] [INFO ] [MAIN ] ACN: Loaded 53829 existing records. [2025-10-17T17:01:42.728117] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:42.728589] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-17T17:01:42.728754] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-17T17:01:42.729188] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-17T17:01:42.729340] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-17T17:01:43.020763] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-10-17T17:01:43.156035] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:43.165194] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-17T17:01:43.182241] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T17:01:43.958035] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-17T17:01:44.170782] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T17:01:44.758040] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-17T17:01:45.450222] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:01:45.563116] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-17T17:01:45.581235] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-17T17:01:46.358013] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-17T17:01:46.715048] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:01:47.146043] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:01:47.157990] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-17T17:01:47.762462] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T17:01:47.958051] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-17T17:01:48.725544] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T17:01:48.757998] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-17T17:01:49.558019] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-17T17:01:49.832530] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:01:50.359673] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-17T17:01:50.365926] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T17:01:51.158098] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-17T17:01:51.958100] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-17T17:01:52.240839] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:01:52.314415] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-17T17:01:52.758072] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-17T17:01:52.805111] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T17:01:52.811130] [INFO ] [REMOTE ] ACM: Full fetch complete (63197 records). [2025-10-17T17:01:52.811251] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-17T17:01:53.205874] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-17T17:01:53.205969] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-17T17:01:53.206663] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-17T17:01:53.206736] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-17T17:01:53.208096] [DEBUG] [LOCAL ] ACM: Trimmed 63197 records to 43560 (keeping 200 days of data) [2025-10-17T17:01:53.483596] [DEBUG] [LOCAL ] ACM: Primary data saved (43560 records). [2025-10-17T17:01:53.483760] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-17T17:01:53.484678] [INFO ] [MAIN ] Update Progress: 19/2368 symbols completed. ACM took 27.1s. Estimated remaining: 3h 45m 46s. Rate: 10.4 symbols/min [2025-10-17T17:01:53.562971] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-17T17:01:53.654870] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:53.693739] [DEBUG] [LOCAL ] ACP: Loaded 31216 existing records from primary storage. [2025-10-17T17:01:53.694010] [INFO ] [MAIN ] ACP: Loaded 31216 existing records. [2025-10-17T17:01:53.875606] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:53.876042] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-17T17:01:53.876122] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-17T17:01:53.876426] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-17T17:01:53.876488] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-17T17:01:54.004726] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T17:01:54.310739] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:54.357986] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-17T17:01:54.704081] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T17:01:55.158077] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-17T17:01:55.928861] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:01:55.958003] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-17T17:01:56.063980] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-17T17:01:56.615562] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T17:01:56.758109] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-17T17:01:57.222783] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T17:01:57.558057] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-17T17:01:58.358036] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-17T17:01:58.570204] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:01:58.658976] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:01:59.158061] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-17T17:01:59.958072] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-17T17:02:00.602000] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T17:02:00.758041] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-17T17:02:01.190285] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T17:02:01.206638] [INFO ] [REMOTE ] ACI: Full fetch complete (77230 records). [2025-10-17T17:02:01.206958] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-17T17:02:01.558436] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-17T17:02:01.574233] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:02:01.693695] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-17T17:02:01.693847] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-17T17:02:01.694628] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-17T17:02:01.694725] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-17T17:02:01.696366] [DEBUG] [LOCAL ] ACI: Trimmed 77230 records to 54062 (keeping 200 days of data) [2025-10-17T17:02:02.078496] [DEBUG] [LOCAL ] ACI: Primary data saved (54062 records). [2025-10-17T17:02:02.078728] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-17T17:02:02.078839] [INFO ] [MAIN ] Update Progress: 20/2368 symbols completed. ACI took 38.0s. Estimated remaining: 3h 51m 12s. Rate: 10.2 symbols/min [2025-10-17T17:02:02.268178] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:02.276157] [DEBUG] [LOCAL ] ACR: Loaded 5466 existing records from primary storage. [2025-10-17T17:02:02.276380] [INFO ] [MAIN ] ACR: Loaded 5466 existing records. [2025-10-17T17:02:02.372844] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-17T17:02:02.457325] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:02.457728] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-17T17:02:02.457804] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-17T17:02:02.458065] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-17T17:02:02.458130] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-17T17:02:02.786208] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:02:02.872263] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:03.158052] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-17T17:02:03.773619] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T17:02:03.907355] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T17:02:03.958051] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-17T17:02:04.465439] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-17T17:02:04.689360] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T17:02:04.758055] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-17T17:02:05.386041] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T17:02:05.558068] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-17T17:02:06.358052] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-17T17:02:07.110445] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:02:07.158009] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-17T17:02:07.958043] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-17T17:02:08.154472] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:02:08.758044] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-17T17:02:08.867288] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-17T17:02:08.874800] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-17T17:02:08.874981] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-17T17:02:09.261489] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-17T17:02:09.261587] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-17T17:02:09.262416] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-17T17:02:09.262498] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-17T17:02:09.264241] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-10-17T17:02:09.567577] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-17T17:02:09.595681] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-10-17T17:02:09.595819] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-17T17:02:09.595958] [INFO ] [MAIN ] Update Progress: 21/2368 symbols completed. ACHR took 49.3s. Estimated remaining: 3h 54m 6s. Rate: 10.0 symbols/min [2025-10-17T17:02:09.779572] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:09.799934] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:02:09.835681] [DEBUG] [LOCAL ] ACRE: Loaded 33901 existing records from primary storage. [2025-10-17T17:02:09.835995] [INFO ] [MAIN ] ACRE: Loaded 33901 existing records. [2025-10-17T17:02:10.031968] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:10.032447] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-17T17:02:10.032510] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-17T17:02:10.042389] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-17T17:02:10.042492] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-17T17:02:10.139249] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T17:02:10.363145] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-17T17:02:10.434801] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:10.443604] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T17:02:11.158038] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-17T17:02:11.958061] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-17T17:02:12.663788] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-17T17:02:12.701295] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T17:02:12.758008] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-17T17:02:13.208574] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T17:02:13.558035] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-17T17:02:14.352721] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:02:14.359898] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-17T17:02:14.883383] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:02:15.158058] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-17T17:02:15.198717] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T17:02:15.958093] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-17T17:02:16.354747] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:02:16.359201] [INFO ] [REMOTE ] ACP: Full fetch complete (46296 records). [2025-10-17T17:02:16.359322] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-17T17:02:16.360100] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:02:16.360190] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:02:16.360236] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:02:16.360337] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-17T17:02:16.360455] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-17T17:02:16.360525] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-17T17:02:16.360792] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-17T17:02:16.360929] [INFO ] [MAIN ] Update Progress: 22/2368 symbols completed. ACP took 22.9s. Estimated remaining: 3h 55m 23s. Rate: 10.0 symbols/min [2025-10-17T17:02:16.543323] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:16.553780] [DEBUG] [LOCAL ] ACV: Loaded 7694 existing records from primary storage. [2025-10-17T17:02:16.554028] [INFO ] [MAIN ] ACV: Loaded 7694 existing records. [2025-10-17T17:02:16.746600] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:16.746864] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-17T17:02:16.746933] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-17T17:02:16.747129] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-17T17:02:16.747190] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-17T17:02:16.762678] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-17T17:02:17.109722] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:17.558026] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-17T17:02:17.641411] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T17:02:17.808434] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:02:18.358043] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-17T17:02:18.978945] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:02:19.128035] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T17:02:19.157998] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-17T17:02:19.595495] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:02:19.958042] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-17T17:02:20.758098] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-17T17:02:20.798306] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T17:02:21.558062] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-17T17:02:22.169078] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:02:22.358047] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-17T17:02:22.750982] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T17:02:23.158061] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-17T17:02:23.536412] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:02:23.808786] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T17:02:23.958113] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-17T17:02:24.410811] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T17:02:24.758126] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-17T17:02:25.558054] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-17T17:02:26.363315] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-17T17:02:26.379288] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:02:26.499979] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T17:02:26.899256] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T17:02:27.158098] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-17T17:02:27.738926] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:02:27.958070] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-17T17:02:28.565286] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T17:02:28.566429] [INFO ] [REMOTE ] ACR: Full fetch complete (8554 records). [2025-10-17T17:02:28.566501] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-17T17:02:28.763144] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-17T17:02:28.937843] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-17T17:02:28.937922] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-17T17:02:28.938107] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-17T17:02:28.938170] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-17T17:02:28.938623] [DEBUG] [LOCAL ] ACR: Trimmed 8554 records to 5512 (keeping 200 days of data) [2025-10-17T17:02:28.970588] [DEBUG] [LOCAL ] ACR: Primary data saved (5512 records). [2025-10-17T17:02:28.970758] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-17T17:02:28.970856] [INFO ] [MAIN ] Update Progress: 23/2368 symbols completed. ACR took 26.9s. Estimated remaining: 4h 6m 29s. Rate: 9.5 symbols/min [2025-10-17T17:02:29.138441] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:29.184400] [DEBUG] [LOCAL ] ACVA: Loaded 49671 existing records from primary storage. [2025-10-17T17:02:29.184776] [INFO ] [MAIN ] ACVA: Loaded 49671 existing records. [2025-10-17T17:02:29.363040] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:29.363306] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-17T17:02:29.363354] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-17T17:02:29.363678] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-17T17:02:29.363736] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-17T17:02:29.579366] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-17T17:02:29.766913] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:30.298076] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:02:30.358027] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-17T17:02:31.158051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-17T17:02:31.677972] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:02:31.958049] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-17T17:02:32.084585] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-17T17:02:32.092446] [INFO ] [REMOTE ] ACN: Full fetch complete (77382 records). [2025-10-17T17:02:32.092609] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-17T17:02:32.481299] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-17T17:02:32.481469] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-17T17:02:32.482229] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-17T17:02:32.482385] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-17T17:02:32.498153] [DEBUG] [LOCAL ] ACN: Trimmed 77382 records to 54216 (keeping 200 days of data) [2025-10-17T17:02:32.509243] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T17:02:32.646113] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T17:02:32.758120] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-17T17:02:32.868492] [DEBUG] [LOCAL ] ACN: Primary data saved (54216 records). [2025-10-17T17:02:32.868628] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-17T17:02:32.869742] [INFO ] [MAIN ] Update Progress: 24/2368 symbols completed. ACN took 50.6s. Estimated remaining: 4h 2m 27s. Rate: 9.7 symbols/min [2025-10-17T17:02:33.037195] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:33.037345] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-17T17:02:33.037382] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-17T17:02:33.037537] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-17T17:02:33.037605] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-17T17:02:33.037727] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-17T17:02:33.037808] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-17T17:02:33.403071] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:33.399448] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T17:02:33.557999] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-17T17:02:33.751766] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:02:33.752061] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-17T17:02:33.752153] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:02:33.752220] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-17T17:02:33.752299] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:02:33.752385] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-17T17:02:33.752470] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-17T17:02:33.752522] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-17T17:02:33.752579] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-17T17:02:33.752679] [INFO ] [MAIN ] Update Progress: 25/2368 symbols completed. AD took 0.9s. Estimated remaining: 3h 54m 2s. Rate: 10.0 symbols/min [2025-10-17T17:02:33.922147] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:33.922329] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-17T17:02:33.922368] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-17T17:02:33.922493] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-17T17:02:33.922535] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-17T17:02:33.922578] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-17T17:02:33.922613] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-17T17:02:34.281976] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:34.357994] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-17T17:02:35.158058] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-17T17:02:35.551358] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:02:35.644775] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T17:02:35.958060] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-17T17:02:36.758067] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-17T17:02:37.224462] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:02:37.348095] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T17:02:37.558020] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-17T17:02:38.304829] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T17:02:38.358039] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-17T17:02:39.158052] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-17T17:02:39.522094] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T17:02:39.853774] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T17:02:39.855844] [INFO ] [REMOTE ] ACV: Full fetch complete (10395 records). [2025-10-17T17:02:39.855918] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-17T17:02:39.963155] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-17T17:02:40.301038] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-17T17:02:40.301147] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-17T17:02:40.301444] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-17T17:02:40.301511] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-17T17:02:40.302094] [DEBUG] [LOCAL ] ACV: Trimmed 10395 records to 7718 (keeping 200 days of data) [2025-10-17T17:02:40.350270] [DEBUG] [LOCAL ] ACV: Primary data saved (7718 records). [2025-10-17T17:02:40.350443] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-17T17:02:40.350556] [INFO ] [MAIN ] Update Progress: 26/2368 symbols completed. ACV took 24.0s. Estimated remaining: 3h 54m 51s. Rate: 10.0 symbols/min [2025-10-17T17:02:40.560483] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:40.602447] [DEBUG] [LOCAL ] ADCT: Loaded 35639 existing records from primary storage. [2025-10-17T17:02:40.602797] [INFO ] [MAIN ] ADCT: Loaded 35639 existing records. [2025-10-17T17:02:40.766534] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-17T17:02:40.800096] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:40.801084] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-17T17:02:40.801151] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-17T17:02:40.801881] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-17T17:02:40.802006] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-17T17:02:41.205987] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:41.497985] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:02:41.558025] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-17T17:02:42.305748] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:02:42.357988] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-17T17:02:42.524021] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T17:02:43.158111] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-17T17:02:43.829415] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:02:43.958097] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-17T17:02:44.472106] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:02:44.477316] [INFO ] [REMOTE ] ACRE: Full fetch complete (49787 records). [2025-10-17T17:02:44.477475] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-17T17:02:44.764240] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-17T17:02:44.866244] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-17T17:02:44.866336] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-17T17:02:44.866886] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-17T17:02:44.866954] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-17T17:02:44.868186] [DEBUG] [LOCAL ] ACRE: Trimmed 49787 records to 34100 (keeping 200 days of data) [2025-10-17T17:02:45.059999] [DEBUG] [LOCAL ] ACRE: Primary data saved (34100 records). [2025-10-17T17:02:45.060157] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-17T17:02:45.060253] [INFO ] [MAIN ] Update Progress: 27/2368 symbols completed. ACRE took 35.5s. Estimated remaining: 3h 52m 51s. Rate: 10.1 symbols/min [2025-10-17T17:02:45.229802] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:45.230075] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-17T17:02:45.230122] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-17T17:02:45.230238] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-17T17:02:45.230279] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-17T17:02:45.230320] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-17T17:02:45.230353] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-17T17:02:45.566734] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-17T17:02:45.588187] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:45.619728] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T17:02:46.358016] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-17T17:02:46.514081] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:02:47.158063] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-17T17:02:47.261901] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:02:47.958087] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-17T17:02:48.375660] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T17:02:48.758111] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-17T17:02:48.985990] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:02:49.558073] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-17T17:02:49.778628] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T17:02:50.214621] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:02:50.358051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-17T17:02:50.768883] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:02:51.158145] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-17T17:02:51.958068] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-17T17:02:52.041789] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T17:02:52.434212] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T17:02:52.758078] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-17T17:02:53.558078] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-17T17:02:53.897082] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:02:54.358045] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-17T17:02:54.397292] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:02:54.441425] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T17:02:55.158051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-17T17:02:55.958331] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:02:55.958476] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-17T17:02:56.758068] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-17T17:02:57.037518] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T17:02:57.428628] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T17:02:57.557988] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-17T17:02:58.309846] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T17:02:58.357990] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-17T17:02:59.158018] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-17T17:02:59.552346] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:02:59.958062] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-17T17:03:00.092326] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T17:03:00.099193] [INFO ] [REMOTE ] ADC: Full fetch complete (66558 records). [2025-10-17T17:03:00.099337] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-17T17:03:00.499389] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-17T17:03:00.499605] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-17T17:03:00.500411] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-17T17:03:00.500469] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-17T17:03:00.502067] [DEBUG] [LOCAL ] ADC: Trimmed 66558 records to 47056 (keeping 200 days of data) [2025-10-17T17:03:00.750035] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:03:00.758082] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-17T17:03:00.841185] [DEBUG] [LOCAL ] ADC: Primary data saved (47056 records). [2025-10-17T17:03:00.841297] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-17T17:03:00.841373] [INFO ] [MAIN ] Update Progress: 28/2368 symbols completed. ADC took 27.1s. Estimated remaining: 4h 6m 26s. Rate: 9.5 symbols/min [2025-10-17T17:03:01.017214] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:01.064235] [DEBUG] [LOCAL ] ADNT: Loaded 47055 existing records from primary storage. [2025-10-17T17:03:01.064680] [INFO ] [MAIN ] ADNT: Loaded 47055 existing records. [2025-10-17T17:03:01.249172] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:01.249369] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-17T17:03:01.249422] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-17T17:03:01.250551] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-17T17:03:01.250617] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-17T17:03:01.563156] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-17T17:03:01.641633] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:01.900355] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:03:02.267727] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:03:02.358060] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-17T17:03:02.826004] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T17:03:03.158051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-17T17:03:03.958051] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-17T17:03:04.263286] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:03:04.758019] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-17T17:03:04.786861] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T17:03:04.870576] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:03:05.558033] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-17T17:03:06.358004] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-17T17:03:06.389433] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:03:07.158039] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-17T17:03:07.543832] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T17:03:07.955192] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T17:03:07.963973] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-17T17:03:08.767374] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-17T17:03:08.774843] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:03:09.558590] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-17T17:03:09.561407] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T17:03:09.910510] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:03:10.358029] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-17T17:03:11.158057] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-17T17:03:11.413203] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:03:11.957992] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-17T17:03:12.037276] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:03:12.758041] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-17T17:03:12.889357] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T17:03:12.896004] [INFO ] [REMOTE ] ACVA: Full fetch complete (70624 records). [2025-10-17T17:03:12.896150] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-17T17:03:12.896956] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:03:12.897051] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:03:12.897094] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:03:12.897135] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-17T17:03:12.897194] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-17T17:03:12.897230] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-17T17:03:12.897481] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-10-17T17:03:12.897601] [INFO ] [MAIN ] Update Progress: 29/2368 symbols completed. ACVA took 43.9s. Estimated remaining: 4h 14m 2s. Rate: 9.2 symbols/min [2025-10-17T17:03:13.062264] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:13.110825] [DEBUG] [LOCAL ] ADT: Loaded 53829 existing records from primary storage. [2025-10-17T17:03:13.111122] [INFO ] [MAIN ] ADT: Loaded 53829 existing records. [2025-10-17T17:03:13.288337] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:13.288534] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-17T17:03:13.288582] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-17T17:03:13.288884] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-17T17:03:13.288949] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-17T17:03:13.559900] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-17T17:03:13.660969] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T17:03:13.663949] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:14.358030] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-17T17:03:14.540191] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:03:14.976987] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T17:03:15.157999] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-17T17:03:15.638407] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:03:15.958038] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-17T17:03:16.593838] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:03:16.758062] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-17T17:03:17.558053] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-17T17:03:17.720677] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T17:03:18.358041] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-17T17:03:18.514170] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:03:19.158013] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-17T17:03:19.239598] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T17:03:19.245292] [INFO ] [REMOTE ] ADCT: Full fetch complete (51257 records). [2025-10-17T17:03:19.245379] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-17T17:03:19.246043] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:03:19.246130] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:03:19.246172] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:03:19.246240] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-17T17:03:19.246303] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-17T17:03:19.246339] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-17T17:03:19.246477] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-17T17:03:19.246565] [INFO ] [MAIN ] Update Progress: 30/2368 symbols completed. ADCT took 38.9s. Estimated remaining: 4h 13m 42s. Rate: 9.2 symbols/min [2025-10-17T17:03:19.410284] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:19.437187] [DEBUG] [LOCAL ] ADX: Loaded 27929 existing records from primary storage. [2025-10-17T17:03:19.437440] [INFO ] [MAIN ] ADX: Loaded 27929 existing records. [2025-10-17T17:03:19.619272] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:19.619511] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-17T17:03:19.619569] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-17T17:03:19.619773] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-17T17:03:19.619830] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-17T17:03:19.959044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-17T17:03:20.001730] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:20.081234] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T17:03:20.758073] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-17T17:03:21.040343] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T17:03:21.193390] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T17:03:21.558080] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-17T17:03:22.093081] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T17:03:22.358030] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-17T17:03:23.086916] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T17:03:23.158040] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-17T17:03:23.958067] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-17T17:03:24.097085] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:03:24.741698] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:03:24.757991] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-17T17:03:25.558037] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-17T17:03:26.131305] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T17:03:26.236337] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T17:03:26.244373] [INFO ] [REMOTE ] ADM: Full fetch complete (77451 records). [2025-10-17T17:03:26.244687] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-17T17:03:26.363208] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-17T17:03:26.698888] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-17T17:03:26.699037] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-17T17:03:26.700045] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-17T17:03:26.700119] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-17T17:03:26.702380] [DEBUG] [LOCAL ] ADM: Trimmed 77451 records to 54178 (keeping 200 days of data) [2025-10-17T17:03:26.956356] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:03:27.089895] [DEBUG] [LOCAL ] ADM: Primary data saved (54178 records). [2025-10-17T17:03:27.090093] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-17T17:03:27.090204] [INFO ] [MAIN ] Update Progress: 31/2368 symbols completed. ADM took 42.0s. Estimated remaining: 4h 15m 16s. Rate: 9.2 symbols/min [2025-10-17T17:03:27.166617] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-17T17:03:27.269599] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:27.324528] [DEBUG] [LOCAL ] AEE: Loaded 50542 existing records from primary storage. [2025-10-17T17:03:27.325012] [INFO ] [MAIN ] AEE: Loaded 50542 existing records. [2025-10-17T17:03:27.515994] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:27.516409] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-17T17:03:27.516474] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-17T17:03:27.516960] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-17T17:03:27.517033] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-17T17:03:27.961367] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:27.981324] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-17T17:03:27.987006] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:03:28.758018] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-17T17:03:29.150487] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T17:03:29.558016] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-17T17:03:29.711351] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T17:03:29.715619] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T17:03:30.358026] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-17T17:03:31.158010] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-17T17:03:31.306130] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:03:31.863459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T17:03:31.958005] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-17T17:03:32.638154] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:03:32.644356] [INFO ] [REMOTE ] ADNT: Full fetch complete (68010 records). [2025-10-17T17:03:32.644479] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-17T17:03:32.763183] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-17T17:03:33.041221] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-17T17:03:33.041331] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-17T17:03:33.042034] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-17T17:03:33.042097] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-17T17:03:33.043921] [DEBUG] [LOCAL ] ADNT: Trimmed 68010 records to 47379 (keeping 200 days of data) [2025-10-17T17:03:33.325004] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:03:33.342411] [DEBUG] [LOCAL ] ADNT: Primary data saved (47379 records). [2025-10-17T17:03:33.342924] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-17T17:03:33.343977] [INFO ] [MAIN ] Update Progress: 32/2368 symbols completed. ADNT took 32.5s. Estimated remaining: 4h 14m 48s. Rate: 9.2 symbols/min [2025-10-17T17:03:33.507778] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:33.507955] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-17T17:03:33.507992] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-17T17:03:33.508105] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-17T17:03:33.508159] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-17T17:03:33.508227] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-17T17:03:33.508272] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-17T17:03:33.568460] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-17T17:03:33.870174] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:34.282329] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T17:03:34.357998] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-17T17:03:34.889124] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T17:03:35.158033] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-17T17:03:35.958086] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-17T17:03:36.385106] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T17:03:36.685010] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:03:36.758229] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-17T17:03:36.925333] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T17:03:37.558052] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-17T17:03:37.802409] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T17:03:38.358027] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-17T17:03:38.846355] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:03:39.158022] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-17T17:03:39.405827] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:03:39.958079] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-17T17:03:40.758061] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-17T17:03:40.796239] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T17:03:41.402954] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T17:03:41.558038] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-17T17:03:42.357994] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-17T17:03:42.501733] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T17:03:43.137331] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:03:43.157981] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-17T17:03:43.958000] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-17T17:03:44.060302] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T17:03:44.284976] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-10-17T17:03:44.758045] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-17T17:03:44.974227] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T17:03:45.558038] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-17T17:03:45.619257] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T17:03:46.358022] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-17T17:03:46.839150] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T17:03:46.843560] [INFO ] [REMOTE ] ADX: Full fetch complete (41949 records). [2025-10-17T17:03:46.843687] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-17T17:03:47.170741] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-17T17:03:47.224507] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-17T17:03:47.224773] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-17T17:03:47.225448] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-17T17:03:47.225554] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-17T17:03:47.226633] [DEBUG] [LOCAL ] ADX: Trimmed 41949 records to 28160 (keeping 200 days of data) [2025-10-17T17:03:47.323743] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T17:03:47.410894] [DEBUG] [LOCAL ] ADX: Primary data saved (28160 records). [2025-10-17T17:03:47.411080] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-17T17:03:47.411226] [INFO ] [MAIN ] Update Progress: 33/2368 symbols completed. ADX took 28.2s. Estimated remaining: 4h 23m 34s. Rate: 8.9 symbols/min [2025-10-17T17:03:47.578914] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:47.623429] [DEBUG] [LOCAL ] AEG: Loaded 49936 existing records from primary storage. [2025-10-17T17:03:47.623756] [INFO ] [MAIN ] AEG: Loaded 49936 existing records. [2025-10-17T17:03:47.798292] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:47.798499] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-17T17:03:47.798547] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-17T17:03:47.798798] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-17T17:03:47.798854] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-17T17:03:47.972339] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-17T17:03:48.155918] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:48.758075] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-17T17:03:49.145900] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T17:03:49.153279] [INFO ] [REMOTE ] ADT: Full fetch complete (77365 records). [2025-10-17T17:03:49.153407] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-17T17:03:49.560143] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-17T17:03:49.564200] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-17T17:03:49.565370] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-17T17:03:49.566196] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-17T17:03:49.566361] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-17T17:03:49.568296] [DEBUG] [LOCAL ] ADT: Trimmed 77365 records to 54217 (keeping 200 days of data) [2025-10-17T17:03:49.889188] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T17:03:49.921028] [DEBUG] [LOCAL ] ADT: Primary data saved (54217 records). [2025-10-17T17:03:49.921175] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-17T17:03:49.921265] [INFO ] [MAIN ] Update Progress: 34/2368 symbols completed. ADT took 37.0s. Estimated remaining: 4h 18m 34s. Rate: 9.0 symbols/min [2025-10-17T17:03:50.087142] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:50.141197] [DEBUG] [LOCAL ] AEM: Loaded 53868 existing records from primary storage. [2025-10-17T17:03:50.141501] [INFO ] [MAIN ] AEM: Loaded 53868 existing records. [2025-10-17T17:03:50.318531] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:50.318751] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-17T17:03:50.318803] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-17T17:03:50.319017] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-17T17:03:50.319075] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-17T17:03:50.361053] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-17T17:03:50.579995] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T17:03:50.655445] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:03:50.719957] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:51.158019] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-17T17:03:51.860114] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T17:03:51.957995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-17T17:03:52.081389] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:03:52.416402] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T17:03:52.758020] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-17T17:03:53.558022] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-17T17:03:54.360960] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-17T17:03:54.366123] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:03:55.158069] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-17T17:03:55.293916] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:03:55.958090] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-17T17:03:56.104064] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:03:56.262311] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:03:56.758023] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-17T17:03:57.558015] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-17T17:03:57.824029] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:03:58.093003] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:03:58.358040] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-17T17:03:59.158036] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-17T17:03:59.327804] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:03:59.745537] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T17:03:59.958057] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-17T17:03:59.991775] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T17:04:00.758028] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-17T17:04:01.558035] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-17T17:04:02.001575] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T17:04:02.361518] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-17T17:04:02.362742] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T17:04:02.366281] [INFO ] [REMOTE ] AEFC: Full fetch complete (11736 records). [2025-10-17T17:04:02.366420] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-17T17:04:02.742375] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-17T17:04:02.742503] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-17T17:04:02.742861] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-17T17:04:02.743065] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-17T17:04:02.743967] [DEBUG] [LOCAL ] AEFC: Trimmed 11736 records to 8348 (keeping 200 days of data) [2025-10-17T17:04:02.813301] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:04:02.836795] [DEBUG] [LOCAL ] AEFC: Primary data saved (8348 records). [2025-10-17T17:04:02.836919] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-17T17:04:02.836991] [INFO ] [MAIN ] Update Progress: 35/2368 symbols completed. AEFC took 29.5s. Estimated remaining: 4h 25m 25s. Rate: 8.8 symbols/min [2025-10-17T17:04:03.003759] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:03.058799] [DEBUG] [LOCAL ] AEO: Loaded 53956 existing records from primary storage. [2025-10-17T17:04:03.059142] [INFO ] [MAIN ] AEO: Loaded 53956 existing records. [2025-10-17T17:04:03.163237] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-17T17:04:03.238614] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:03.238828] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-17T17:04:03.238878] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-17T17:04:03.239068] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-17T17:04:03.239111] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-17T17:04:03.578143] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:03.958013] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-17T17:04:04.066234] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:04:04.758019] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-17T17:04:05.154085] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:04:05.231608] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:04:05.558028] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-17T17:04:06.358035] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-17T17:04:06.977378] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-17T17:04:07.158002] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-17T17:04:07.191016] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:04:07.958040] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-17T17:04:08.013237] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:04:08.758007] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-17T17:04:09.163126] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:04:09.557996] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-17T17:04:09.652406] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:04:10.296068] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:04:10.357987] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-17T17:04:11.004169] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T17:04:11.158016] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-17T17:04:11.958033] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-17T17:04:12.099252] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T17:04:12.758011] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-17T17:04:12.793377] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:04:13.558000] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-17T17:04:13.806229] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T17:04:14.358003] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-17T17:04:14.478505] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:04:15.081986] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:04:15.088431] [INFO ] [REMOTE ] AEE: Full fetch complete (72638 records). [2025-10-17T17:04:15.088541] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-17T17:04:15.089321] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:04:15.089413] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:04:15.089457] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:04:15.089510] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-17T17:04:15.089609] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-17T17:04:15.089717] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-17T17:04:15.089960] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-17T17:04:15.090055] [INFO ] [MAIN ] Update Progress: 36/2368 symbols completed. AEE took 48.0s. Estimated remaining: 4h 31m 10s. Rate: 8.6 symbols/min [2025-10-17T17:04:15.163320] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-17T17:04:15.258540] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:15.307004] [DEBUG] [LOCAL ] AER: Loaded 48455 existing records from primary storage. [2025-10-17T17:04:15.307312] [INFO ] [MAIN ] AER: Loaded 48455 existing records. [2025-10-17T17:04:15.486466] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:15.486706] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-17T17:04:15.486765] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-17T17:04:15.487114] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-17T17:04:15.487172] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-17T17:04:15.847489] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:15.874765] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:04:15.958043] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-17T17:04:16.758060] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-17T17:04:17.032356] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T17:04:17.339822] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T17:04:17.558049] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-17T17:04:18.358002] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-17T17:04:18.448137] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:04:19.158043] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-17T17:04:19.640083] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T17:04:19.958042] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-17T17:04:20.133051] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:04:20.139815] [INFO ] [REMOTE ] AEG: Full fetch complete (70613 records). [2025-10-17T17:04:20.139976] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-17T17:04:20.524523] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-17T17:04:20.524616] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-17T17:04:20.525309] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-17T17:04:20.525373] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-17T17:04:20.526838] [DEBUG] [LOCAL ] AEG: Trimmed 70613 records to 50300 (keeping 200 days of data) [2025-10-17T17:04:20.762432] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-17T17:04:20.821046] [DEBUG] [LOCAL ] AEG: Primary data saved (50300 records). [2025-10-17T17:04:20.821205] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-17T17:04:20.821365] [INFO ] [MAIN ] Update Progress: 37/2368 symbols completed. AEG took 33.4s. Estimated remaining: 4h 29m 45s. Rate: 8.6 symbols/min [2025-10-17T17:04:20.874133] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:04:21.558006] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-17T17:04:21.935633] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T17:04:22.060847] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:04:22.358045] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-17T17:04:23.158089] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-17T17:04:23.412809] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T17:04:23.958045] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-17T17:04:24.408097] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T17:04:24.470492] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T17:04:24.758041] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-17T17:04:25.558014] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-17T17:04:25.999289] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:04:26.357990] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-17T17:04:26.627773] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T17:04:27.158003] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-17T17:04:27.600881] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T17:04:27.607588] [INFO ] [REMOTE ] AEM: Full fetch complete (77062 records). [2025-10-17T17:04:27.607707] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-17T17:04:27.608482] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:04:27.608570] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:04:27.608637] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:04:27.608734] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-17T17:04:27.608800] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-10-17T17:04:27.608838] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-10-17T17:04:27.608985] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-10-17T17:04:27.609849] [INFO ] [MAIN ] Update Progress: 38/2368 symbols completed. AEM took 37.7s. Estimated remaining: 4h 29m 28s. Rate: 8.6 symbols/min [2025-10-17T17:04:28.281571] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T17:04:28.293259] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-17T17:04:28.826737] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:04:28.838950] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-17T17:04:30.407046] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T17:04:30.419807] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-17T17:04:30.514337] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:04:30.524543] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-17T17:04:32.018488] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:04:32.028056] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-17T17:04:32.092744] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:04:32.100583] [INFO ] [REMOTE ] AEO: Full fetch complete (77647 records). [2025-10-17T17:04:32.100798] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-17T17:04:32.498028] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-17T17:04:32.498124] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-17T17:04:32.498950] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-17T17:04:32.499019] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-17T17:04:32.500674] [DEBUG] [LOCAL ] AEO: Trimmed 77647 records to 54346 (keeping 200 days of data) [2025-10-17T17:04:32.829418] [DEBUG] [LOCAL ] AEO: Primary data saved (54346 records). [2025-10-17T17:04:32.829560] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-17T17:04:32.830873] [INFO ] [MAIN ] Update Progress: 39/2368 symbols completed. AEO took 30.0s. Estimated remaining: 4h 27m 39s. Rate: 8.7 symbols/min [2025-10-17T17:04:33.738336] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T17:04:33.748869] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-17T17:04:35.105332] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T17:04:35.117135] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-17T17:04:36.733181] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T17:04:36.743270] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-17T17:04:38.481308] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:04:38.487662] [INFO ] [REMOTE ] AER: Full fetch complete (69941 records). [2025-10-17T17:04:38.487785] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-17T17:04:38.869501] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-17T17:04:38.869578] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-17T17:04:38.870231] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-17T17:04:38.870295] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-17T17:04:38.871574] [DEBUG] [LOCAL ] AER: Trimmed 69941 records to 48795 (keeping 200 days of data) [2025-10-17T17:04:39.169328] [DEBUG] [LOCAL ] AER: Primary data saved (48795 records). [2025-10-17T17:04:39.169466] [INFO ] [MAIN ] AER: Full history saved. [2025-10-17T17:04:39.170568] [INFO ] [MAIN ] Update Progress: 40/2368 symbols completed. AER took 24.1s. Estimated remaining: 4h 26m 60s. Rate: 8.7 symbols/min [2025-10-17T17:04:39.704745] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.862323] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.855152] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.881803] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.878275] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-17T17:04:39.882446] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-17T17:04:39.882942] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-17T17:04:39.883010] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-17T17:04:39.883181] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-17T17:04:39.883287] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-17T17:04:39.999812] [DEBUG] [LOCAL ] AFB: Loaded 11274 existing records from primary storage. [2025-10-17T17:04:40.004263] [INFO ] [MAIN ] AFB: Loaded 11274 existing records. [2025-10-17T17:04:40.254831] [DEBUG] [LOCAL ] AES: Loaded 54059 existing records from primary storage. [2025-10-17T17:04:40.283922] [INFO ] [MAIN ] AES: Loaded 54059 existing records. [2025-10-17T17:04:40.361531] [DEBUG] [LOCAL ] AESI: Loaded 50127 existing records from primary storage. [2025-10-17T17:04:40.432478] [INFO ] [MAIN ] AESI: Loaded 50127 existing records. [2025-10-17T17:04:40.689722] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:40.813527] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:40.832167] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-17T17:04:40.832383] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-17T17:04:40.895025] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-17T17:04:40.906328] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-17T17:04:40.907268] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-17T17:04:40.921210] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:40.953508] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-17T17:04:40.987154] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-17T17:04:41.016118] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:41.040527] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-17T17:04:41.040632] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-17T17:04:41.052403] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-17T17:04:41.052315] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-17T17:04:41.094425] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-17T17:04:41.105791] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-17T17:04:41.199285] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:04:41.361467] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-17T17:04:41.402523] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:04:41.423452] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-17T17:04:41.476841] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:04:41.570175] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-17T17:04:41.676502] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-17T17:04:41.740306] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-17T17:04:41.802451] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-17T17:04:41.912994] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:41.932093] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-17T17:04:41.928593] [INFO ] [MAIN ] Update Progress: 41/2368 symbols completed. AEXA took 2.8s. Estimated remaining: 4h 22m 59s. Rate: 8.8 symbols/min [2025-10-17T17:04:42.134097] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:42.186889] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-17T17:04:42.186413] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:42.225111] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-17T17:04:42.302319] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:42.340474] [DEBUG] [LOCAL ] AFG: Loaded 32434 existing records from primary storage. [2025-10-17T17:04:42.340794] [INFO ] [MAIN ] AFG: Loaded 32434 existing records. [2025-10-17T17:04:42.511518] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:42.511747] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-17T17:04:42.511809] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-17T17:04:42.512121] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-17T17:04:42.512200] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-17T17:04:42.863296] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:42.863801] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-17T17:04:42.874138] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T17:04:42.877062] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-17T17:04:43.650922] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:04:43.655276] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-17T17:04:43.874429] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:04:43.883583] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-17T17:04:43.964444] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:04:43.969825] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-17T17:04:44.149178] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T17:04:44.151984] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-17T17:04:44.294149] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T17:04:44.304938] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-17T17:04:44.799786] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T17:04:44.803340] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-17T17:04:44.871745] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T17:04:44.877690] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-17T17:04:45.022793] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:04:45.031724] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-17T17:04:45.379509] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:04:45.558029] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-17T17:04:46.035920] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T17:04:46.362562] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-17T17:04:46.373461] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:04:46.375144] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-17T17:04:46.459266] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:04:47.158027] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-17T17:04:47.604427] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:04:47.958073] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-17T17:04:48.758085] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-17T17:04:48.985269] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T17:04:49.074325] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T17:04:49.558023] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-17T17:04:50.364712] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-17T17:04:50.385574] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T17:04:50.969354] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T17:04:51.158036] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-17T17:04:51.669029] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-17T17:04:51.944616] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T17:04:51.957995] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-17T17:04:52.758096] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-17T17:04:53.295378] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T17:04:53.558032] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-17T17:04:53.612243] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T17:04:54.358042] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-17T17:04:55.158067] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-17T17:04:55.796279] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T17:04:55.907697] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:04:55.931962] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:04:55.958016] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-17T17:04:56.758005] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-17T17:04:56.795324] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:04:56.797244] [INFO ] [REMOTE ] AFB: Full fetch complete (16494 records). [2025-10-17T17:04:56.797312] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-17T17:04:57.162750] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-17T17:04:57.162856] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-17T17:04:57.163156] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-17T17:04:57.163204] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-17T17:04:57.163968] [DEBUG] [LOCAL ] AFB: Trimmed 16494 records to 11315 (keeping 200 days of data) [2025-10-17T17:04:57.230124] [DEBUG] [LOCAL ] AFB: Primary data saved (11315 records). [2025-10-17T17:04:57.230260] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-17T17:04:57.230343] [INFO ] [MAIN ] Update Progress: 42/2368 symbols completed. AFB took 18.1s. Estimated remaining: 4h 30m 44s. Rate: 8.6 symbols/min [2025-10-17T17:04:57.400623] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:57.400781] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-17T17:04:57.400823] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-17T17:04:57.400933] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-17T17:04:57.400973] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-17T17:04:57.401014] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-17T17:04:57.401046] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-17T17:04:57.558596] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-17T17:04:57.763924] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:58.358003] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-17T17:04:58.760234] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T17:04:58.840145] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T17:04:59.066686] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T17:04:59.158009] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-17T17:04:59.958073] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-17T17:05:00.185186] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:05:00.494628] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T17:05:00.758081] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-17T17:05:01.558053] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-17T17:05:01.893558] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-17T17:05:02.236351] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:05:02.358074] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-17T17:05:02.785741] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:05:03.158046] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-17T17:05:03.790454] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T17:05:03.958229] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-17T17:05:04.316611] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-17T17:05:04.758046] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-17T17:05:05.213328] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-17T17:05:05.558027] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-17T17:05:06.358020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-17T17:05:06.932552] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T17:05:07.158000] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-17T17:05:07.632117] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-17T17:05:07.958054] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-17T17:05:08.743859] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:05:08.758032] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-17T17:05:08.867999] [DEBUG] [REMOTE ] AFG: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T17:05:08.868308] [WARN ] [REMOTE ] AFG: No data returned for month 2025-08 [2025-10-17T17:05:08.868412] [FATAL] [REMOTE ] AFG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:05:08.868540] [FATAL] [MAIN ] AFG: Failed to fetch primary data. [2025-10-17T17:05:08.868628] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:05:08.868742] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-17T17:05:08.868824] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-17T17:05:08.868865] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-17T17:05:08.869152] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-17T17:05:08.869243] [INFO ] [MAIN ] Update Progress: 43/2368 symbols completed. AFG took 26.9s. Estimated remaining: 4h 34m 49s. Rate: 8.5 symbols/min [2025-10-17T17:05:09.047959] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:09.053221] [DEBUG] [LOCAL ] AFGC: Loaded 2570 existing records from primary storage. [2025-10-17T17:05:09.053441] [INFO ] [MAIN ] AFGC: Loaded 2570 existing records. [2025-10-17T17:05:09.238417] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:09.238695] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-17T17:05:09.238756] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-17T17:05:09.238919] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-17T17:05:09.238979] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-17T17:05:09.580555] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-17T17:05:09.585177] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:10.016743] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T17:05:10.166047] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-17T17:05:10.358013] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-17T17:05:10.922091] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T17:05:11.158040] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-17T17:05:11.700561] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T17:05:11.958000] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-17T17:05:12.758040] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-17T17:05:13.213929] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T17:05:13.558008] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-17T17:05:13.943708] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:05:14.030458] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:05:14.358033] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-17T17:05:14.752778] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-17T17:05:15.158042] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-17T17:05:15.958084] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-17T17:05:16.758048] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-17T17:05:16.801502] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:05:17.231019] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T17:05:17.231893] [INFO ] [REMOTE ] AFGB: Full fetch complete (3489 records). [2025-10-17T17:05:17.231966] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-17T17:05:17.232392] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:05:17.232479] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:05:17.232523] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:05:17.232565] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-17T17:05:17.232622] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-17T17:05:17.232691] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-17T17:05:17.232751] [DEBUG] [LOCAL ] AFGB: No derivative data file found to delete. [2025-10-17T17:05:17.232808] [INFO ] [MAIN ] Update Progress: 44/2368 symbols completed. AFGB took 20.0s. Estimated remaining: 4h 35m 49s. Rate: 8.4 symbols/min [2025-10-17T17:05:17.411181] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:17.416043] [DEBUG] [LOCAL ] AFGD: Loaded 1786 existing records from primary storage. [2025-10-17T17:05:17.416233] [INFO ] [MAIN ] AFGD: Loaded 1786 existing records. [2025-10-17T17:05:17.571234] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-17T17:05:17.612102] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:17.612322] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-17T17:05:17.612371] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-17T17:05:17.612527] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-17T17:05:17.612584] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-17T17:05:17.974124] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:18.006259] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T17:05:18.053360] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T17:05:18.358049] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-17T17:05:19.158034] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-17T17:05:19.844064] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T17:05:19.958081] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-17T17:05:20.181757] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T17:05:20.758048] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-17T17:05:21.558081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-17T17:05:21.718762] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:05:22.085570] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T17:05:22.358018] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-17T17:05:22.408601] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T17:05:22.417667] [INFO ] [REMOTE ] AESI: Full fetch complete (71418 records). [2025-10-17T17:05:22.417934] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-17T17:05:22.863189] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-17T17:05:22.869751] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-17T17:05:22.869902] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-17T17:05:22.870948] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-17T17:05:22.871038] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-17T17:05:22.873243] [DEBUG] [LOCAL ] AESI: Trimmed 71418 records to 50515 (keeping 200 days of data) [2025-10-17T17:05:23.167467] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-17T17:05:23.203111] [DEBUG] [LOCAL ] AESI: Primary data saved (50515 records). [2025-10-17T17:05:23.203240] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-17T17:05:23.204800] [INFO ] [MAIN ] Update Progress: 45/2368 symbols completed. AESI took 44.0s. Estimated remaining: 4h 34m 42s. Rate: 8.5 symbols/min [2025-10-17T17:05:23.370501] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:23.375570] [DEBUG] [LOCAL ] AFGE: Loaded 2380 existing records from primary storage. [2025-10-17T17:05:23.375769] [INFO ] [MAIN ] AFGE: Loaded 2380 existing records. [2025-10-17T17:05:23.549581] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:23.549810] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-17T17:05:23.549858] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-17T17:05:23.550004] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-17T17:05:23.550060] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-17T17:05:23.825917] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T17:05:23.910397] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:23.958096] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-17T17:05:24.400352] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T17:05:24.758042] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-17T17:05:25.205112] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T17:05:25.558037] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-17T17:05:26.014871] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T17:05:26.358047] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-17T17:05:26.938159] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T17:05:27.158081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-17T17:05:27.512321] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T17:05:27.958036] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-17T17:05:28.414481] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T17:05:28.758046] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-17T17:05:29.112113] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T17:05:29.558048] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-17T17:05:29.914157] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T17:05:30.358049] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-17T17:05:30.854477] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T17:05:30.855341] [INFO ] [REMOTE ] AFGC: Full fetch complete (3646 records). [2025-10-17T17:05:30.855433] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-17T17:05:31.164013] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-17T17:05:31.209845] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-17T17:05:31.209969] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-17T17:05:31.210124] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-17T17:05:31.210207] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-17T17:05:31.210571] [DEBUG] [LOCAL ] AFGC: Trimmed 3646 records to 2584 (keeping 200 days of data) [2025-10-17T17:05:31.226712] [DEBUG] [LOCAL ] AFGC: Primary data saved (2584 records). [2025-10-17T17:05:31.226793] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-17T17:05:31.226885] [INFO ] [MAIN ] Update Progress: 46/2368 symbols completed. AFGC took 22.4s. Estimated remaining: 4h 35m 22s. Rate: 8.4 symbols/min [2025-10-17T17:05:31.392038] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:31.446552] [DEBUG] [LOCAL ] AFL: Loaded 53580 existing records from primary storage. [2025-10-17T17:05:31.446892] [INFO ] [MAIN ] AFL: Loaded 53580 existing records. [2025-10-17T17:05:31.621131] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:31.621320] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-17T17:05:31.621366] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-17T17:05:31.621587] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-17T17:05:31.621638] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-17T17:05:31.722770] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:05:31.961265] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-17T17:05:31.983611] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:32.455114] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T17:05:32.758036] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-17T17:05:33.194732] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T17:05:33.558041] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-17T17:05:34.358017] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-17T17:05:35.158080] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-17T17:05:35.558904] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T17:05:35.769493] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T17:05:35.958040] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-17T17:05:36.589098] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-17T17:05:36.598072] [INFO ] [REMOTE ] AES: Full fetch complete (77846 records). [2025-10-17T17:05:36.598276] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-17T17:05:36.762465] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-17T17:05:36.986318] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-17T17:05:36.986406] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-17T17:05:36.987157] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-17T17:05:36.987228] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-17T17:05:36.989000] [DEBUG] [LOCAL ] AES: Trimmed 77846 records to 54448 (keeping 200 days of data) [2025-10-17T17:05:37.296037] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T17:05:37.321490] [DEBUG] [LOCAL ] AES: Primary data saved (54448 records). [2025-10-17T17:05:37.321627] [INFO ] [MAIN ] AES: Full history saved. [2025-10-17T17:05:37.321744] [INFO ] [MAIN ] Update Progress: 47/2368 symbols completed. AES took 58.2s. Estimated remaining: 4h 34m 24s. Rate: 8.5 symbols/min [2025-10-17T17:05:37.493423] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:37.541123] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-10-17T17:05:37.541546] [INFO ] [MAIN ] AG: Loaded 54033 existing records. [2025-10-17T17:05:37.563227] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-17T17:05:37.724824] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:37.725148] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-17T17:05:37.725237] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-17T17:05:37.725599] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-17T17:05:37.725789] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-17T17:05:37.938675] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T17:05:38.068102] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T17:05:38.151666] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:38.358039] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-17T17:05:38.809698] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:05:39.158038] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-17T17:05:39.958031] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-17T17:05:40.268541] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-17T17:05:40.451908] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T17:05:40.758035] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-17T17:05:41.110113] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T17:05:41.558090] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-17T17:05:42.126372] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T17:05:42.358032] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-17T17:05:42.787730] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T17:05:43.158053] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-17T17:05:43.958040] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-17T17:05:44.402544] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T17:05:44.403328] [INFO ] [REMOTE ] AFGE: Full fetch complete (3384 records). [2025-10-17T17:05:44.403407] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-17T17:05:44.762898] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-17T17:05:44.787062] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-17T17:05:44.787208] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-17T17:05:44.787417] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-17T17:05:44.787540] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-17T17:05:44.788391] [DEBUG] [LOCAL ] AFGE: Trimmed 3384 records to 2387 (keeping 200 days of data) [2025-10-17T17:05:44.803851] [DEBUG] [LOCAL ] AFGE: Primary data saved (2387 records). [2025-10-17T17:05:44.803935] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-17T17:05:44.804050] [INFO ] [MAIN ] Update Progress: 48/2368 symbols completed. AFGE took 21.6s. Estimated remaining: 4h 34m 36s. Rate: 8.4 symbols/min [2025-10-17T17:05:44.998841] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T17:05:45.001156] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:45.061405] [DEBUG] [LOCAL ] AGCO: Loaded 42651 existing records from primary storage. [2025-10-17T17:05:45.061727] [INFO ] [MAIN ] AGCO: Loaded 42651 existing records. [2025-10-17T17:05:45.241018] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:45.241226] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-17T17:05:45.241279] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-17T17:05:45.241555] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-17T17:05:45.241614] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-17T17:05:45.563102] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-17T17:05:45.601790] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:46.142899] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T17:05:46.358005] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-17T17:05:46.582109] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T17:05:47.158072] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-17T17:05:47.805744] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:05:47.958037] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-17T17:05:48.758071] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-17T17:05:49.214465] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T17:05:49.272789] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T17:05:49.558054] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-17T17:05:50.012199] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T17:05:50.358036] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-17T17:05:50.718580] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T17:05:51.158034] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-17T17:05:51.609848] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T17:05:51.958038] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-17T17:05:52.366010] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T17:05:52.366826] [INFO ] [REMOTE ] AFGD: Full fetch complete (2838 records). [2025-10-17T17:05:52.366895] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-17T17:05:52.752509] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-17T17:05:52.752623] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-17T17:05:52.752807] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-17T17:05:52.752946] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-17T17:05:52.753460] [DEBUG] [LOCAL ] AFGD: Trimmed 2838 records to 1791 (keeping 200 days of data) [2025-10-17T17:05:52.762388] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-17T17:05:52.765224] [DEBUG] [LOCAL ] AFGD: Primary data saved (1791 records). [2025-10-17T17:05:52.765317] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-17T17:05:52.765728] [INFO ] [MAIN ] Update Progress: 49/2368 symbols completed. AFGD took 35.5s. Estimated remaining: 4h 35m 10s. Rate: 8.4 symbols/min [2025-10-17T17:05:52.975127] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:52.977060] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T17:05:53.009827] [DEBUG] [LOCAL ] AGD: Loaded 19404 existing records from primary storage. [2025-10-17T17:05:53.010060] [INFO ] [MAIN ] AGD: Loaded 19404 existing records. [2025-10-17T17:05:53.194044] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:53.194308] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-17T17:05:53.194357] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-17T17:05:53.194621] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-17T17:05:53.194720] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-17T17:05:53.558273] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-17T17:05:53.560755] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:54.358026] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-17T17:05:54.640548] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:05:55.168441] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-17T17:05:55.174290] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:05:55.216402] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T17:05:55.958035] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-17T17:05:56.752490] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:05:56.757973] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-17T17:05:57.050322] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:05:57.413723] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T17:05:57.558058] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-17T17:05:58.358013] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-17T17:05:58.916003] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T17:05:59.158083] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-17T17:05:59.958020] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-17T17:06:00.063422] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:06:00.200315] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:06:00.758021] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-17T17:06:01.537060] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T17:06:01.558017] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-17T17:06:02.358024] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-17T17:06:02.722820] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T17:06:03.158041] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-17T17:06:03.840602] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-17T17:06:03.930523] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:06:03.957988] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-17T17:06:04.122098] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T17:06:04.758037] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-17T17:06:05.191319] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T17:06:05.557995] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-17T17:06:05.931941] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:06:06.358041] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-17T17:06:07.158036] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-17T17:06:07.642200] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T17:06:07.958091] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-17T17:06:07.993116] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:06:08.758012] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-17T17:06:09.196323] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T17:06:09.219753] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T17:06:09.558025] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-17T17:06:10.349462] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:06:10.358228] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-17T17:06:11.158047] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-17T17:06:11.574969] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T17:06:11.958008] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-17T17:06:12.266272] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T17:06:12.323126] [INFO ] [REMOTE ] AFL: Full fetch complete (77070 records). [2025-10-17T17:06:12.324189] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T17:06:12.324312] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-17T17:06:12.705666] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-17T17:06:12.705754] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-17T17:06:12.706446] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-17T17:06:12.706490] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-17T17:06:12.707900] [DEBUG] [LOCAL ] AFL: Trimmed 77070 records to 53965 (keeping 200 days of data) [2025-10-17T17:06:12.763531] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-17T17:06:13.037564] [DEBUG] [LOCAL ] AFL: Primary data saved (53965 records). [2025-10-17T17:06:13.037864] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-17T17:06:13.039037] [INFO ] [MAIN ] Update Progress: 50/2368 symbols completed. AFL took 41.8s. Estimated remaining: 4h 45m 12s. Rate: 8.1 symbols/min [2025-10-17T17:06:13.205408] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:13.258151] [DEBUG] [LOCAL ] AGI: Loaded 53813 existing records from primary storage. [2025-10-17T17:06:13.258460] [INFO ] [MAIN ] AGI: Loaded 53813 existing records. [2025-10-17T17:06:13.428414] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:13.428574] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-17T17:06:13.428621] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-17T17:06:13.429027] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-17T17:06:13.429085] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-17T17:06:13.564878] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-17T17:06:13.780591] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:13.836223] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:06:13.887567] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:06:13.893314] [INFO ] [REMOTE ] AGCO: Full fetch complete (61683 records). [2025-10-17T17:06:13.893409] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-17T17:06:14.281939] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-17T17:06:14.282085] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-17T17:06:14.282841] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-17T17:06:14.282950] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-17T17:06:14.296751] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T17:06:14.301570] [DEBUG] [LOCAL ] AGCO: Trimmed 61683 records to 42964 (keeping 200 days of data) [2025-10-17T17:06:14.361884] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-17T17:06:14.572006] [DEBUG] [LOCAL ] AGCO: Primary data saved (42964 records). [2025-10-17T17:06:14.572140] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-17T17:06:14.572222] [INFO ] [MAIN ] Update Progress: 51/2368 symbols completed. AGCO took 29.8s. Estimated remaining: 4h 40m 39s. Rate: 8.3 symbols/min [2025-10-17T17:06:14.735884] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:14.790074] [DEBUG] [LOCAL ] AGL: Loaded 52970 existing records from primary storage. [2025-10-17T17:06:14.790400] [INFO ] [MAIN ] AGL: Loaded 52970 existing records. [2025-10-17T17:06:14.960537] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:14.960816] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-17T17:06:14.960863] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-17T17:06:14.961272] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-17T17:06:14.961329] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-17T17:06:15.163252] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-17T17:06:15.316996] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:15.958073] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-17T17:06:16.171806] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T17:06:16.758043] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-17T17:06:17.081114] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T17:06:17.171244] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T17:06:17.557999] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-17T17:06:18.358039] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-17T17:06:18.477951] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T17:06:18.600528] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:06:18.604293] [INFO ] [REMOTE ] AGD: Full fetch complete (26568 records). [2025-10-17T17:06:18.604364] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-17T17:06:18.961339] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-17T17:06:18.961416] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-17T17:06:18.961749] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-17T17:06:18.961812] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-17T17:06:18.962844] [DEBUG] [LOCAL ] AGD: Trimmed 26568 records to 19496 (keeping 200 days of data) [2025-10-17T17:06:19.077832] [DEBUG] [LOCAL ] AGD: Primary data saved (19496 records). [2025-10-17T17:06:19.077964] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-17T17:06:19.078045] [INFO ] [MAIN ] Update Progress: 52/2368 symbols completed. AGD took 26.3s. Estimated remaining: 4h 38m 29s. Rate: 8.3 symbols/min [2025-10-17T17:06:19.165574] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-17T17:06:19.244368] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:19.256719] [DEBUG] [LOCAL ] AGM: Loaded 10792 existing records from primary storage. [2025-10-17T17:06:19.256927] [INFO ] [MAIN ] AGM: Loaded 10792 existing records. [2025-10-17T17:06:19.427687] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:19.427918] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-17T17:06:19.427965] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-17T17:06:19.428140] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-17T17:06:19.428177] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-17T17:06:19.778045] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:19.958031] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-17T17:06:20.216283] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T17:06:20.687520] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T17:06:20.758056] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-17T17:06:21.434777] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-17T17:06:21.451240] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-17T17:06:21.558024] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-17T17:06:22.358079] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-17T17:06:23.158078] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-17T17:06:23.778449] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T17:06:23.786218] [INFO ] [REMOTE ] AG: Full fetch complete (77781 records). [2025-10-17T17:06:23.786381] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-17T17:06:23.965125] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-17T17:06:24.189027] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-17T17:06:24.189133] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-17T17:06:24.190029] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-17T17:06:24.190106] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-17T17:06:24.191746] [DEBUG] [LOCAL ] AG: Trimmed 77781 records to 54423 (keeping 200 days of data) [2025-10-17T17:06:24.306693] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-17T17:06:24.547062] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T17:06:24.558205] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-10-17T17:06:24.558352] [INFO ] [MAIN ] AG: Full history saved. [2025-10-17T17:06:24.558460] [INFO ] [MAIN ] Update Progress: 53/2368 symbols completed. AG took 47.2s. Estimated remaining: 4h 37m 6s. Rate: 8.4 symbols/min [2025-10-17T17:06:24.690169] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T17:06:24.761377] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:24.761545] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-17T17:06:24.789041] [DEBUG] [LOCAL ] AGO: Loaded 28168 existing records from primary storage. [2025-10-17T17:06:24.789286] [INFO ] [MAIN ] AGO: Loaded 28168 existing records. [2025-10-17T17:06:24.964354] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:24.964550] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-17T17:06:24.964611] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-17T17:06:24.964956] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-17T17:06:24.965011] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-17T17:06:25.313551] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:25.558046] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-17T17:06:26.358113] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-17T17:06:26.477046] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T17:06:27.078600] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T17:06:27.157982] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-17T17:06:27.546898] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:06:27.768824] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:06:27.958073] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-17T17:06:28.758094] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-17T17:06:29.104453] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T17:06:29.558077] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-17T17:06:30.295786] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T17:06:30.358034] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-17T17:06:30.784914] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T17:06:31.158048] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-17T17:06:31.806311] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T17:06:31.958066] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-17T17:06:32.758065] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-17T17:06:32.787882] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:06:32.811205] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T17:06:33.558067] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-17T17:06:33.975530] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:06:34.358042] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-17T17:06:35.158085] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-17T17:06:35.315093] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:06:35.333238] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T17:06:35.958034] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-17T17:06:36.758080] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-17T17:06:37.056901] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T17:06:37.557987] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-17T17:06:37.754872] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:06:37.970459] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:06:38.358050] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-17T17:06:38.391525] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T17:06:39.158042] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-17T17:06:39.958007] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-17T17:06:39.997742] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:06:40.293386] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T17:06:40.758021] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-17T17:06:41.189830] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T17:06:41.558079] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-17T17:06:41.687058] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T17:06:41.689250] [INFO ] [REMOTE ] AGM: Full fetch complete (13302 records). [2025-10-17T17:06:41.689325] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-17T17:06:42.067066] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-17T17:06:42.067192] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-17T17:06:42.067442] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-17T17:06:42.067485] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-17T17:06:42.068034] [DEBUG] [LOCAL ] AGM: Trimmed 13302 records to 10847 (keeping 200 days of data) [2025-10-17T17:06:42.134331] [DEBUG] [LOCAL ] AGM: Primary data saved (10847 records). [2025-10-17T17:06:42.134457] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-17T17:06:42.134538] [INFO ] [MAIN ] Update Progress: 54/2368 symbols completed. AGM took 23.1s. Estimated remaining: 4h 44m 24s. Rate: 8.1 symbols/min [2025-10-17T17:06:42.302174] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:42.338869] [DEBUG] [LOCAL ] AGRO: Loaded 33278 existing records from primary storage. [2025-10-17T17:06:42.339171] [INFO ] [MAIN ] AGRO: Loaded 33278 existing records. [2025-10-17T17:06:42.369579] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-17T17:06:42.520271] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:42.520498] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-17T17:06:42.520557] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-17T17:06:42.520954] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-17T17:06:42.521011] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-17T17:06:42.895796] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:43.158007] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-17T17:06:43.344299] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T17:06:43.958031] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-17T17:06:44.154480] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:06:44.230597] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:06:44.758008] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-17T17:06:44.782497] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:06:45.558075] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-17T17:06:46.224010] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:06:46.358054] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-17T17:06:46.900202] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:06:47.158016] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-17T17:06:47.958037] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-17T17:06:47.996828] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:06:48.071020] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T17:06:48.758031] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-17T17:06:49.279824] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T17:06:49.558071] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-17T17:06:50.358039] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-17T17:06:50.700460] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:06:50.735386] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T17:06:51.158073] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-17T17:06:51.958047] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-17T17:06:52.470256] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T17:06:52.504082] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T17:06:52.758024] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-17T17:06:53.129009] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:06:53.558069] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-17T17:06:54.043539] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:06:54.358066] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-17T17:06:55.158030] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-17T17:06:55.199447] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:06:55.430879] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:06:55.958048] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-17T17:06:56.634337] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:06:56.758033] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-17T17:06:57.558048] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-17T17:06:57.763434] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T17:06:57.767748] [INFO ] [REMOTE ] AGO: Full fetch complete (39768 records). [2025-10-17T17:06:57.767840] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-17T17:06:58.117309] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T17:06:58.159719] [INFO ] [REMOTE ] AGL: Full fetch complete (75897 records). [2025-10-17T17:06:58.162067] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-17T17:06:58.259498] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-17T17:06:58.290683] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-17T17:06:58.291442] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-17T17:06:58.296906] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-17T17:06:58.370715] [DEBUG] [LOCAL ] AGO: Trimmed 39768 records to 28374 (keeping 200 days of data) [2025-10-17T17:06:58.370852] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-17T17:06:58.716500] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-17T17:06:58.716607] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-17T17:06:58.717583] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-17T17:06:58.718154] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-17T17:06:58.742500] [DEBUG] [LOCAL ] AGL: Trimmed 75897 records to 53357 (keeping 200 days of data) [2025-10-17T17:06:58.745041] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T17:06:58.907563] [DEBUG] [LOCAL ] AGO: Primary data saved (28374 records). [2025-10-17T17:06:58.908441] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-17T17:06:58.908875] [INFO ] [MAIN ] Update Progress: 55/2368 symbols completed. AGO took 34.4s. Estimated remaining: 4h 50m 52s. Rate: 8.0 symbols/min [2025-10-17T17:06:59.109244] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:59.160927] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-17T17:06:59.285950] [DEBUG] [LOCAL ] AGX: Loaded 33089 existing records from primary storage. [2025-10-17T17:06:59.307573] [INFO ] [MAIN ] AGX: Loaded 33089 existing records. [2025-10-17T17:06:59.405784] [DEBUG] [LOCAL ] AGL: Primary data saved (53357 records). [2025-10-17T17:06:59.421739] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-17T17:06:59.429929] [INFO ] [MAIN ] Update Progress: 56/2368 symbols completed. AGL took 44.9s. Estimated remaining: 4h 45m 55s. Rate: 8.1 symbols/min [2025-10-17T17:06:59.626760] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:59.630030] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-17T17:06:59.630407] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-17T17:06:59.641941] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-17T17:06:59.642046] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-17T17:06:59.826111] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:00.152575] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:00.155510] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-17T17:07:00.157925] [DEBUG] [LOCAL ] AHH: Loaded 40838 existing records from primary storage. [2025-10-17T17:07:00.158817] [INFO ] [MAIN ] AHH: Loaded 40838 existing records. [2025-10-17T17:07:00.377718] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T17:07:00.400315] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:00.400819] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-17T17:07:00.400881] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-17T17:07:00.412062] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-17T17:07:00.412197] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-17T17:07:00.690156] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:07:00.763151] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-17T17:07:00.863068] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:01.558039] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-17T17:07:01.986300] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:07:02.358070] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-17T17:07:02.589398] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T17:07:02.596709] [INFO ] [REMOTE ] AGI: Full fetch complete (76897 records). [2025-10-17T17:07:02.596863] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-17T17:07:02.597764] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:07:02.597858] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:07:02.597901] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:07:02.597964] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-17T17:07:02.598044] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-17T17:07:02.598099] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-17T17:07:02.598460] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-17T17:07:02.598558] [INFO ] [MAIN ] Update Progress: 57/2368 symbols completed. AGI took 49.6s. Estimated remaining: 4h 42m 55s. Rate: 8.2 symbols/min [2025-10-17T17:07:02.772940] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:02.773138] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-17T17:07:02.773178] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-17T17:07:02.773298] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-17T17:07:02.773341] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-17T17:07:02.773382] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-17T17:07:02.773417] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-17T17:07:03.088610] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:07:03.165394] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-17T17:07:03.180053] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:03.761167] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:07:03.958066] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-17T17:07:04.490953] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:07:04.758068] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-17T17:07:05.411317] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T17:07:05.558050] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-17T17:07:05.986195] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T17:07:05.990705] [INFO ] [REMOTE ] AGRO: Full fetch complete (49042 records). [2025-10-17T17:07:05.990815] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-17T17:07:06.371057] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-17T17:07:06.398882] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-17T17:07:06.398952] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-17T17:07:06.399512] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-17T17:07:06.399577] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-17T17:07:06.400848] [DEBUG] [LOCAL ] AGRO: Trimmed 49042 records to 33606 (keeping 200 days of data) [2025-10-17T17:07:06.602480] [DEBUG] [LOCAL ] AGRO: Primary data saved (33606 records). [2025-10-17T17:07:06.602630] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-17T17:07:06.602757] [INFO ] [MAIN ] Update Progress: 58/2368 symbols completed. AGRO took 24.5s. Estimated remaining: 4h 40m 34s. Rate: 8.2 symbols/min [2025-10-17T17:07:06.706393] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:07:06.722573] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-17T17:07:06.732952] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:07:06.754410] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-17T17:07:06.761279] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:07:06.761388] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-17T17:07:06.779562] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-17T17:07:06.779475] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:06.780052] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-17T17:07:06.780128] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-17T17:07:06.780207] [INFO ] [MAIN ] Update Progress: 59/2368 symbols completed. AHL took 4.2s. Estimated remaining: 4h 35m 49s. Rate: 8.4 symbols/min [2025-10-17T17:07:06.958290] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:06.976965] [DEBUG] [LOCAL ] AHT: Loaded 6425 existing records from primary storage. [2025-10-17T17:07:06.977195] [INFO ] [MAIN ] AHT: Loaded 6425 existing records. [2025-10-17T17:07:07.096981] [DEBUG] [LOCAL ] AHR: Loaded 49438 existing records from primary storage. [2025-10-17T17:07:07.113270] [INFO ] [MAIN ] AHR: Loaded 49438 existing records. [2025-10-17T17:07:07.224598] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:07.184432] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-17T17:07:07.249350] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-17T17:07:07.271149] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-17T17:07:07.276750] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-17T17:07:07.286560] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-17T17:07:07.454046] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:07.494031] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-17T17:07:07.494694] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-17T17:07:07.508705] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T17:07:07.526902] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-17T17:07:07.532164] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-17T17:07:07.984760] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-17T17:07:08.026244] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:08.163959] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:08.757999] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-17T17:07:08.933275] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T17:07:09.558046] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-17T17:07:09.604672] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:07:10.224727] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:07:10.358006] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-17T17:07:10.582315] [DEBUG] [REMOTE ] AHR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-17T17:07:10.582615] [WARN ] [REMOTE ] AHR: No data returned for month 2025-01 [2025-10-17T17:07:10.582751] [FATAL] [REMOTE ] AHR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:07:10.582883] [FATAL] [MAIN ] AHR: Failed to fetch primary data. [2025-10-17T17:07:10.582967] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:07:10.583058] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-17T17:07:10.583139] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-17T17:07:10.583180] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-17T17:07:10.583292] [DEBUG] [LOCAL ] AHR: Deleted derivative data file. [2025-10-17T17:07:10.583360] [INFO ] [MAIN ] Update Progress: 60/2368 symbols completed. AHR took 4.0s. Estimated remaining: 4h 33m 32s. Rate: 8.4 symbols/min [2025-10-17T17:07:10.696192] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T17:07:10.769235] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:10.823801] [DEBUG] [LOCAL ] AI: Loaded 54155 existing records from primary storage. [2025-10-17T17:07:10.824122] [INFO ] [MAIN ] AI: Loaded 54155 existing records. [2025-10-17T17:07:10.997185] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:10.997396] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-17T17:07:10.997444] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-17T17:07:10.997850] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-17T17:07:10.997907] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-17T17:07:11.169629] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-17T17:07:11.349732] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:11.958032] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-17T17:07:12.759091] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:07:12.758336] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-17T17:07:13.558020] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-17T17:07:13.955172] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T17:07:14.271370] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T17:07:14.357981] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-17T17:07:14.875272] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:07:15.158049] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-17T17:07:15.958090] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-17T17:07:16.660802] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T17:07:16.758000] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-17T17:07:16.799515] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:07:17.031006] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:07:17.359189] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:07:17.558037] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-17T17:07:18.358047] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-17T17:07:18.846265] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:07:19.158040] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-17T17:07:19.850842] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T17:07:19.958054] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-17T17:07:20.212485] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T17:07:20.758060] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-17T17:07:20.839533] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T17:07:21.558035] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-17T17:07:22.358100] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-17T17:07:22.525288] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:07:22.876797] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T17:07:23.158078] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-17T17:07:23.915401] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-17T17:07:23.957990] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-17T17:07:24.710996] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:07:24.757989] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-17T17:07:25.558031] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-17T17:07:26.109545] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T17:07:26.315604] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T17:07:26.357988] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-17T17:07:26.387328] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T17:07:27.158054] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-17T17:07:27.958039] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-17T17:07:28.383952] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:07:28.618478] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T17:07:28.758021] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-17T17:07:29.106913] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T17:07:29.558041] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-17T17:07:30.090162] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T17:07:30.358059] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-17T17:07:30.922029] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T17:07:30.926321] [INFO ] [REMOTE ] AGX: Full fetch complete (48983 records). [2025-10-17T17:07:30.926494] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-17T17:07:31.163191] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-17T17:07:31.309828] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-17T17:07:31.309914] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-17T17:07:31.310546] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-17T17:07:31.310633] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-17T17:07:31.311717] [DEBUG] [LOCAL ] AGX: Trimmed 48983 records to 33316 (keeping 200 days of data) [2025-10-17T17:07:31.518740] [DEBUG] [LOCAL ] AGX: Primary data saved (33316 records). [2025-10-17T17:07:31.518890] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-17T17:07:31.519028] [INFO ] [MAIN ] Update Progress: 61/2368 symbols completed. AGX took 32.6s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-17T17:07:31.689207] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:31.741287] [DEBUG] [LOCAL ] AIG: Loaded 53860 existing records from primary storage. [2025-10-17T17:07:31.741693] [INFO ] [MAIN ] AIG: Loaded 53860 existing records. [2025-10-17T17:07:31.954829] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:07:31.961129] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:31.969976] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-17T17:07:31.961407] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-17T17:07:31.971966] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-17T17:07:31.972241] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-17T17:07:31.972346] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-17T17:07:32.083157] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:07:32.338221] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:32.758095] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-17T17:07:33.279736] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T17:07:33.558033] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-17T17:07:34.341183] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-17T17:07:34.358000] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-17T17:07:34.961013] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T17:07:35.158046] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-17T17:07:35.958075] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-17T17:07:36.678127] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T17:07:36.757994] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-17T17:07:36.983989] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-17T17:07:37.062842] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:07:37.558042] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-17T17:07:37.655069] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T17:07:38.358070] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-17T17:07:39.080293] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T17:07:39.082004] [INFO ] [REMOTE ] AHT: Full fetch complete (9138 records). [2025-10-17T17:07:39.082119] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-17T17:07:39.165044] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-17T17:07:39.459684] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-17T17:07:39.459777] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-17T17:07:39.459975] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-17T17:07:39.460014] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-17T17:07:39.460513] [DEBUG] [LOCAL ] AHT: Trimmed 9138 records to 6493 (keeping 200 days of data) [2025-10-17T17:07:39.503374] [DEBUG] [LOCAL ] AHT: Primary data saved (6493 records). [2025-10-17T17:07:39.503574] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-17T17:07:39.503749] [INFO ] [MAIN ] Update Progress: 62/2368 symbols completed. AHT took 32.7s. Estimated remaining: 4h 42m 25s. Rate: 8.2 symbols/min [2025-10-17T17:07:39.677011] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:39.677276] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-17T17:07:39.677325] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-17T17:07:39.677442] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-17T17:07:39.677485] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-17T17:07:39.677593] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-17T17:07:39.677635] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-17T17:07:39.960104] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-17T17:07:40.069796] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:40.101363] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T17:07:40.471532] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:07:40.477850] [INFO ] [REMOTE ] AHH: Full fetch complete (59640 records). [2025-10-17T17:07:40.477979] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-17T17:07:40.763780] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-17T17:07:40.864431] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-17T17:07:40.864636] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-17T17:07:40.865294] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-17T17:07:40.865342] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-17T17:07:40.866534] [DEBUG] [LOCAL ] AHH: Trimmed 59640 records to 41118 (keeping 200 days of data) [2025-10-17T17:07:41.102908] [DEBUG] [LOCAL ] AHH: Primary data saved (41118 records). [2025-10-17T17:07:41.103156] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-17T17:07:41.103261] [INFO ] [MAIN ] Update Progress: 63/2368 symbols completed. AHH took 41.7s. Estimated remaining: 4h 38m 47s. Rate: 8.3 symbols/min [2025-10-17T17:07:41.283372] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:41.312412] [DEBUG] [LOCAL ] AIN: Loaded 24655 existing records from primary storage. [2025-10-17T17:07:41.312801] [INFO ] [MAIN ] AIN: Loaded 24655 existing records. [2025-10-17T17:07:41.500658] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:41.500951] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-17T17:07:41.501005] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-17T17:07:41.501276] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-17T17:07:41.501317] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-17T17:07:41.565844] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-17T17:07:41.773320] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:07:41.802196] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-17T17:07:41.819914] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:07:41.830514] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-17T17:07:41.835768] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:07:41.861090] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-17T17:07:41.898938] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-17T17:07:41.903796] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:41.904197] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-17T17:07:41.904338] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-17T17:07:41.904567] [INFO ] [MAIN ] Update Progress: 64/2368 symbols completed. AII took 2.4s. Estimated remaining: 4h 34m 47s. Rate: 8.4 symbols/min [2025-10-17T17:07:42.123727] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:42.132223] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T17:07:42.157375] [DEBUG] [LOCAL ] AIO: Loaded 13450 existing records from primary storage. [2025-10-17T17:07:42.157709] [INFO ] [MAIN ] AIO: Loaded 13450 existing records. [2025-10-17T17:07:42.329770] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:42.329993] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-17T17:07:42.330043] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-17T17:07:42.330225] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-17T17:07:42.330282] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-17T17:07:42.363273] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-17T17:07:42.681189] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:42.989864] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-17T17:07:43.158031] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-17T17:07:43.695836] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:07:43.958041] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-17T17:07:44.291010] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T17:07:44.689312] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T17:07:44.758066] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-17T17:07:45.558050] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-17T17:07:46.358010] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-17T17:07:46.390460] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:07:47.158092] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-17T17:07:47.349283] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:07:47.958030] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-17T17:07:48.247768] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-17T17:07:48.255400] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-17T17:07:48.255555] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-17T17:07:48.674192] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-17T17:07:48.674333] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-17T17:07:48.675329] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-17T17:07:48.675400] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-17T17:07:48.678010] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 54545 (keeping 200 days of data) [2025-10-17T17:07:48.770006] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-17T17:07:48.913804] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T17:07:49.050635] [DEBUG] [LOCAL ] AI: Primary data saved (54545 records). [2025-10-17T17:07:49.050883] [INFO ] [MAIN ] AI: Full history saved. [2025-10-17T17:07:49.051011] [INFO ] [MAIN ] Update Progress: 65/2368 symbols completed. AI took 38.5s. Estimated remaining: 4h 34m 40s. Rate: 8.4 symbols/min [2025-10-17T17:07:49.229998] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:49.262809] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T17:07:49.299934] [DEBUG] [LOCAL ] AIR: Loaded 29128 existing records from primary storage. [2025-10-17T17:07:49.300297] [INFO ] [MAIN ] AIR: Loaded 29128 existing records. [2025-10-17T17:07:49.487003] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:49.487344] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-17T17:07:49.487398] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-17T17:07:49.487813] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-17T17:07:49.487872] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-17T17:07:49.559998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-17T17:07:49.756680] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T17:07:49.888516] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:50.178418] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T17:07:50.358059] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-17T17:07:51.158006] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-17T17:07:51.397065] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:07:51.958052] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-17T17:07:52.043484] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T17:07:52.758038] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-17T17:07:53.140250] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:07:53.247203] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T17:07:53.558056] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-17T17:07:54.358016] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-17T17:07:55.158032] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-17T17:07:55.319039] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:07:55.817097] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T17:07:55.958020] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-17T17:07:56.439290] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T17:07:56.758008] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-17T17:07:57.065542] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:07:57.558008] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-17T17:07:57.740693] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T17:07:58.358025] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-17T17:07:59.158012] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-17T17:07:59.236384] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:07:59.371862] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T17:07:59.638181] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T17:07:59.958063] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-17T17:08:00.758037] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-17T17:08:01.351198] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T17:08:01.558032] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-17T17:08:02.045077] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:08:02.358042] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-17T17:08:02.869250] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:08:03.158016] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-17T17:08:03.547522] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:08:03.958038] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-17T17:08:04.325909] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:08:04.725090] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T17:08:04.757987] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-17T17:08:05.558002] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-17T17:08:05.575500] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:08:06.358032] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-17T17:08:07.158033] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-17T17:08:07.331923] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T17:08:07.355016] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:08:07.871830] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T17:08:07.874184] [INFO ] [REMOTE ] AIO: Full fetch complete (20086 records). [2025-10-17T17:08:07.874284] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-17T17:08:07.963141] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-17T17:08:08.241134] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-17T17:08:08.241212] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-17T17:08:08.241481] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-17T17:08:08.241522] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-17T17:08:08.242108] [DEBUG] [LOCAL ] AIO: Trimmed 20086 records to 13513 (keeping 200 days of data) [2025-10-17T17:08:08.329077] [DEBUG] [LOCAL ] AIO: Primary data saved (13513 records). [2025-10-17T17:08:08.329305] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-17T17:08:08.329419] [INFO ] [MAIN ] Update Progress: 66/2368 symbols completed. AIO took 26.4s. Estimated remaining: 4h 41m 36s. Rate: 8.2 symbols/min [2025-10-17T17:08:08.522571] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:08.553320] [DEBUG] [LOCAL ] AIT: Loaded 27175 existing records from primary storage. [2025-10-17T17:08:08.553636] [INFO ] [MAIN ] AIT: Loaded 27175 existing records. [2025-10-17T17:08:08.751372] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:08.751612] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-17T17:08:08.751689] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-17T17:08:08.751980] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-17T17:08:08.752037] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-17T17:08:08.764085] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-17T17:08:09.161907] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:09.557992] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-17T17:08:09.607813] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:08:10.006473] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:08:10.358054] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-17T17:08:10.879258] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:08:11.158007] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-17T17:08:11.405161] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T17:08:11.958050] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-17T17:08:12.484144] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T17:08:12.758030] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-17T17:08:12.976257] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T17:08:12.979957] [INFO ] [REMOTE ] AIN: Full fetch complete (33688 records). [2025-10-17T17:08:12.980042] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-17T17:08:13.341028] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-17T17:08:13.341126] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-17T17:08:13.341501] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-17T17:08:13.341543] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-17T17:08:13.342302] [DEBUG] [LOCAL ] AIN: Trimmed 33688 records to 24822 (keeping 200 days of data) [2025-10-17T17:08:13.486183] [DEBUG] [LOCAL ] AIN: Primary data saved (24822 records). [2025-10-17T17:08:13.486323] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-17T17:08:13.486409] [INFO ] [MAIN ] Update Progress: 67/2368 symbols completed. AIN took 32.4s. Estimated remaining: 4h 40m 13s. Rate: 8.2 symbols/min [2025-10-17T17:08:13.564080] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-17T17:08:13.662287] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:13.701801] [DEBUG] [LOCAL ] AIV: Loaded 41824 existing records from primary storage. [2025-10-17T17:08:13.702108] [INFO ] [MAIN ] AIV: Loaded 41824 existing records. [2025-10-17T17:08:13.881147] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:13.881482] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-17T17:08:13.881562] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-17T17:08:13.881979] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-17T17:08:13.882038] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-17T17:08:14.100117] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T17:08:14.306245] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:14.357990] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-17T17:08:15.158094] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-17T17:08:15.355318] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T17:08:15.964353] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-17T17:08:15.989671] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:08:16.642558] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:08:16.758020] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-17T17:08:17.507392] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:08:17.558070] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-17T17:08:18.041075] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T17:08:18.358044] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-17T17:08:19.158029] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-17T17:08:19.311266] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T17:08:19.318722] [INFO ] [REMOTE ] AIG: Full fetch complete (77560 records). [2025-10-17T17:08:19.318854] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-17T17:08:19.713085] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-17T17:08:19.713229] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-17T17:08:19.714023] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-17T17:08:19.714090] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-17T17:08:19.715581] [DEBUG] [LOCAL ] AIG: Trimmed 77560 records to 54247 (keeping 200 days of data) [2025-10-17T17:08:19.962489] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-17T17:08:19.978674] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:08:20.091510] [DEBUG] [LOCAL ] AIG: Primary data saved (54247 records). [2025-10-17T17:08:20.091666] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-17T17:08:20.091768] [INFO ] [MAIN ] Update Progress: 68/2368 symbols completed. AIG took 48.6s. Estimated remaining: 4h 39m 42s. Rate: 8.2 symbols/min [2025-10-17T17:08:20.259633] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:20.287579] [DEBUG] [LOCAL ] AIZ: Loaded 29712 existing records from primary storage. [2025-10-17T17:08:20.287921] [INFO ] [MAIN ] AIZ: Loaded 29712 existing records. [2025-10-17T17:08:20.481224] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:20.481455] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-17T17:08:20.481576] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-17T17:08:20.483917] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-17T17:08:20.484003] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-17T17:08:20.604228] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:08:20.763213] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-17T17:08:20.861554] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:21.440296] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:08:21.558017] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-17T17:08:22.185329] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:08:22.358056] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-17T17:08:22.833859] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:08:23.158093] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-17T17:08:23.856690] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T17:08:23.958065] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-17T17:08:24.270767] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:08:24.758060] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-17T17:08:25.130903] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:08:25.558071] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-17T17:08:25.758601] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:08:26.358122] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-17T17:08:27.029821] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T17:08:27.157993] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-17T17:08:27.763754] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T17:08:27.958005] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-17T17:08:28.173409] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T17:08:28.758040] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-17T17:08:29.028272] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T17:08:29.558028] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-17T17:08:30.351259] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T17:08:30.356452] [INFO ] [REMOTE ] AIR: Full fetch complete (40277 records). [2025-10-17T17:08:30.356541] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-17T17:08:30.367701] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-17T17:08:30.729900] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-17T17:08:30.730056] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-17T17:08:30.730506] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-17T17:08:30.730551] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-17T17:08:30.731504] [DEBUG] [LOCAL ] AIR: Trimmed 40277 records to 29335 (keeping 200 days of data) [2025-10-17T17:08:30.848526] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:08:30.921603] [DEBUG] [LOCAL ] AIR: Primary data saved (29335 records). [2025-10-17T17:08:30.921770] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-17T17:08:30.921866] [INFO ] [MAIN ] Update Progress: 69/2368 symbols completed. AIR took 41.9s. Estimated remaining: 4h 41m 33s. Rate: 8.2 symbols/min [2025-10-17T17:08:31.086566] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:31.092329] [DEBUG] [LOCAL ] AIZN: Loaded 3972 existing records from primary storage. [2025-10-17T17:08:31.092526] [INFO ] [MAIN ] AIZN: Loaded 3972 existing records. [2025-10-17T17:08:31.165437] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-17T17:08:31.268534] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:31.269059] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-17T17:08:31.269115] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-17T17:08:31.269307] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-17T17:08:31.269364] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-17T17:08:31.620239] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:31.939454] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:08:31.957987] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-17T17:08:32.252746] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:08:32.696932] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T17:08:32.758045] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-17T17:08:33.540064] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T17:08:33.557988] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-17T17:08:34.154699] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:08:34.358114] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-17T17:08:35.158099] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-17T17:08:35.558395] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:08:35.562365] [INFO ] [REMOTE ] AIT: Full fetch complete (39221 records). [2025-10-17T17:08:35.562470] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-17T17:08:35.933133] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-17T17:08:35.933218] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-17T17:08:35.933687] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-17T17:08:35.933752] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-17T17:08:35.934842] [DEBUG] [LOCAL ] AIT: Trimmed 39221 records to 27357 (keeping 200 days of data) [2025-10-17T17:08:35.993189] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-17T17:08:36.117792] [DEBUG] [LOCAL ] AIT: Primary data saved (27357 records). [2025-10-17T17:08:36.117932] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-17T17:08:36.118032] [INFO ] [MAIN ] Update Progress: 70/2368 symbols completed. AIT took 27.8s. Estimated remaining: 4h 40m 15s. Rate: 8.2 symbols/min [2025-10-17T17:08:36.298364] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:36.349362] [DEBUG] [LOCAL ] AJG: Loaded 46920 existing records from primary storage. [2025-10-17T17:08:36.349754] [INFO ] [MAIN ] AJG: Loaded 46920 existing records. [2025-10-17T17:08:36.540366] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:36.540962] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-17T17:08:36.541212] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-17T17:08:36.544399] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-17T17:08:36.544530] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T17:08:36.544693] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-17T17:08:36.765880] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-17T17:08:36.876188] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T17:08:36.953516] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:37.442270] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T17:08:37.558053] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-17T17:08:38.358066] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-17T17:08:38.364452] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:08:39.158052] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-17T17:08:39.903243] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:08:39.958038] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-17T17:08:40.658108] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:08:40.758033] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-17T17:08:41.072253] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-17T17:08:41.444980] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:08:41.558045] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-17T17:08:42.358038] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-17T17:08:43.158047] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-17T17:08:43.200898] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:08:43.739776] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T17:08:43.825488] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:08:43.958065] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-17T17:08:44.758063] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-17T17:08:45.546206] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:08:45.562310] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-17T17:08:46.108108] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T17:08:46.268948] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T17:08:46.358021] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-17T17:08:47.158063] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-17T17:08:47.522224] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T17:08:47.958046] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-17T17:08:48.527331] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T17:08:48.758039] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-17T17:08:48.868507] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:08:48.875280] [INFO ] [REMOTE ] AIV: Full fetch complete (60411 records). [2025-10-17T17:08:48.875404] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-17T17:08:49.206160] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T17:08:49.261977] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-17T17:08:49.262061] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-17T17:08:49.262670] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-17T17:08:49.262736] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-17T17:08:49.263989] [DEBUG] [LOCAL ] AIV: Trimmed 60411 records to 42194 (keeping 200 days of data) [2025-10-17T17:08:49.504996] [DEBUG] [LOCAL ] AIV: Primary data saved (42194 records). [2025-10-17T17:08:49.505124] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-17T17:08:49.505206] [INFO ] [MAIN ] Update Progress: 71/2368 symbols completed. AIV took 36.0s. Estimated remaining: 4h 43m 24s. Rate: 8.1 symbols/min [2025-10-17T17:08:49.566362] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-17T17:08:49.677101] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:49.677291] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-17T17:08:49.677348] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-17T17:08:49.677483] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-17T17:08:49.677558] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-17T17:08:49.677613] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-17T17:08:49.677680] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-17T17:08:50.043432] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:50.358052] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-17T17:08:51.147038] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T17:08:51.157979] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-17T17:08:51.957997] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-17T17:08:51.997730] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:08:52.266161] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:08:52.585258] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-17T17:08:52.586403] [INFO ] [REMOTE ] AIZN: Full fetch complete (5864 records). [2025-10-17T17:08:52.586471] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-17T17:08:52.759827] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-17T17:08:52.941077] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-17T17:08:52.941174] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-17T17:08:52.941363] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-17T17:08:52.941404] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-17T17:08:52.941809] [DEBUG] [LOCAL ] AIZN: Trimmed 5864 records to 3995 (keeping 200 days of data) [2025-10-17T17:08:52.965287] [DEBUG] [LOCAL ] AIZN: Primary data saved (3995 records). [2025-10-17T17:08:52.965360] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-17T17:08:52.965446] [INFO ] [MAIN ] Update Progress: 72/2368 symbols completed. AIZN took 22.0s. Estimated remaining: 4h 41m 11s. Rate: 8.2 symbols/min [2025-10-17T17:08:53.130732] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:53.174273] [DEBUG] [LOCAL ] AKR: Loaded 46457 existing records from primary storage. [2025-10-17T17:08:53.174569] [INFO ] [MAIN ] AKR: Loaded 46457 existing records. [2025-10-17T17:08:53.282134] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-17T17:08:53.355287] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:53.355510] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-17T17:08:53.355558] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-17T17:08:53.355958] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-17T17:08:53.356015] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-17T17:08:53.566850] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-17T17:08:53.723553] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:54.358033] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-17T17:08:54.831980] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T17:08:54.974954] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:08:55.158030] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-17T17:08:55.958079] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-17T17:08:56.511349] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:08:56.758041] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-17T17:08:57.321077] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T17:08:57.558026] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-17T17:08:58.025846] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:08:58.153219] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T17:08:58.358057] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-17T17:08:58.799744] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T17:08:59.158038] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-17T17:08:59.958029] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-17T17:09:00.501709] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T17:09:00.595840] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T17:09:00.758000] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-17T17:09:01.558016] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-17T17:09:01.683169] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T17:09:02.358015] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-17T17:09:02.607166] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T17:09:03.158030] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-17T17:09:03.706933] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T17:09:03.731558] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:09:03.958034] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-17T17:09:04.322343] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-17T17:09:04.758047] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-17T17:09:05.557997] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-17T17:09:05.702675] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:09:05.706120] [INFO ] [REMOTE ] AIZ: Full fetch complete (42641 records). [2025-10-17T17:09:05.706227] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-17T17:09:05.706904] [FATAL] [VALIDATOR ] AIZ: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:09:05.706989] [FATAL] [MAIN ] AIZ: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:09:05.707032] [WARN ] [MAIN ] AIZ: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:09:05.707072] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-17T17:09:05.707128] [DEBUG] [LOCAL ] AIZ: No primary data file found to delete. [2025-10-17T17:09:05.707163] [INFO ] [LOCAL ] AIZ: Starting deletion of derivative data. [2025-10-17T17:09:05.707311] [DEBUG] [LOCAL ] AIZ: Deleted derivative data file. [2025-10-17T17:09:05.707399] [INFO ] [MAIN ] Update Progress: 73/2368 symbols completed. AIZ took 45.6s. Estimated remaining: 4h 43m 53s. Rate: 8.1 symbols/min [2025-10-17T17:09:05.875623] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:05.899879] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T17:09:05.917019] [DEBUG] [LOCAL ] AL: Loaded 45074 existing records from primary storage. [2025-10-17T17:09:05.917345] [INFO ] [MAIN ] AL: Loaded 45074 existing records. [2025-10-17T17:09:06.099084] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:06.099462] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-17T17:09:06.099525] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-17T17:09:06.100267] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-17T17:09:06.100326] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-17T17:09:06.363172] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-17T17:09:06.449474] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:07.158025] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-17T17:09:07.958121] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-17T17:09:08.171864] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T17:09:08.355797] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T17:09:08.758000] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-17T17:09:08.879801] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T17:09:09.241166] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T17:09:09.242363] [INFO ] [REMOTE ] AKA: Full fetch complete (2748 records). [2025-10-17T17:09:09.242431] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-17T17:09:09.424109] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T17:09:09.424314] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:09:09.424383] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:09:09.424457] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-17T17:09:09.424534] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-17T17:09:09.424603] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-17T17:09:09.424703] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-17T17:09:09.424774] [INFO ] [MAIN ] Update Progress: 74/2368 symbols completed. AKA took 19.9s. Estimated remaining: 4h 41m 51s. Rate: 8.1 symbols/min [2025-10-17T17:09:09.563182] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-17T17:09:09.594891] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:09.647334] [DEBUG] [LOCAL ] ALB: Loaded 53733 existing records from primary storage. [2025-10-17T17:09:09.647741] [INFO ] [MAIN ] ALB: Loaded 53733 existing records. [2025-10-17T17:09:09.822291] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:09.822504] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-17T17:09:09.822550] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-17T17:09:09.823054] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-17T17:09:09.823111] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-17T17:09:10.171197] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:10.358051] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-17T17:09:11.073032] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T17:09:11.158033] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-17T17:09:11.958039] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-17T17:09:12.209750] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T17:09:12.395158] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:09:12.758092] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-17T17:09:13.460055] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:09:13.558015] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-17T17:09:14.309050] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:09:14.358029] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-17T17:09:15.158036] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-17T17:09:15.222075] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:09:15.958035] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-17T17:09:16.029175] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:09:16.600743] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T17:09:16.758058] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-17T17:09:17.436187] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:09:17.558151] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-17T17:09:18.346456] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T17:09:18.357976] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-17T17:09:19.158006] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-17T17:09:19.309114] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:09:19.869383] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T17:09:19.957997] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-17T17:09:20.588060] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T17:09:20.594419] [INFO ] [REMOTE ] AJG: Full fetch complete (69038 records). [2025-10-17T17:09:20.594568] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-17T17:09:20.766388] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-17T17:09:20.986752] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-17T17:09:20.986832] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-17T17:09:20.987556] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-17T17:09:20.987620] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-17T17:09:20.989518] [DEBUG] [LOCAL ] AJG: Trimmed 69038 records to 47258 (keeping 200 days of data) [2025-10-17T17:09:21.245616] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:09:21.321790] [DEBUG] [LOCAL ] AJG: Primary data saved (47258 records). [2025-10-17T17:09:21.321915] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-17T17:09:21.323126] [INFO ] [MAIN ] Update Progress: 75/2368 symbols completed. AJG took 45.2s. Estimated remaining: 4h 44m 2s. Rate: 8.1 symbols/min [2025-10-17T17:09:21.487685] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:21.541975] [DEBUG] [LOCAL ] ALC: Loaded 51569 existing records from primary storage. [2025-10-17T17:09:21.542288] [INFO ] [MAIN ] ALC: Loaded 51569 existing records. [2025-10-17T17:09:21.563149] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-17T17:09:21.734149] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:21.734455] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-17T17:09:21.734530] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-17T17:09:21.734995] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-17T17:09:21.735090] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-17T17:09:22.135595] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:22.158095] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T17:09:22.357992] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-17T17:09:23.158058] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-17T17:09:23.753041] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-17T17:09:23.958006] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-17T17:09:24.058150] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:09:24.758104] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-17T17:09:24.904332] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T17:09:25.498108] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:09:25.557991] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-17T17:09:26.059496] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T17:09:26.358037] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-17T17:09:27.145396] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:09:27.158033] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-17T17:09:27.761863] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:09:27.958053] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-17T17:09:28.412584] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T17:09:28.758046] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-17T17:09:29.558038] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-17T17:09:29.624926] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T17:09:30.201249] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:09:30.358035] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-17T17:09:30.948490] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T17:09:31.158047] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-17T17:09:31.958007] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-17T17:09:32.122541] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:09:32.715538] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T17:09:32.722263] [INFO ] [REMOTE ] AL: Full fetch complete (63553 records). [2025-10-17T17:09:32.722384] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-17T17:09:32.765671] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-17T17:09:33.124866] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-17T17:09:33.124955] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-17T17:09:33.125603] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-17T17:09:33.125670] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-17T17:09:33.126931] [DEBUG] [LOCAL ] AL: Trimmed 63553 records to 45438 (keeping 200 days of data) [2025-10-17T17:09:33.406985] [DEBUG] [LOCAL ] AL: Primary data saved (45438 records). [2025-10-17T17:09:33.407124] [INFO ] [MAIN ] AL: Full history saved. [2025-10-17T17:09:33.407267] [INFO ] [MAIN ] Update Progress: 76/2368 symbols completed. AL took 27.7s. Estimated remaining: 4h 46m 15s. Rate: 8.0 symbols/min [2025-10-17T17:09:33.580584] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:33.576950] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-17T17:09:33.612780] [DEBUG] [LOCAL ] ALE: Loaded 32255 existing records from primary storage. [2025-10-17T17:09:33.613052] [INFO ] [MAIN ] ALE: Loaded 32255 existing records. [2025-10-17T17:09:33.793903] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:33.794140] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-17T17:09:33.794187] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-17T17:09:33.794419] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-17T17:09:33.794486] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-17T17:09:34.203854] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:34.208957] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T17:09:34.308247] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T17:09:34.314766] [INFO ] [REMOTE ] AKR: Full fetch complete (65472 records). [2025-10-17T17:09:34.314903] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-17T17:09:34.368460] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-17T17:09:34.691661] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-17T17:09:34.691750] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-17T17:09:34.692359] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-17T17:09:34.692401] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-17T17:09:34.693623] [DEBUG] [LOCAL ] AKR: Trimmed 65472 records to 46788 (keeping 200 days of data) [2025-10-17T17:09:34.969486] [DEBUG] [LOCAL ] AKR: Primary data saved (46788 records). [2025-10-17T17:09:34.969635] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-17T17:09:34.969759] [INFO ] [MAIN ] Update Progress: 77/2368 symbols completed. AKR took 42.0s. Estimated remaining: 4h 43m 11s. Rate: 8.1 symbols/min [2025-10-17T17:09:35.158150] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-17T17:09:35.444414] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T17:09:35.644108] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T17:09:35.958013] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-17T17:09:36.757994] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-17T17:09:37.205003] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:09:37.207589] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T17:09:37.558086] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-17T17:09:38.358048] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-17T17:09:38.417555] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T17:09:38.687598] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T17:09:39.158030] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-17T17:09:39.958001] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-17T17:09:40.072336] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:09:40.547689] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-17T17:09:40.758036] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-17T17:09:41.337477] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:09:41.558024] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-17T17:09:41.932760] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:09:42.358085] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-17T17:09:43.158042] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-17T17:09:43.283214] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:09:43.957990] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-17T17:09:44.413391] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T17:09:44.439997] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T17:09:44.758041] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-17T17:09:45.558020] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-17T17:09:45.711149] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T17:09:45.981887] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:09:46.358039] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-17T17:09:47.158090] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-17T17:09:47.566086] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T17:09:47.898228] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:09:47.958012] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-17T17:09:48.633029] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:09:48.758038] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-17T17:09:49.372012] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:09:49.381252] [INFO ] [REMOTE ] ALC: Full fetch complete (73680 records). [2025-10-17T17:09:49.381397] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-17T17:09:49.570610] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-17T17:09:49.784164] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-17T17:09:49.784311] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-17T17:09:49.785060] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-17T17:09:49.785153] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-17T17:09:49.793996] [DEBUG] [LOCAL ] ALC: Trimmed 73680 records to 51959 (keeping 200 days of data) [2025-10-17T17:09:49.807520] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T17:09:50.113248] [DEBUG] [LOCAL ] ALC: Primary data saved (51959 records). [2025-10-17T17:09:50.113388] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-17T17:09:50.114291] [INFO ] [MAIN ] Update Progress: 78/2368 symbols completed. ALC took 28.8s. Estimated remaining: 4h 46m 50s. Rate: 8.0 symbols/min [2025-10-17T17:09:50.358028] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-17T17:09:51.121295] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T17:09:51.158002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-17T17:09:51.795437] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:09:51.958026] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-17T17:09:53.075085] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T17:09:53.086832] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-17T17:09:53.252907] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T17:09:53.258613] [INFO ] [REMOTE ] ALE: Full fetch complete (44014 records). [2025-10-17T17:09:53.258778] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-17T17:09:53.632087] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-17T17:09:53.632192] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-17T17:09:53.632712] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-17T17:09:53.632776] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-17T17:09:53.633857] [DEBUG] [LOCAL ] ALE: Trimmed 44014 records to 32507 (keeping 200 days of data) [2025-10-17T17:09:53.825580] [DEBUG] [LOCAL ] ALE: Primary data saved (32507 records). [2025-10-17T17:09:53.825763] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-17T17:09:53.825872] [INFO ] [MAIN ] Update Progress: 79/2368 symbols completed. ALE took 20.4s. Estimated remaining: 4h 44m 52s. Rate: 8.0 symbols/min [2025-10-17T17:09:55.720106] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-17T17:09:55.727383] [INFO ] [REMOTE ] ALB: Full fetch complete (77070 records). [2025-10-17T17:09:55.727521] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-17T17:09:56.108889] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-17T17:09:56.108974] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-17T17:09:56.109760] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-17T17:09:56.109824] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-17T17:09:56.111326] [DEBUG] [LOCAL ] ALB: Trimmed 77070 records to 54123 (keeping 200 days of data) [2025-10-17T17:09:56.439449] [DEBUG] [LOCAL ] ALB: Primary data saved (54123 records). [2025-10-17T17:09:56.439630] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-17T17:09:56.439783] [INFO ] [MAIN ] Update Progress: 80/2368 symbols completed. ALB took 47.0s. Estimated remaining: 4h 42m 26s. Rate: 8.1 symbols/min [2025-10-17T17:09:57.015565] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.155295] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.158285] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.137595] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.159068] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-17T17:09:57.159350] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-17T17:09:57.159526] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-17T17:09:57.159623] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-17T17:09:57.159748] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-17T17:09:57.159835] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-17T17:09:57.296124] [DEBUG] [LOCAL ] ALG: Loaded 9812 existing records from primary storage. [2025-10-17T17:09:57.320292] [INFO ] [MAIN ] ALG: Loaded 9812 existing records. [2025-10-17T17:09:57.488732] [DEBUG] [LOCAL ] ALEX: Loaded 31407 existing records from primary storage. [2025-10-17T17:09:57.569073] [INFO ] [MAIN ] ALEX: Loaded 31407 existing records. [2025-10-17T17:09:57.716959] [DEBUG] [LOCAL ] ALIT: Loaded 53175 existing records from primary storage. [2025-10-17T17:09:57.769311] [INFO ] [MAIN ] ALIT: Loaded 53175 existing records. [2025-10-17T17:09:57.924207] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:58.001003] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-17T17:09:58.027941] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-17T17:09:58.072307] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:58.081989] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-17T17:09:58.084124] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-17T17:09:58.099341] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-17T17:09:58.124058] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:58.135679] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-17T17:09:58.148493] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-17T17:09:58.204149] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-17T17:09:58.216083] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-17T17:09:58.274188] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:58.359052] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-17T17:09:58.386352] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-17T17:09:58.407190] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-17T17:09:58.447756] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-17T17:09:58.508930] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:09:58.608778] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-17T17:09:58.685465] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:09:58.768001] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-17T17:09:58.826901] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:09:58.892235] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-17T17:09:58.923676] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-17T17:09:58.983948] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-17T17:09:59.045961] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-17T17:09:59.087823] [INFO ] [MAIN ] Update Progress: 81/2368 symbols completed. ALH took 2.5s. Estimated remaining: 4h 40m 4s. Rate: 8.2 symbols/min [2025-10-17T17:09:59.139419] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:59.155112] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-17T17:09:59.355262] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:59.386959] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-17T17:09:59.544126] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:59.568263] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-17T17:09:59.570288] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:59.627418] [DEBUG] [LOCAL ] ALK: Loaded 53470 existing records from primary storage. [2025-10-17T17:09:59.628054] [INFO ] [MAIN ] ALK: Loaded 53470 existing records. [2025-10-17T17:09:59.820005] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:59.820381] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-17T17:09:59.820487] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-17T17:09:59.820804] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-17T17:09:59.820865] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-17T17:10:00.198450] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:00.199076] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-17T17:10:00.283705] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T17:10:00.286752] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-17T17:10:00.907047] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:10:00.913833] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-17T17:10:01.602575] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T17:10:01.606569] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-17T17:10:01.643531] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:10:01.658121] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-17T17:10:02.262733] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T17:10:02.270542] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-17T17:10:02.281080] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T17:10:02.284853] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-17T17:10:02.344743] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T17:10:02.357988] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-17T17:10:03.134357] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T17:10:03.157982] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-17T17:10:03.358548] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T17:10:03.441147] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:10:03.863804] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T17:10:03.958045] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-17T17:10:04.758009] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-17T17:10:04.935520] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T17:10:05.166273] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:10:05.558018] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-17T17:10:05.802371] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:10:06.358051] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-17T17:10:07.158068] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-17T17:10:07.186041] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:10:07.958037] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-17T17:10:08.372494] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T17:10:08.426401] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T17:10:08.758065] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-17T17:10:09.558059] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-17T17:10:09.737085] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T17:10:10.306514] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:10:10.358022] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-17T17:10:10.798120] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T17:10:11.158031] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-17T17:10:11.420483] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:10:11.958042] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-17T17:10:12.758039] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-17T17:10:12.879126] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:10:13.509932] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-17T17:10:13.557994] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-17T17:10:14.358016] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-17T17:10:14.811805] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T17:10:15.148622] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:10:15.158372] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-17T17:10:15.215036] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T17:10:15.958095] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-17T17:10:16.758024] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-17T17:10:16.848689] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:10:17.330216] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:10:17.558064] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-17T17:10:18.358006] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-17T17:10:18.398987] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:10:18.452019] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T17:10:19.158091] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-17T17:10:19.958043] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-17T17:10:20.156467] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T17:10:20.593305] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:10:20.758077] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-17T17:10:21.558027] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-17T17:10:21.937032] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T17:10:22.358027] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-17T17:10:22.425021] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T17:10:23.158339] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-17T17:10:23.161669] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T17:10:23.166716] [INFO ] [REMOTE ] ALEX: Full fetch complete (44592 records). [2025-10-17T17:10:23.166797] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-17T17:10:23.584207] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-17T17:10:23.584317] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-17T17:10:23.584865] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-17T17:10:23.584935] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-17T17:10:23.586104] [DEBUG] [LOCAL ] ALEX: Trimmed 44592 records to 31633 (keeping 200 days of data) [2025-10-17T17:10:23.780704] [DEBUG] [LOCAL ] ALEX: Primary data saved (31633 records). [2025-10-17T17:10:23.780893] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-17T17:10:23.780998] [INFO ] [MAIN ] Update Progress: 82/2368 symbols completed. ALEX took 27.3s. Estimated remaining: 4h 48m 0s. Rate: 7.9 symbols/min [2025-10-17T17:10:23.957843] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:23.958041] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-17T17:10:24.005888] [DEBUG] [LOCAL ] ALL: Loaded 50161 existing records from primary storage. [2025-10-17T17:10:24.006243] [INFO ] [MAIN ] ALL: Loaded 50161 existing records. [2025-10-17T17:10:24.213625] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:24.215563] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-17T17:10:24.217009] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-17T17:10:24.216877] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T17:10:24.217376] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-17T17:10:24.222766] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-17T17:10:24.403256] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T17:10:24.668082] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:24.758057] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-17T17:10:25.558034] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-17T17:10:25.780064] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T17:10:26.354033] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T17:10:26.357971] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-17T17:10:26.412001] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:10:27.111814] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T17:10:27.157981] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-17T17:10:27.781472] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T17:10:27.783027] [INFO ] [REMOTE ] ALG: Full fetch complete (15354 records). [2025-10-17T17:10:27.783097] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-17T17:10:27.964295] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-17T17:10:28.145979] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-17T17:10:28.146062] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-17T17:10:28.146382] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-17T17:10:28.146425] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-17T17:10:28.146943] [DEBUG] [LOCAL ] ALG: Trimmed 15354 records to 9877 (keeping 200 days of data) [2025-10-17T17:10:28.214158] [DEBUG] [LOCAL ] ALG: Primary data saved (9877 records). [2025-10-17T17:10:28.214449] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-17T17:10:28.214749] [INFO ] [MAIN ] Update Progress: 83/2368 symbols completed. ALG took 31.8s. Estimated remaining: 4h 46m 27s. Rate: 8.0 symbols/min [2025-10-17T17:10:28.383361] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:28.432113] [DEBUG] [LOCAL ] ALLE: Loaded 44517 existing records from primary storage. [2025-10-17T17:10:28.432429] [INFO ] [MAIN ] ALLE: Loaded 44517 existing records. [2025-10-17T17:10:28.628144] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:28.628368] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-17T17:10:28.628446] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-17T17:10:28.629057] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-17T17:10:28.629129] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-17T17:10:28.763238] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-17T17:10:29.002517] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:29.558043] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-17T17:10:29.952282] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-17T17:10:30.358061] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-17T17:10:30.811527] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T17:10:31.163925] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-17T17:10:31.168453] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:10:31.176428] [INFO ] [REMOTE ] ALIT: Full fetch complete (76608 records). [2025-10-17T17:10:31.176537] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-17T17:10:31.565024] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-17T17:10:31.565116] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-17T17:10:31.565866] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-17T17:10:31.565933] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-17T17:10:31.567458] [DEBUG] [LOCAL ] ALIT: Trimmed 76608 records to 53560 (keeping 200 days of data) [2025-10-17T17:10:31.880271] [DEBUG] [LOCAL ] ALIT: Primary data saved (53560 records). [2025-10-17T17:10:31.880404] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-17T17:10:31.880498] [INFO ] [MAIN ] Update Progress: 84/2368 symbols completed. ALIT took 35.4s. Estimated remaining: 4h 44m 35s. Rate: 8.0 symbols/min [2025-10-17T17:10:31.958933] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-17T17:10:32.056040] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:32.094745] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T17:10:32.152205] [DEBUG] [LOCAL ] ALLY: Loaded 53610 existing records from primary storage. [2025-10-17T17:10:32.152534] [INFO ] [MAIN ] ALLY: Loaded 53610 existing records. [2025-10-17T17:10:32.329839] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:32.330126] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-17T17:10:32.330190] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-17T17:10:32.330470] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-17T17:10:32.330531] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-17T17:10:32.687212] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:32.710525] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:10:32.757994] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-17T17:10:33.558000] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-17T17:10:34.153800] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T17:10:34.161217] [INFO ] [REMOTE ] ALK: Full fetch complete (77019 records). [2025-10-17T17:10:34.161391] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-17T17:10:34.382579] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-17T17:10:34.551896] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T17:10:34.611174] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-17T17:10:34.611247] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-17T17:10:34.611989] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-17T17:10:34.612068] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-17T17:10:34.613417] [DEBUG] [LOCAL ] ALK: Trimmed 77019 records to 53860 (keeping 200 days of data) [2025-10-17T17:10:34.920824] [DEBUG] [LOCAL ] ALK: Primary data saved (53860 records). [2025-10-17T17:10:34.920964] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-17T17:10:34.921044] [INFO ] [MAIN ] Update Progress: 85/2368 symbols completed. ALK took 35.8s. Estimated remaining: 4h 42m 28s. Rate: 8.1 symbols/min [2025-10-17T17:10:35.099707] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:35.141266] [DEBUG] [LOCAL ] ALSN: Loaded 43767 existing records from primary storage. [2025-10-17T17:10:35.141622] [INFO ] [MAIN ] ALSN: Loaded 43767 existing records. [2025-10-17T17:10:35.163254] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-17T17:10:35.340872] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:35.341108] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-17T17:10:35.341172] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-17T17:10:35.341375] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-17T17:10:35.341433] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-17T17:10:35.547256] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:10:35.757954] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:35.957990] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-17T17:10:36.483140] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T17:10:36.758038] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-17T17:10:36.926827] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:10:37.558009] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-17T17:10:37.696268] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:10:38.358054] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-17T17:10:38.526637] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T17:10:38.906109] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T17:10:39.158035] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-17T17:10:39.655080] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:10:39.958054] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-17T17:10:40.579824] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T17:10:40.758025] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-17T17:10:41.037965] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T17:10:41.558028] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-17T17:10:42.358044] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-17T17:10:42.440144] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:10:43.158042] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-17T17:10:43.234005] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:10:43.945740] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:10:43.957982] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-17T17:10:44.758030] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-17T17:10:44.838796] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:10:45.553237] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T17:10:45.562423] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-17T17:10:46.358046] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-17T17:10:46.600300] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T17:10:47.044807] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T17:10:47.158082] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-17T17:10:47.850223] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T17:10:47.958043] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-17T17:10:48.758014] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-17T17:10:48.862694] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T17:10:49.558012] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-17T17:10:49.653633] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:10:49.948244] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T17:10:50.358056] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-17T17:10:51.158042] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-17T17:10:51.217108] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T17:10:51.958049] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-17T17:10:52.008578] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:10:52.758042] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-17T17:10:53.498016] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-17T17:10:53.535018] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T17:10:53.557991] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-17T17:10:54.232208] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:10:54.358036] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-17T17:10:55.158074] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-17T17:10:55.391316] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T17:10:55.958039] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-17T17:10:56.016422] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T17:10:56.758013] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-17T17:10:56.843129] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:10:57.558031] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-17T17:10:57.807723] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T17:10:57.814755] [INFO ] [REMOTE ] ALL: Full fetch complete (72539 records). [2025-10-17T17:10:57.814894] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-17T17:10:58.209302] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-17T17:10:58.209381] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-17T17:10:58.210128] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-17T17:10:58.210192] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-17T17:10:58.211618] [DEBUG] [LOCAL ] ALL: Trimmed 72539 records to 50503 (keeping 200 days of data) [2025-10-17T17:10:58.394289] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-17T17:10:58.531323] [DEBUG] [LOCAL ] ALL: Primary data saved (50503 records). [2025-10-17T17:10:58.531462] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-17T17:10:58.532484] [INFO ] [MAIN ] Update Progress: 86/2368 symbols completed. ALL took 34.8s. Estimated remaining: 4h 49m 30s. Rate: 7.9 symbols/min [2025-10-17T17:10:58.712926] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T17:10:58.754371] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:58.754946] [DEBUG] [LOCAL ] ALTG: No existing data file found in primary storage. [2025-10-17T17:10:58.754991] [WARN ] [MAIN ] ALTG: No existing data found, performing full refresh instead. [2025-10-17T17:10:58.755103] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-17T17:10:58.755145] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-17T17:10:58.755185] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-10-17T17:10:58.755217] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-17T17:10:59.088669] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T17:10:59.135219] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:59.135348] [INFO ] [REMOTE ] ALLE: Full fetch complete (64834 records). [2025-10-17T17:10:59.135863] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-17T17:10:59.166735] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-17T17:10:59.514330] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-17T17:10:59.514407] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-17T17:10:59.515035] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-17T17:10:59.515106] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-17T17:10:59.516350] [DEBUG] [LOCAL ] ALLE: Trimmed 64834 records to 44772 (keeping 200 days of data) [2025-10-17T17:10:59.790928] [DEBUG] [LOCAL ] ALLE: Primary data saved (44772 records). [2025-10-17T17:10:59.791053] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-17T17:10:59.792225] [INFO ] [MAIN ] Update Progress: 87/2368 symbols completed. ALLE took 31.6s. Estimated remaining: 4h 46m 36s. Rate: 8.0 symbols/min [2025-10-17T17:10:59.961069] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-17T17:10:59.964288] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:59.977191] [DEBUG] [LOCAL ] ALUR: Loaded 9589 existing records from primary storage. [2025-10-17T17:10:59.977414] [INFO ] [MAIN ] ALUR: Loaded 9589 existing records. [2025-10-17T17:11:00.162589] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:11:00.202735] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:00.203772] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-17T17:11:00.203832] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-17T17:11:00.204503] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-17T17:11:00.204563] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-17T17:11:00.556551] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:00.704791] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:11:00.758034] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-17T17:11:01.009921] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T17:11:01.558046] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-17T17:11:02.358010] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-17T17:11:02.633684] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:11:02.640021] [INFO ] [REMOTE ] ALSN: Full fetch complete (62574 records). [2025-10-17T17:11:02.640130] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-17T17:11:03.051072] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-17T17:11:03.051354] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-17T17:11:03.052069] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-17T17:11:03.052211] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-17T17:11:03.073409] [DEBUG] [LOCAL ] ALSN: Trimmed 62574 records to 44062 (keeping 200 days of data) [2025-10-17T17:11:03.074563] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:11:03.176936] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-17T17:11:03.332635] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T17:11:03.376772] [DEBUG] [LOCAL ] ALSN: Primary data saved (44062 records). [2025-10-17T17:11:03.376942] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-17T17:11:03.377049] [INFO ] [MAIN ] Update Progress: 88/2368 symbols completed. ALSN took 28.5s. Estimated remaining: 4h 44m 46s. Rate: 8.0 symbols/min [2025-10-17T17:11:03.547776] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:03.586554] [DEBUG] [LOCAL ] ALV: Loaded 42481 existing records from primary storage. [2025-10-17T17:11:03.586861] [INFO ] [MAIN ] ALV: Loaded 42481 existing records. [2025-10-17T17:11:03.759851] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:03.760053] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-17T17:11:03.760100] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-17T17:11:03.760581] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-17T17:11:03.760638] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-17T17:11:03.964569] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-17T17:11:04.122906] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:04.471022] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:11:04.758008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-17T17:11:05.558003] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-17T17:11:05.673316] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T17:11:06.358030] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-17T17:11:06.392057] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:11:06.451872] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:11:07.158032] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-17T17:11:07.919265] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:11:07.958014] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-17T17:11:08.722243] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T17:11:08.758116] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-17T17:11:09.402721] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T17:11:09.558048] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-17T17:11:09.939907] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T17:11:10.358078] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-17T17:11:11.105001] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:11:11.142069] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T17:11:11.157980] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-17T17:11:11.958009] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-17T17:11:12.226748] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T17:11:12.758037] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-17T17:11:13.445675] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T17:11:13.558023] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-17T17:11:13.657423] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T17:11:14.358037] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-17T17:11:14.886412] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T17:11:15.158040] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-17T17:11:15.304523] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T17:11:15.958034] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-17T17:11:16.494061] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T17:11:16.717894] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T17:11:16.725295] [INFO ] [REMOTE ] ALLY: Full fetch complete (77218 records). [2025-10-17T17:11:16.725429] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-17T17:11:16.763186] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-17T17:11:17.112574] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-17T17:11:17.112677] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-17T17:11:17.113450] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-17T17:11:17.113498] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-17T17:11:17.115075] [DEBUG] [LOCAL ] ALLY: Trimmed 77218 records to 54000 (keeping 200 days of data) [2025-10-17T17:11:17.428224] [DEBUG] [LOCAL ] ALLY: Primary data saved (54000 records). [2025-10-17T17:11:17.428362] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-17T17:11:17.428442] [INFO ] [MAIN ] Update Progress: 89/2368 symbols completed. ALLY took 45.5s. Estimated remaining: 4h 47m 26s. Rate: 7.9 symbols/min [2025-10-17T17:11:17.531957] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:11:17.563130] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-17T17:11:17.631427] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:17.640750] [DEBUG] [LOCAL ] ALX: Loaded 7061 existing records from primary storage. [2025-10-17T17:11:17.641039] [INFO ] [MAIN ] ALX: Loaded 7061 existing records. [2025-10-17T17:11:17.811614] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:17.811909] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-17T17:11:17.811963] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-17T17:11:17.812118] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-17T17:11:17.812175] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-17T17:11:18.179298] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:18.312490] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T17:11:18.314408] [INFO ] [REMOTE ] ALUR: Full fetch complete (18842 records). [2025-10-17T17:11:18.314481] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-17T17:11:18.365984] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-17T17:11:18.690417] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-17T17:11:18.690507] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-17T17:11:18.690875] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-17T17:11:18.690942] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-17T17:11:18.691598] [DEBUG] [LOCAL ] ALUR: Trimmed 18842 records to 9640 (keeping 200 days of data) [2025-10-17T17:11:18.744629] [DEBUG] [LOCAL ] ALUR: Primary data saved (9640 records). [2025-10-17T17:11:18.744925] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-17T17:11:18.745008] [INFO ] [MAIN ] Update Progress: 90/2368 symbols completed. ALUR took 19.0s. Estimated remaining: 4h 44m 41s. Rate: 8.0 symbols/min [2025-10-17T17:11:18.916546] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:18.977761] [DEBUG] [LOCAL ] AM: Loaded 52320 existing records from primary storage. [2025-10-17T17:11:18.978106] [INFO ] [MAIN ] AM: Loaded 52320 existing records. [2025-10-17T17:11:19.045942] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-17T17:11:19.163440] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-17T17:11:19.166701] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:19.168103] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-17T17:11:19.168196] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-17T17:11:19.168669] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-17T17:11:19.168731] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-17T17:11:19.560088] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:19.924806] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T17:11:19.957992] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-17T17:11:20.454820] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T17:11:20.758083] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-17T17:11:21.558032] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-17T17:11:22.358024] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-17T17:11:22.508491] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T17:11:22.764875] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:11:22.830439] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T17:11:23.158045] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-17T17:11:23.657451] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T17:11:23.958100] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-17T17:11:24.758002] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-17T17:11:25.558015] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-17T17:11:25.609880] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:11:25.766170] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T17:11:26.358098] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-17T17:11:27.158066] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-17T17:11:27.612707] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T17:11:27.841688] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:11:27.958086] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-17T17:11:28.146034] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T17:11:28.758030] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-17T17:11:29.511534] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T17:11:29.558047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-17T17:11:29.687272] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:11:30.358029] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-17T17:11:30.448120] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:11:31.158004] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-17T17:11:31.286581] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:11:31.958070] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-17T17:11:32.715541] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:11:32.758006] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-17T17:11:32.872372] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T17:11:33.558037] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-17T17:11:33.917912] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:11:34.358037] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-17T17:11:35.113749] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T17:11:35.158030] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-17T17:11:35.166252] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:11:35.958048] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-17T17:11:36.486889] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:11:36.758047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-17T17:11:37.558046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-17T17:11:37.601950] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:11:37.800134] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:11:37.803518] [INFO ] [REMOTE ] ALTG: Full fetch complete (33440 records). [2025-10-17T17:11:37.803609] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-17T17:11:38.224136] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-17T17:11:38.224232] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-17T17:11:38.224689] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-17T17:11:38.224751] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-17T17:11:38.225707] [DEBUG] [LOCAL ] ALTG: Trimmed 33440 records to 23632 (keeping 200 days of data) [2025-10-17T17:11:38.361107] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-17T17:11:38.364277] [DEBUG] [LOCAL ] ALTG: Primary data saved (23632 records). [2025-10-17T17:11:38.364344] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-17T17:11:38.364514] [INFO ] [MAIN ] Update Progress: 91/2368 symbols completed. ALTG took 39.8s. Estimated remaining: 4h 49m 36s. Rate: 7.9 symbols/min [2025-10-17T17:11:38.531692] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:38.571465] [DEBUG] [LOCAL ] AMBC: Loaded 36530 existing records from primary storage. [2025-10-17T17:11:38.571796] [INFO ] [MAIN ] AMBC: Loaded 36530 existing records. [2025-10-17T17:11:38.749675] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:38.749874] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-17T17:11:38.749923] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-17T17:11:38.750185] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-17T17:11:38.750226] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-17T17:11:38.992919] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:11:39.118097] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:39.157995] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-17T17:11:39.160801] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T17:11:39.957999] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-17T17:11:40.530603] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T17:11:40.758025] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-17T17:11:40.796908] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:11:41.558037] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-17T17:11:42.357994] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-17T17:11:42.508231] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:11:42.684186] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:11:43.051699] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T17:11:43.053712] [INFO ] [REMOTE ] ALX: Full fetch complete (7929 records). [2025-10-17T17:11:43.053783] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-17T17:11:43.163106] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-17T17:11:43.432319] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-17T17:11:43.432413] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-17T17:11:43.432711] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-17T17:11:43.432774] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-17T17:11:43.433325] [DEBUG] [LOCAL ] ALX: Trimmed 7929 records to 7141 (keeping 200 days of data) [2025-10-17T17:11:43.478082] [DEBUG] [LOCAL ] ALX: Primary data saved (7141 records). [2025-10-17T17:11:43.478206] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-17T17:11:43.478298] [INFO ] [MAIN ] Update Progress: 92/2368 symbols completed. ALX took 26.0s. Estimated remaining: 4h 48m 26s. Rate: 7.9 symbols/min [2025-10-17T17:11:43.656180] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:43.698329] [DEBUG] [LOCAL ] AMBP: Loaded 44894 existing records from primary storage. [2025-10-17T17:11:43.698703] [INFO ] [MAIN ] AMBP: Loaded 44894 existing records. [2025-10-17T17:11:43.888971] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:43.889259] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-17T17:11:43.889320] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-17T17:11:43.889696] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-17T17:11:43.889814] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-17T17:11:43.963992] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-17T17:11:44.256128] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:44.758079] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-17T17:11:45.008304] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:11:45.558002] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-17T17:11:45.589151] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:11:46.358000] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-17T17:11:46.522228] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T17:11:46.876930] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:11:47.158007] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-17T17:11:47.256031] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:11:47.958067] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-17T17:11:48.619112] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:11:48.758038] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-17T17:11:49.558019] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-17T17:11:50.093046] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-17T17:11:50.190528] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:11:50.358065] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-17T17:11:51.139216] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T17:11:51.157995] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-17T17:11:51.966816] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-17T17:11:51.972479] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:11:52.650429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:11:52.657864] [INFO ] [REMOTE ] ALV: Full fetch complete (62218 records). [2025-10-17T17:11:52.658052] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-17T17:11:52.766469] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-17T17:11:53.066120] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-17T17:11:53.066220] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-17T17:11:53.066899] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-17T17:11:53.066964] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-17T17:11:53.068373] [DEBUG] [LOCAL ] ALV: Trimmed 62218 records to 42843 (keeping 200 days of data) [2025-10-17T17:11:53.334220] [DEBUG] [LOCAL ] ALV: Primary data saved (42843 records). [2025-10-17T17:11:53.334424] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-17T17:11:53.335149] [INFO ] [MAIN ] Update Progress: 93/2368 symbols completed. ALV took 50.0s. Estimated remaining: 4h 49m 14s. Rate: 7.9 symbols/min [2025-10-17T17:11:53.504986] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:53.505269] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-17T17:11:53.505324] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-17T17:11:53.505595] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-17T17:11:53.505698] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-17T17:11:53.505767] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-17T17:11:53.505814] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-17T17:11:53.567717] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-17T17:11:53.830186] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:11:53.916867] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:54.358027] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-17T17:11:54.540614] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:11:54.750042] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T17:11:55.158039] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-17T17:11:55.816141] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T17:11:55.957997] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-17T17:11:56.758037] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-17T17:11:56.850023] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:11:56.972277] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:11:56.972579] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-17T17:11:56.972689] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:11:56.972742] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-17T17:11:56.972777] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:11:56.972857] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-17T17:11:56.972952] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-17T17:11:56.973007] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-17T17:11:56.973050] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-17T17:11:56.973096] [INFO ] [MAIN ] Update Progress: 94/2368 symbols completed. AMBQ took 3.6s. Estimated remaining: 4h 47m 30s. Rate: 7.9 symbols/min [2025-10-17T17:11:57.160431] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:57.219569] [DEBUG] [LOCAL ] AMC: Loaded 54152 existing records from primary storage. [2025-10-17T17:11:57.220085] [INFO ] [MAIN ] AMC: Loaded 54152 existing records. [2025-10-17T17:11:57.411730] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:57.433273] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-17T17:11:57.433421] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-17T17:11:57.434264] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-17T17:11:57.435839] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-17T17:11:57.435739] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:11:57.563088] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-17T17:11:57.830624] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:58.358044] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-17T17:11:58.924075] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:11:59.158022] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-17T17:11:59.910695] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:11:59.918245] [INFO ] [REMOTE ] AM: Full fetch complete (75702 records). [2025-10-17T17:11:59.918416] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-17T17:11:59.964074] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-17T17:12:00.314009] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-17T17:12:00.314112] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-17T17:12:00.315012] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-17T17:12:00.315082] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-17T17:12:00.316948] [DEBUG] [LOCAL ] AM: Trimmed 75702 records to 52670 (keeping 200 days of data) [2025-10-17T17:12:00.669522] [DEBUG] [LOCAL ] AM: Primary data saved (52670 records). [2025-10-17T17:12:00.669901] [INFO ] [MAIN ] AM: Full history saved. [2025-10-17T17:12:00.671287] [INFO ] [MAIN ] Update Progress: 95/2368 symbols completed. AM took 41.9s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-10-17T17:12:00.763261] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-17T17:12:00.880759] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:00.961339] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-17T17:12:00.962139] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-10-17T17:12:01.307378] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-17T17:12:01.314708] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:01.331477] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-17T17:12:01.331568] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-17T17:12:01.332107] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-17T17:12:01.332169] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-17T17:12:01.567578] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-17T17:12:01.795793] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T17:12:01.868978] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:02.358024] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-17T17:12:03.158032] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-17T17:12:03.430313] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-17T17:12:03.492221] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:12:03.876421] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:12:03.958027] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-17T17:12:04.516037] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T17:12:04.758038] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-17T17:12:04.843292] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T17:12:05.558013] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-17T17:12:06.357992] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-17T17:12:06.798428] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T17:12:06.956007] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T17:12:06.961523] [INFO ] [REMOTE ] AMBC: Full fetch complete (51879 records). [2025-10-17T17:12:06.961672] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-17T17:12:07.163114] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-17T17:12:07.340612] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-17T17:12:07.340725] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-17T17:12:07.341294] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-17T17:12:07.341377] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-17T17:12:07.342589] [DEBUG] [LOCAL ] AMBC: Trimmed 51879 records to 36767 (keeping 200 days of data) [2025-10-17T17:12:07.538724] [DEBUG] [LOCAL ] AMBC: Primary data saved (36767 records). [2025-10-17T17:12:07.538855] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-17T17:12:07.538932] [INFO ] [MAIN ] Update Progress: 96/2368 symbols completed. AMBC took 29.2s. Estimated remaining: 4h 45m 26s. Rate: 8.0 symbols/min [2025-10-17T17:12:07.702764] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:07.755097] [DEBUG] [LOCAL ] AME: Loaded 49020 existing records from primary storage. [2025-10-17T17:12:07.755393] [INFO ] [MAIN ] AME: Loaded 49020 existing records. [2025-10-17T17:12:07.927010] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:07.927202] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-17T17:12:07.927247] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-17T17:12:07.927464] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-17T17:12:07.927524] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-17T17:12:07.969392] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-17T17:12:08.282096] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:08.650777] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T17:12:08.758011] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-17T17:12:08.856025] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:12:09.559409] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-17T17:12:09.562130] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:12:10.357992] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-17T17:12:10.544000] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:12:11.158040] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-17T17:12:11.484512] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T17:12:11.958024] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-17T17:12:12.066062] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T17:12:12.342276] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T17:12:12.758090] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-17T17:12:13.558030] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-17T17:12:14.291382] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:12:14.357997] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-17T17:12:14.613618] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-17T17:12:14.845805] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:12:15.158021] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-17T17:12:15.958059] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-17T17:12:16.588102] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T17:12:16.757987] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-17T17:12:16.987436] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T17:12:17.371340] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T17:12:17.558020] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-17T17:12:18.358082] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-17T17:12:18.524591] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:12:19.158073] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-17T17:12:19.435003] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T17:12:19.938459] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T17:12:19.944480] [INFO ] [REMOTE ] AMBP: Full fetch complete (65147 records). [2025-10-17T17:12:19.944635] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-17T17:12:19.966545] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-17T17:12:20.324783] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-17T17:12:20.324866] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-17T17:12:20.325492] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-17T17:12:20.325535] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-17T17:12:20.326868] [DEBUG] [LOCAL ] AMBP: Trimmed 65147 records to 45132 (keeping 200 days of data) [2025-10-17T17:12:20.575428] [DEBUG] [LOCAL ] AMBP: Primary data saved (45132 records). [2025-10-17T17:12:20.575551] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-17T17:12:20.575630] [INFO ] [MAIN ] Update Progress: 97/2368 symbols completed. AMBP took 37.1s. Estimated remaining: 4h 47m 27s. Rate: 7.9 symbols/min [2025-10-17T17:12:20.744249] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:20.763107] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-17T17:12:20.765036] [DEBUG] [LOCAL ] AMG: Loaded 20310 existing records from primary storage. [2025-10-17T17:12:20.765219] [INFO ] [MAIN ] AMG: Loaded 20310 existing records. [2025-10-17T17:12:20.946131] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:20.946327] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-17T17:12:20.946375] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-17T17:12:20.946595] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-17T17:12:20.946683] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-17T17:12:21.345232] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:21.339784] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T17:12:21.558009] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-17T17:12:21.980502] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:12:22.358019] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-17T17:12:22.588170] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T17:12:22.938357] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T17:12:23.158080] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-17T17:12:23.845470] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T17:12:23.958006] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-17T17:12:24.279698] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T17:12:24.758057] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-17T17:12:25.558017] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-17T17:12:26.305551] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T17:12:26.357995] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-17T17:12:27.139292] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-10-17T17:12:27.157983] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-17T17:12:27.200732] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:12:27.958105] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-17T17:12:28.181515] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T17:12:28.758141] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-17T17:12:29.001420] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T17:12:29.495767] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-17T17:12:29.557992] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-17T17:12:30.358018] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-17T17:12:30.446104] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:12:31.158038] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-17T17:12:31.492288] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T17:12:31.904925] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-17T17:12:31.957992] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-17T17:12:32.758086] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-17T17:12:33.077512] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T17:12:33.558083] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-17T17:12:33.601967] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T17:12:34.225692] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-17T17:12:34.358004] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-17T17:12:35.157995] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-17T17:12:35.335215] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:12:35.342485] [INFO ] [REMOTE ] AME: Full fetch complete (70026 records). [2025-10-17T17:12:35.342596] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-17T17:12:35.679516] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T17:12:35.766276] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-17T17:12:35.766362] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-17T17:12:35.767092] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-17T17:12:35.767156] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-17T17:12:35.768576] [DEBUG] [LOCAL ] AME: Trimmed 70026 records to 49338 (keeping 200 days of data) [2025-10-17T17:12:35.966680] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-17T17:12:36.090208] [DEBUG] [LOCAL ] AME: Primary data saved (49338 records). [2025-10-17T17:12:36.090355] [INFO ] [MAIN ] AME: Full history saved. [2025-10-17T17:12:36.092478] [INFO ] [MAIN ] Update Progress: 98/2368 symbols completed. AME took 28.6s. Estimated remaining: 4h 50m 23s. Rate: 7.8 symbols/min [2025-10-17T17:12:36.259986] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:36.324257] [DEBUG] [LOCAL ] AMH: Loaded 52220 existing records from primary storage. [2025-10-17T17:12:36.324615] [INFO ] [MAIN ] AMH: Loaded 52220 existing records. [2025-10-17T17:12:36.497115] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:36.497331] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-17T17:12:36.497379] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-17T17:12:36.497730] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-17T17:12:36.497786] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-17T17:12:36.767724] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-17T17:12:36.849223] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:37.558031] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-17T17:12:37.660621] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:12:37.789835] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-17T17:12:38.008669] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T17:12:38.358019] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-17T17:12:39.158087] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-17T17:12:39.325078] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:12:39.958074] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-17T17:12:40.704682] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-17T17:12:40.712710] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-17T17:12:40.712857] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-17T17:12:40.758397] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-17T17:12:40.846173] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:12:41.150871] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T17:12:41.149671] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-17T17:12:41.150993] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-17T17:12:41.158847] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-17T17:12:41.158930] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-17T17:12:41.159571] [INFO ] [REMOTE ] AMCR: Full fetch complete (77842 records). [2025-10-17T17:12:41.159940] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-17T17:12:41.191795] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54542 (keeping 200 days of data) [2025-10-17T17:12:41.563329] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-17T17:12:41.785279] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-17T17:12:41.814142] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-17T17:12:41.820686] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-17T17:12:41.821590] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-17T17:12:41.837154] [DEBUG] [LOCAL ] AMCR: Trimmed 77842 records to 54449 (keeping 200 days of data) [2025-10-17T17:12:42.038235] [DEBUG] [LOCAL ] AMC: Primary data saved (54542 records). [2025-10-17T17:12:42.042208] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-17T17:12:42.046195] [INFO ] [MAIN ] Update Progress: 99/2368 symbols completed. AMC took 45.1s. Estimated remaining: 4h 49m 36s. Rate: 7.8 symbols/min [2025-10-17T17:12:42.385876] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:42.438776] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-10-17T17:12:42.439347] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-17T17:12:42.440470] [INFO ] [MAIN ] Update Progress: 100/2368 symbols completed. AMCR took 41.8s. Estimated remaining: 4h 46m 43s. Rate: 7.9 symbols/min [2025-10-17T17:12:42.587631] [DEBUG] [LOCAL ] AMN: Loaded 42102 existing records from primary storage. [2025-10-17T17:12:42.588870] [INFO ] [MAIN ] AMN: Loaded 42102 existing records. [2025-10-17T17:12:42.612056] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T17:12:42.744521] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-17T17:12:42.842890] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:42.913586] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T17:12:42.909085] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:42.924364] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-17T17:12:42.924989] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-17T17:12:42.925875] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-17T17:12:42.925935] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-17T17:12:43.166156] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-17T17:12:43.224308] [DEBUG] [LOCAL ] AMP: Loaded 32286 existing records from primary storage. [2025-10-17T17:12:43.246148] [INFO ] [MAIN ] AMP: Loaded 32286 existing records. [2025-10-17T17:12:43.341584] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:43.493986] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:43.494222] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-17T17:12:43.494270] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-17T17:12:43.494572] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-17T17:12:43.494629] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-17T17:12:43.843173] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:43.958022] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-17T17:12:44.044016] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:12:44.544139] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:12:44.758029] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-17T17:12:45.558018] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-17T17:12:45.849933] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T17:12:45.965497] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T17:12:45.968411] [INFO ] [REMOTE ] AMG: Full fetch complete (29621 records). [2025-10-17T17:12:45.968486] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-17T17:12:46.333723] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-17T17:12:46.333814] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-17T17:12:46.334183] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-17T17:12:46.334223] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-17T17:12:46.335046] [DEBUG] [LOCAL ] AMG: Trimmed 29621 records to 20485 (keeping 200 days of data) [2025-10-17T17:12:46.388012] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-17T17:12:46.461814] [DEBUG] [LOCAL ] AMG: Primary data saved (20485 records). [2025-10-17T17:12:46.461942] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-17T17:12:46.462020] [INFO ] [MAIN ] Update Progress: 101/2368 symbols completed. AMG took 25.9s. Estimated remaining: 4h 45m 16s. Rate: 7.9 symbols/min [2025-10-17T17:12:46.626470] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:46.674894] [DEBUG] [LOCAL ] AMPX: Loaded 52728 existing records from primary storage. [2025-10-17T17:12:46.675202] [INFO ] [MAIN ] AMPX: Loaded 52728 existing records. [2025-10-17T17:12:46.848218] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:46.848458] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-17T17:12:46.848505] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-17T17:12:46.848970] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-17T17:12:46.849026] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-17T17:12:47.159981] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-17T17:12:47.218461] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:47.287726] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:12:47.891508] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T17:12:47.958077] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-17T17:12:48.758058] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-17T17:12:48.872562] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:12:49.558042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-17T17:12:49.876445] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T17:12:49.924740] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:12:50.358055] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-17T17:12:51.100674] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:12:51.157985] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-17T17:12:51.575616] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T17:12:51.958034] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-17T17:12:52.764432] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-17T17:12:52.766455] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:12:53.558163] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-17T17:12:53.896890] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:12:54.358024] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-17T17:12:54.414571] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:12:55.088071] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:12:55.158063] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-17T17:12:55.958043] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-17T17:12:56.044207] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:12:56.684318] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T17:12:56.758063] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-17T17:12:57.558019] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-17T17:12:57.669034] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T17:12:58.358037] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-17T17:12:58.735671] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T17:12:58.783421] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T17:12:59.158078] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-17T17:12:59.970563] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-17T17:12:59.977573] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:13:00.514417] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:13:00.758060] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-17T17:13:01.248360] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:13:01.558026] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-17T17:13:02.358068] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-17T17:13:02.907729] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T17:13:03.158058] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-17T17:13:03.898574] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:13:03.958018] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-17T17:13:04.088123] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:13:04.758058] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-17T17:13:05.550773] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T17:13:05.560303] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-17T17:13:06.260739] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (5.50 seconds). [2025-10-17T17:13:06.312712] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:13:06.357980] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-17T17:13:06.994989] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T17:13:07.158045] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-17T17:13:07.858910] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:13:07.958002] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-17T17:13:08.605613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:13:08.758089] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-17T17:13:09.521893] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T17:13:09.557993] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-17T17:13:10.092291] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:13:10.358047] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-17T17:13:11.158038] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-17T17:13:11.728115] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T17:13:11.937273] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-17T17:13:11.957992] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-17T17:13:12.652365] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:13:12.657931] [INFO ] [REMOTE ] AMN: Full fetch complete (60092 records). [2025-10-17T17:13:12.658043] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-17T17:13:12.658840] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:13:12.658906] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:13:12.658945] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:13:12.658984] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-17T17:13:12.659040] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-17T17:13:12.659089] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-17T17:13:12.659235] [DEBUG] [LOCAL ] AMN: Deleted derivative data file. [2025-10-17T17:13:12.659324] [INFO ] [MAIN ] Update Progress: 102/2368 symbols completed. AMN took 30.6s. Estimated remaining: 4h 52m 2s. Rate: 7.8 symbols/min [2025-10-17T17:13:12.758817] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-17T17:13:12.827921] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:12.864524] [DEBUG] [LOCAL ] AMPY: Loaded 39500 existing records from primary storage. [2025-10-17T17:13:12.864850] [INFO ] [MAIN ] AMPY: Loaded 39500 existing records. [2025-10-17T17:13:13.041792] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:13.042015] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-17T17:13:13.042063] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-17T17:13:13.042259] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-17T17:13:13.042301] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-17T17:13:13.400839] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:13.557992] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-17T17:13:13.992575] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T17:13:14.217154] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T17:13:14.358050] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-17T17:13:15.086343] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T17:13:15.158032] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-17T17:13:15.610014] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:13:15.958110] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-17T17:13:16.570759] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:13:16.576417] [INFO ] [REMOTE ] AMP: Full fetch complete (47562 records). [2025-10-17T17:13:16.576584] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-17T17:13:16.759140] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-17T17:13:16.967548] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-17T17:13:16.967683] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-17T17:13:16.968202] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-17T17:13:16.968263] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-17T17:13:16.969321] [DEBUG] [LOCAL ] AMP: Trimmed 47562 records to 32543 (keeping 200 days of data) [2025-10-17T17:13:17.173867] [DEBUG] [LOCAL ] AMP: Primary data saved (32543 records). [2025-10-17T17:13:17.174012] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-17T17:13:17.174101] [INFO ] [MAIN ] Update Progress: 103/2368 symbols completed. AMP took 34.7s. Estimated remaining: 4h 50m 44s. Rate: 7.8 symbols/min [2025-10-17T17:13:17.348881] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:17.378438] [DEBUG] [LOCAL ] AMR: Loaded 29158 existing records from primary storage. [2025-10-17T17:13:17.378777] [INFO ] [MAIN ] AMR: Loaded 29158 existing records. [2025-10-17T17:13:17.560536] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-17T17:13:17.565328] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:17.567095] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-17T17:13:17.567174] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-17T17:13:17.567480] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-17T17:13:17.567564] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-17T17:13:17.938763] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:18.236845] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-17T17:13:18.358035] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-17T17:13:18.564787] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T17:13:18.604460] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T17:13:18.611719] [INFO ] [REMOTE ] AMH: Full fetch complete (75082 records). [2025-10-17T17:13:18.611831] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-17T17:13:18.986336] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-17T17:13:18.986417] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-17T17:13:18.987134] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-17T17:13:18.987199] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-17T17:13:18.988582] [DEBUG] [LOCAL ] AMH: Trimmed 75082 records to 52597 (keeping 200 days of data) [2025-10-17T17:13:19.169245] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-17T17:13:19.319230] [DEBUG] [LOCAL ] AMH: Primary data saved (52597 records). [2025-10-17T17:13:19.319401] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-17T17:13:19.319502] [INFO ] [MAIN ] Update Progress: 104/2368 symbols completed. AMH took 43.2s. Estimated remaining: 4h 48m 35s. Rate: 7.8 symbols/min [2025-10-17T17:13:19.486019] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T17:13:19.510678] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:19.549059] [DEBUG] [LOCAL ] AMRC: Loaded 38803 existing records from primary storage. [2025-10-17T17:13:19.549374] [INFO ] [MAIN ] AMRC: Loaded 38803 existing records. [2025-10-17T17:13:19.728071] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:19.728288] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-17T17:13:19.728337] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-17T17:13:19.728875] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-17T17:13:19.728934] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-17T17:13:19.968607] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-17T17:13:20.082663] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:20.292877] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T17:13:20.758047] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-17T17:13:21.081248] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:13:21.558032] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-17T17:13:21.873862] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T17:13:22.358010] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-17T17:13:22.453098] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:13:23.158033] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-17T17:13:23.958010] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-17T17:13:24.006208] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:13:24.476226] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:13:24.758049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-17T17:13:25.322757] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T17:13:25.558018] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-17T17:13:25.884586] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:13:26.358041] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-17T17:13:27.158038] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-17T17:13:27.334177] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:13:27.359086] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T17:13:27.958049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-17T17:13:28.470002] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:13:28.758005] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-17T17:13:29.423984] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:13:29.558034] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-17T17:13:30.267285] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:13:30.358047] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-17T17:13:30.682063] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T17:13:31.158078] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-17T17:13:31.486099] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T17:13:31.958084] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-17T17:13:32.758075] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-17T17:13:33.271565] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T17:13:33.558050] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-17T17:13:33.713536] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T17:13:33.721579] [INFO ] [REMOTE ] AMPX: Full fetch complete (75210 records). [2025-10-17T17:13:33.721782] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-17T17:13:34.039126] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T17:13:34.153616] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-17T17:13:34.153727] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-17T17:13:34.154458] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-17T17:13:34.154520] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-17T17:13:34.156001] [DEBUG] [LOCAL ] AMPX: Trimmed 75210 records to 53118 (keeping 200 days of data) [2025-10-17T17:13:34.358049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-17T17:13:34.467359] [DEBUG] [LOCAL ] AMPX: Primary data saved (53118 records). [2025-10-17T17:13:34.467480] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-17T17:13:34.467593] [INFO ] [MAIN ] Update Progress: 105/2368 symbols completed. AMPX took 48.0s. Estimated remaining: 4h 51m 9s. Rate: 7.8 symbols/min [2025-10-17T17:13:34.634503] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:34.634687] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-17T17:13:34.634740] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-17T17:13:34.634885] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-17T17:13:34.634987] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-17T17:13:34.635051] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-17T17:13:34.635086] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-17T17:13:35.018537] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:35.062000] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:13:35.157990] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-17T17:13:35.958000] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-17T17:13:36.018984] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T17:13:36.462207] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T17:13:36.758030] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-17T17:13:36.964619] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:13:36.965001] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-17T17:13:36.965092] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:13:36.965140] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-17T17:13:36.965205] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:13:36.965278] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-17T17:13:36.965346] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-17T17:13:36.965383] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-17T17:13:36.965422] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-17T17:13:36.965469] [INFO ] [MAIN ] Update Progress: 106/2368 symbols completed. AMRZ took 2.5s. Estimated remaining: 4h 49m 10s. Rate: 7.8 symbols/min [2025-10-17T17:13:37.139788] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:37.174556] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T17:13:37.217231] [DEBUG] [LOCAL ] AMT: Loaded 52860 existing records from primary storage. [2025-10-17T17:13:37.217586] [INFO ] [MAIN ] AMT: Loaded 52860 existing records. [2025-10-17T17:13:37.388974] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:37.389208] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-17T17:13:37.389256] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-17T17:13:37.389685] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-17T17:13:37.389742] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-17T17:13:37.563465] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-17T17:13:37.763679] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:38.358026] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-17T17:13:39.133109] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:13:39.158035] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-17T17:13:39.570428] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T17:13:39.958056] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-17T17:13:40.442237] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:13:40.758078] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-17T17:13:41.558118] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-17T17:13:41.867943] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T17:13:42.247817] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:13:42.254800] [INFO ] [REMOTE ] AMPY: Full fetch complete (53080 records). [2025-10-17T17:13:42.254970] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-17T17:13:42.363286] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-17T17:13:42.634254] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-17T17:13:42.634348] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-17T17:13:42.634938] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-17T17:13:42.635001] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-17T17:13:42.636056] [DEBUG] [LOCAL ] AMPY: Trimmed 53080 records to 39876 (keeping 200 days of data) [2025-10-17T17:13:42.852198] [DEBUG] [LOCAL ] AMPY: Primary data saved (39876 records). [2025-10-17T17:13:42.852338] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-17T17:13:42.852419] [INFO ] [MAIN ] Update Progress: 107/2368 symbols completed. AMPY took 30.2s. Estimated remaining: 4h 48m 25s. Rate: 7.8 symbols/min [2025-10-17T17:13:43.027326] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:43.048690] [DEBUG] [LOCAL ] AMTB: Loaded 20672 existing records from primary storage. [2025-10-17T17:13:43.048938] [INFO ] [MAIN ] AMTB: Loaded 20672 existing records. [2025-10-17T17:13:43.160546] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-17T17:13:43.174337] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T17:13:43.229400] [INFO ] [REMOTE ] AMR: Full fetch complete (40613 records). [2025-10-17T17:13:43.253919] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:43.254128] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-17T17:13:43.254998] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-17T17:13:43.255111] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-17T17:13:43.255514] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-17T17:13:43.297984] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-17T17:13:44.012261] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:44.029726] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-17T17:13:44.029550] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-17T17:13:44.031059] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-17T17:13:44.031756] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-17T17:13:44.031844] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-17T17:13:44.060685] [DEBUG] [LOCAL ] AMR: Trimmed 40613 records to 29322 (keeping 200 days of data) [2025-10-17T17:13:44.062397] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:13:44.249220] [DEBUG] [LOCAL ] AMR: Primary data saved (29322 records). [2025-10-17T17:13:44.249375] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-17T17:13:44.250766] [INFO ] [MAIN ] Update Progress: 108/2368 symbols completed. AMR took 27.1s. Estimated remaining: 4h 46m 6s. Rate: 7.9 symbols/min [2025-10-17T17:13:44.475722] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:44.483280] [DEBUG] [LOCAL ] AMTD: Loaded 3819 existing records from primary storage. [2025-10-17T17:13:44.483545] [INFO ] [MAIN ] AMTD: Loaded 3819 existing records. [2025-10-17T17:13:44.660990] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:44.661238] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-17T17:13:44.661287] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-17T17:13:44.661468] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-17T17:13:44.661526] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-17T17:13:44.758399] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-17T17:13:44.968792] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T17:13:45.067683] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:45.081211] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T17:13:45.558039] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-17T17:13:46.348559] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:13:46.358019] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-17T17:13:46.526886] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T17:13:46.979209] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T17:13:47.158092] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-17T17:13:47.686169] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T17:13:47.958033] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-17T17:13:48.758052] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-17T17:13:48.955429] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:13:49.343962] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:13:49.558008] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-17T17:13:50.358137] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-17T17:13:51.157999] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-17T17:13:51.295403] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T17:13:51.478895] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T17:13:51.958047] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-17T17:13:52.758055] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-17T17:13:53.110831] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T17:13:53.147182] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T17:13:53.558012] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-17T17:13:53.781607] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T17:13:54.358035] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-17T17:13:55.158011] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-17T17:13:55.250682] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T17:13:55.256791] [INFO ] [REMOTE ] AMRC: Full fetch complete (54386 records). [2025-10-17T17:13:55.256941] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-17T17:13:55.647474] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-17T17:13:55.647584] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-17T17:13:55.648519] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-17T17:13:55.648609] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-17T17:13:55.649978] [DEBUG] [LOCAL ] AMRC: Trimmed 54386 records to 39116 (keeping 200 days of data) [2025-10-17T17:13:55.872817] [DEBUG] [LOCAL ] AMRC: Primary data saved (39116 records). [2025-10-17T17:13:55.872988] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-17T17:13:55.873132] [INFO ] [MAIN ] Update Progress: 109/2368 symbols completed. AMRC took 36.6s. Estimated remaining: 4h 47m 22s. Rate: 7.9 symbols/min [2025-10-17T17:13:55.921933] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T17:13:55.963123] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-17T17:13:56.057480] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:56.109392] [DEBUG] [LOCAL ] AMTM: Loaded 50899 existing records from primary storage. [2025-10-17T17:13:56.109768] [INFO ] [MAIN ] AMTM: Loaded 50899 existing records. [2025-10-17T17:13:56.301099] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:56.301475] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-17T17:13:56.301635] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-17T17:13:56.301983] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-17T17:13:56.302183] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-17T17:13:56.527775] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T17:13:56.721281] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:56.732919] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T17:13:56.757984] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-17T17:13:57.558088] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-17T17:13:57.836742] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T17:13:57.964429] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T17:13:58.358027] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-17T17:13:58.821707] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-17T17:13:59.158031] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-17T17:13:59.958002] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-17T17:14:00.758033] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-17T17:14:01.312604] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T17:14:01.558053] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-17T17:14:01.744390] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T17:14:02.053033] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-17T17:14:02.358039] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-17T17:14:03.121050] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T17:14:03.158050] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-17T17:14:03.692500] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T17:14:03.958096] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-17T17:14:04.758106] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-17T17:14:05.075799] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:14:05.226216] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T17:14:05.561409] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-17T17:14:05.566733] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:14:06.358044] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-17T17:14:06.617878] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T17:14:06.621192] [INFO ] [REMOTE ] AMTB: Full fetch complete (29693 records). [2025-10-17T17:14:06.621285] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-17T17:14:06.986015] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-17T17:14:06.986093] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-17T17:14:06.986467] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-17T17:14:06.986532] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-17T17:14:06.987259] [DEBUG] [LOCAL ] AMTB: Trimmed 29693 records to 20848 (keeping 200 days of data) [2025-10-17T17:14:07.108259] [DEBUG] [LOCAL ] AMTB: Primary data saved (20848 records). [2025-10-17T17:14:07.108392] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-17T17:14:07.108488] [INFO ] [MAIN ] Update Progress: 110/2368 symbols completed. AMTB took 24.3s. Estimated remaining: 4h 48m 28s. Rate: 7.8 symbols/min [2025-10-17T17:14:07.170803] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-17T17:14:07.323284] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:07.334020] [DEBUG] [LOCAL ] AMWL: Loaded 9671 existing records from primary storage. [2025-10-17T17:14:07.334235] [INFO ] [MAIN ] AMWL: Loaded 9671 existing records. [2025-10-17T17:14:07.516144] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:07.516480] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-17T17:14:07.516534] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-17T17:14:07.516770] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-17T17:14:07.516831] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-17T17:14:07.949235] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:07.958024] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-17T17:14:08.128614] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:14:08.536395] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T17:14:08.758040] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-17T17:14:09.174009] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T17:14:09.291994] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T17:14:09.558038] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-17T17:14:10.131214] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T17:14:10.358042] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-17T17:14:11.022369] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T17:14:11.158041] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-17T17:14:11.958064] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-17T17:14:12.698320] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T17:14:12.758056] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-17T17:14:13.381636] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T17:14:13.558057] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-17T17:14:14.358000] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-17T17:14:14.563337] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T17:14:15.128147] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T17:14:15.129347] [INFO ] [REMOTE ] AMTD: Full fetch complete (5528 records). [2025-10-17T17:14:15.129417] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-17T17:14:15.162203] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-17T17:14:15.529755] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-17T17:14:15.529941] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-17T17:14:15.530153] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-17T17:14:15.530302] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-17T17:14:15.531124] [DEBUG] [LOCAL ] AMTD: Trimmed 5528 records to 3828 (keeping 200 days of data) [2025-10-17T17:14:15.553735] [DEBUG] [LOCAL ] AMTD: Primary data saved (3828 records). [2025-10-17T17:14:15.553907] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-17T17:14:15.554017] [INFO ] [MAIN ] Update Progress: 111/2368 symbols completed. AMTD took 31.3s. Estimated remaining: 4h 48m 37s. Rate: 7.8 symbols/min [2025-10-17T17:14:15.750876] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:15.753273] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T17:14:15.812424] [DEBUG] [LOCAL ] AMX: Loaded 49533 existing records from primary storage. [2025-10-17T17:14:15.812767] [INFO ] [MAIN ] AMX: Loaded 49533 existing records. [2025-10-17T17:14:15.960622] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-17T17:14:15.991490] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:15.991879] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-17T17:14:15.991931] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-17T17:14:15.992282] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-17T17:14:15.992337] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-17T17:14:16.290621] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:14:16.359580] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:16.758104] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-17T17:14:17.511025] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T17:14:17.557995] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-17T17:14:17.813928] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:14:18.357995] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-17T17:14:18.396539] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T17:14:19.158036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-17T17:14:19.958002] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-17T17:14:20.064179] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:14:20.072356] [INFO ] [REMOTE ] AMT: Full fetch complete (76179 records). [2025-10-17T17:14:20.072527] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-17T17:14:20.504401] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-17T17:14:20.504550] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-17T17:14:20.505670] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-17T17:14:20.505782] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-17T17:14:20.507995] [DEBUG] [LOCAL ] AMT: Trimmed 76179 records to 53232 (keeping 200 days of data) [2025-10-17T17:14:20.760728] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-17T17:14:20.887924] [DEBUG] [LOCAL ] AMT: Primary data saved (53232 records). [2025-10-17T17:14:20.888134] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-17T17:14:20.889192] [INFO ] [MAIN ] Update Progress: 112/2368 symbols completed. AMT took 43.9s. Estimated remaining: 4h 47m 42s. Rate: 7.8 symbols/min [2025-10-17T17:14:21.071307] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:21.125226] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:14:21.146012] [DEBUG] [LOCAL ] AN: Loaded 31615 existing records from primary storage. [2025-10-17T17:14:21.146247] [INFO ] [MAIN ] AN: Loaded 31615 existing records. [2025-10-17T17:14:21.322354] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:21.322680] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-17T17:14:21.322757] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-17T17:14:21.323239] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-17T17:14:21.323298] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-17T17:14:21.434636] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T17:14:21.565019] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-17T17:14:21.694194] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:21.766245] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T17:14:22.358045] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-17T17:14:23.158056] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-17T17:14:23.185344] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:14:23.874554] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:14:23.958007] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-17T17:14:24.181525] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T17:14:24.758031] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-17T17:14:25.355312] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:14:25.468079] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T17:14:25.558000] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-17T17:14:26.358010] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-17T17:14:26.391219] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T17:14:27.158022] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-17T17:14:27.889025] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T17:14:27.912536] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:14:27.958013] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-17T17:14:28.758017] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-17T17:14:28.794185] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:14:29.558031] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-17T17:14:30.343346] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T17:14:30.357981] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-17T17:14:30.632167] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T17:14:30.634925] [INFO ] [REMOTE ] AMWL: Full fetch complete (14639 records). [2025-10-17T17:14:30.634994] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-17T17:14:30.989345] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-17T17:14:30.989424] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-17T17:14:30.989719] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-17T17:14:30.989784] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-17T17:14:30.990352] [DEBUG] [LOCAL ] AMWL: Trimmed 14639 records to 9827 (keeping 200 days of data) [2025-10-17T17:14:31.042614] [DEBUG] [LOCAL ] AMWL: Primary data saved (9827 records). [2025-10-17T17:14:31.042769] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-17T17:14:31.042855] [INFO ] [MAIN ] Update Progress: 113/2368 symbols completed. AMWL took 23.9s. Estimated remaining: 4h 48m 24s. Rate: 7.8 symbols/min [2025-10-17T17:14:31.163140] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-17T17:14:31.217310] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:31.270190] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-17T17:14:31.270510] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-10-17T17:14:31.445982] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:31.446195] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-17T17:14:31.446245] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-17T17:14:31.446621] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-17T17:14:31.446717] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-17T17:14:31.798137] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:31.958045] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-17T17:14:32.068937] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T17:14:32.758036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-17T17:14:33.085729] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T17:14:33.558072] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-17T17:14:33.916294] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:14:34.358007] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-17T17:14:34.445585] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:14:35.158037] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-17T17:14:35.355763] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T17:14:35.958119] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-17T17:14:36.592829] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T17:14:36.733984] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T17:14:36.757990] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-17T17:14:37.558013] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-17T17:14:37.754329] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T17:14:38.266162] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:14:38.358002] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-17T17:14:39.158042] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-17T17:14:39.739596] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T17:14:39.883358] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-17T17:14:39.958032] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-17T17:14:40.451692] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T17:14:40.758074] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-17T17:14:41.558030] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-17T17:14:42.219239] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-17T17:14:42.358007] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-17T17:14:42.644361] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T17:14:42.651346] [INFO ] [REMOTE ] AMTM: Full fetch complete (73831 records). [2025-10-17T17:14:42.651490] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-17T17:14:42.985014] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:14:43.065601] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-17T17:14:43.065706] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-17T17:14:43.066474] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-17T17:14:43.066517] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-17T17:14:43.067992] [DEBUG] [LOCAL ] AMTM: Trimmed 73831 records to 51234 (keeping 200 days of data) [2025-10-17T17:14:43.158730] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-17T17:14:43.362626] [DEBUG] [LOCAL ] AMTM: Primary data saved (51234 records). [2025-10-17T17:14:43.362788] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-17T17:14:43.362870] [INFO ] [MAIN ] Update Progress: 114/2368 symbols completed. AMTM took 47.5s. Estimated remaining: 4h 49m 48s. Rate: 7.8 symbols/min [2025-10-17T17:14:43.530042] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:43.578733] [DEBUG] [LOCAL ] ANF: Loaded 52463 existing records from primary storage. [2025-10-17T17:14:43.579058] [INFO ] [MAIN ] ANF: Loaded 52463 existing records. [2025-10-17T17:14:43.754764] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:43.754990] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-17T17:14:43.755037] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-17T17:14:43.755510] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-17T17:14:43.755547] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-17T17:14:43.968777] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-17T17:14:44.184606] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:44.187221] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T17:14:44.220635] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T17:14:44.758084] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-17T17:14:45.558027] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-17T17:14:46.358021] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-17T17:14:46.534060] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-17T17:14:46.537616] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T17:14:46.580171] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T17:14:47.158050] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-17T17:14:47.958099] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-17T17:14:47.994703] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:14:48.758027] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-17T17:14:49.169818] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:14:49.456082] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:14:49.558035] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-17T17:14:50.358001] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-17T17:14:50.627144] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:14:51.158031] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-17T17:14:51.715543] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-17T17:14:51.792889] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:14:51.958041] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-17T17:14:52.154231] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T17:14:52.158406] [INFO ] [REMOTE ] AN: Full fetch complete (47085 records). [2025-10-17T17:14:52.158497] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-17T17:14:52.559148] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-17T17:14:52.559239] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-17T17:14:52.559914] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-17T17:14:52.559982] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-17T17:14:52.561242] [DEBUG] [LOCAL ] AN: Trimmed 47085 records to 31816 (keeping 200 days of data) [2025-10-17T17:14:52.758259] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-17T17:14:52.768340] [DEBUG] [LOCAL ] AN: Primary data saved (31816 records). [2025-10-17T17:14:52.768512] [INFO ] [MAIN ] AN: Full history saved. [2025-10-17T17:14:52.768664] [INFO ] [MAIN ] Update Progress: 115/2368 symbols completed. AN took 31.9s. Estimated remaining: 4h 50m 14s. Rate: 7.8 symbols/min [2025-10-17T17:14:52.966507] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:52.966709] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-17T17:14:52.966761] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-17T17:14:52.966879] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-17T17:14:52.966924] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-17T17:14:52.966967] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-17T17:14:52.967000] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-17T17:14:53.308731] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:53.558047] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-17T17:14:53.751178] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:14:53.751662] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-17T17:14:53.751775] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:14:53.751839] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-17T17:14:53.751904] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:14:53.751978] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-17T17:14:53.752097] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-17T17:14:53.752166] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-17T17:14:53.752242] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-17T17:14:53.752330] [INFO ] [MAIN ] Update Progress: 116/2368 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 47m 55s. Rate: 7.8 symbols/min [2025-10-17T17:14:53.957675] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:53.977201] [DEBUG] [LOCAL ] ANRO: Loaded 19575 existing records from primary storage. [2025-10-17T17:14:53.977450] [INFO ] [MAIN ] ANRO: Loaded 19575 existing records. [2025-10-17T17:14:54.156736] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:54.157049] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-17T17:14:54.157197] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-17T17:14:54.157628] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-17T17:14:54.157760] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-17T17:14:54.365484] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-17T17:14:54.529352] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-17T17:14:54.579469] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:54.607636] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T17:14:55.158035] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-17T17:14:55.958145] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-17T17:14:56.116184] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:14:56.758011] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-17T17:14:56.970762] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:14:56.977950] [INFO ] [REMOTE ] AMX: Full fetch complete (70987 records). [2025-10-17T17:14:56.978097] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-17T17:14:57.410730] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:14:57.409534] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-17T17:14:57.410854] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-17T17:14:57.418494] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-17T17:14:57.418557] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-17T17:14:57.419922] [DEBUG] [LOCAL ] AMX: Trimmed 70987 records to 49908 (keeping 200 days of data) [2025-10-17T17:14:57.590479] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-17T17:14:57.716877] [DEBUG] [LOCAL ] AMX: Primary data saved (49908 records). [2025-10-17T17:14:57.717023] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-17T17:14:57.717898] [INFO ] [MAIN ] Update Progress: 117/2368 symbols completed. AMX took 42.2s. Estimated remaining: 4h 46m 36s. Rate: 7.9 symbols/min [2025-10-17T17:14:58.358137] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-17T17:14:58.466294] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T17:14:58.598732] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T17:14:59.158039] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-17T17:14:59.965753] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-17T17:14:59.967416] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T17:15:00.695312] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T17:15:00.758030] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-17T17:15:01.558061] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-17T17:15:02.264627] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T17:15:02.330350] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T17:15:02.358027] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-17T17:15:03.158101] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-17T17:15:03.495553] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T17:15:03.958038] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-17T17:15:04.189370] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-17T17:15:04.758116] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-17T17:15:04.886189] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T17:15:05.122270] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T17:15:05.558065] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-17T17:15:06.358040] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-17T17:15:07.065935] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:15:07.116481] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-17T17:15:07.123931] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-17T17:15:07.124054] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-17T17:15:07.166312] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-17T17:15:07.507261] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-17T17:15:07.507339] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-17T17:15:07.508119] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-17T17:15:07.508182] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-17T17:15:07.509624] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 54546 (keeping 200 days of data) [2025-10-17T17:15:07.627441] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T17:15:07.854469] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-10-17T17:15:07.854633] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-17T17:15:07.854753] [INFO ] [MAIN ] Update Progress: 118/2368 symbols completed. ANET took 36.8s. Estimated remaining: 4h 47m 16s. Rate: 7.8 symbols/min [2025-10-17T17:15:07.958038] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-17T17:15:08.953437] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T17:15:08.958058] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-17T17:15:09.561673] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-17T17:15:09.574091] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-17T17:15:09.913763] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:15:10.358092] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-17T17:15:11.383322] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T17:15:11.394509] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-17T17:15:11.419564] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T17:15:11.958064] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-17T17:15:12.878949] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:15:12.894046] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-17T17:15:12.968607] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T17:15:12.972820] [INFO ] [REMOTE ] ANRO: Full fetch complete (29839 records). [2025-10-17T17:15:12.972898] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-17T17:15:13.340139] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-17T17:15:13.340215] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-17T17:15:13.340587] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-17T17:15:13.340628] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-17T17:15:13.341373] [DEBUG] [LOCAL ] ANRO: Trimmed 29839 records to 19753 (keeping 200 days of data) [2025-10-17T17:15:13.447535] [DEBUG] [LOCAL ] ANRO: Primary data saved (19753 records). [2025-10-17T17:15:13.447728] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-17T17:15:13.447829] [INFO ] [MAIN ] Update Progress: 119/2368 symbols completed. ANRO took 19.7s. Estimated remaining: 4h 46m 29s. Rate: 7.9 symbols/min [2025-10-17T17:15:14.623119] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T17:15:14.631359] [INFO ] [REMOTE ] ANF: Full fetch complete (75786 records). [2025-10-17T17:15:14.631586] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-17T17:15:15.054380] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-17T17:15:15.054719] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-17T17:15:15.055498] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-17T17:15:15.055544] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-17T17:15:15.057121] [DEBUG] [LOCAL ] ANF: Trimmed 75786 records to 52835 (keeping 200 days of data) [2025-10-17T17:15:15.363184] [DEBUG] [LOCAL ] ANF: Primary data saved (52835 records). [2025-10-17T17:15:15.363321] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-17T17:15:15.363399] [INFO ] [MAIN ] Update Progress: 120/2368 symbols completed. ANF took 32.0s. Estimated remaining: 4h 44m 34s. Rate: 7.9 symbols/min [2025-10-17T17:15:15.975350] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.014958] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.048559] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-17T17:15:16.067466] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.065526] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.068155] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-17T17:15:16.068066] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-17T17:15:16.068389] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-17T17:15:16.068561] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-17T17:15:16.068232] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-17T17:15:16.068983] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-17T17:15:16.068810] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-17T17:15:16.069109] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-17T17:15:16.069474] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-17T17:15:16.081098] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-17T17:15:16.090555] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-17T17:15:16.268615] [DEBUG] [LOCAL ] ANVS: Loaded 24112 existing records from primary storage. [2025-10-17T17:15:16.305624] [INFO ] [MAIN ] ANVS: Loaded 24112 existing records. [2025-10-17T17:15:16.377232] [DEBUG] [LOCAL ] AOD: Loaded 31036 existing records from primary storage. [2025-10-17T17:15:16.411372] [INFO ] [MAIN ] AOD: Loaded 31036 existing records. [2025-10-17T17:15:16.956869] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:17.068718] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-17T17:15:17.068984] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-17T17:15:17.110076] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-17T17:15:17.141794] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-17T17:15:17.197741] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:17.182336] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:17.225508] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-17T17:15:17.248408] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-17T17:15:17.254501] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-17T17:15:17.318727] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-17T17:15:17.383772] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:17.387986] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-17T17:15:17.388466] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-17T17:15:17.607629] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:15:17.686757] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-17T17:15:17.704224] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:15:17.725933] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-17T17:15:17.726045] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:15:17.726220] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-17T17:15:17.726303] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-17T17:15:17.731993] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-17T17:15:17.747580] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-17T17:15:17.755441] [INFO ] [MAIN ] Update Progress: 121/2368 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 42m 50s. Rate: 7.9 symbols/min [2025-10-17T17:15:17.886369] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:17.893538] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-17T17:15:18.191262] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:18.206430] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-17T17:15:18.226708] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:18.267884] [DEBUG] [LOCAL ] AON: Loaded 45501 existing records from primary storage. [2025-10-17T17:15:18.268203] [INFO ] [MAIN ] AON: Loaded 45501 existing records. [2025-10-17T17:15:18.442777] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:18.442997] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-17T17:15:18.443063] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-17T17:15:18.443436] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-17T17:15:18.443490] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-17T17:15:18.555878] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T17:15:18.574695] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-17T17:15:18.807741] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:18.808139] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-17T17:15:19.295994] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T17:15:19.298892] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-17T17:15:19.373315] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T17:15:19.397622] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-17T17:15:19.399135] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T17:15:19.966372] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-17T17:15:19.967475] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T17:15:20.110950] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:15:20.721113] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T17:15:20.757995] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-17T17:15:20.869200] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T17:15:21.558018] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-17T17:15:21.971423] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T17:15:22.358046] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-17T17:15:23.163125] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-17T17:15:23.175433] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:15:23.590695] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T17:15:23.958037] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-17T17:15:24.758048] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-17T17:15:24.894748] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:15:24.944530] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T17:15:25.558039] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-17T17:15:26.141500] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T17:15:26.173523] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T17:15:26.358033] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-17T17:15:27.158094] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-17T17:15:27.488944] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T17:15:27.957994] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-17T17:15:28.115592] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T17:15:28.758006] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-17T17:15:29.064079] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:15:29.558030] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-17T17:15:29.712346] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T17:15:30.358026] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-17T17:15:30.458958] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T17:15:31.158009] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-17T17:15:31.212234] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T17:15:31.958024] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-17T17:15:32.769898] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-17T17:15:32.772685] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:15:33.558008] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-17T17:15:33.651773] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:15:34.137851] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:15:34.358066] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-17T17:15:34.763267] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T17:15:35.158083] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-17T17:15:35.182772] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:15:35.958042] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-17T17:15:36.758013] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-17T17:15:36.964762] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T17:15:37.091911] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T17:15:37.251298] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T17:15:37.558022] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-17T17:15:38.358014] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-17T17:15:38.796283] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:15:39.158089] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-17T17:15:39.282826] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T17:15:39.958089] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-17T17:15:40.214094] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T17:15:40.758101] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-17T17:15:40.957039] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T17:15:41.558041] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-17T17:15:42.243042] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T17:15:42.358052] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-17T17:15:42.500010] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:15:42.503469] [INFO ] [REMOTE ] AOMR: Full fetch complete (23243 records). [2025-10-17T17:15:42.503555] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-17T17:15:42.920018] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-17T17:15:42.920122] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-17T17:15:42.920522] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-17T17:15:42.920585] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-17T17:15:42.921330] [DEBUG] [LOCAL ] AOMR: Trimmed 23243 records to 16681 (keeping 200 days of data) [2025-10-17T17:15:43.022594] [DEBUG] [LOCAL ] AOMR: Primary data saved (16681 records). [2025-10-17T17:15:43.022773] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-17T17:15:43.022919] [INFO ] [MAIN ] Update Progress: 122/2368 symbols completed. AOMR took 27.6s. Estimated remaining: 4h 48m 9s. Rate: 7.8 symbols/min [2025-10-17T17:15:43.163202] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-17T17:15:43.214216] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:43.245218] [DEBUG] [LOCAL ] AORT: Loaded 29387 existing records from primary storage. [2025-10-17T17:15:43.245490] [INFO ] [MAIN ] AORT: Loaded 29387 existing records. [2025-10-17T17:15:43.450672] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:43.451001] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-17T17:15:43.451061] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-17T17:15:43.451237] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-17T17:15:43.451277] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-17T17:15:43.831590] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:43.883513] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:15:43.958047] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-17T17:15:44.649268] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T17:15:44.758025] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-17T17:15:45.115304] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:15:45.558062] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-17T17:15:46.060315] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T17:15:46.064977] [INFO ] [REMOTE ] AOD: Full fetch complete (44503 records). [2025-10-17T17:15:46.065088] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-17T17:15:46.065743] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:15:46.065832] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:15:46.065875] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:15:46.065915] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-17T17:15:46.065975] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-17T17:15:46.066011] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-10-17T17:15:46.066178] [DEBUG] [LOCAL ] AOD: Deleted derivative data file. [2025-10-17T17:15:46.066272] [INFO ] [MAIN ] Update Progress: 123/2368 symbols completed. AOD took 30.7s. Estimated remaining: 4h 46m 36s. Rate: 7.8 symbols/min [2025-10-17T17:15:46.230928] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:46.231119] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-17T17:15:46.231157] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-17T17:15:46.231266] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-17T17:15:46.231307] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-17T17:15:46.231351] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-17T17:15:46.231383] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-17T17:15:46.370838] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-17T17:15:46.596346] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:46.660854] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T17:15:46.665772] [INFO ] [REMOTE ] ANVS: Full fetch complete (36879 records). [2025-10-17T17:15:46.665899] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-17T17:15:47.038253] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-17T17:15:47.038333] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-17T17:15:47.038835] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-17T17:15:47.038897] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-17T17:15:47.039744] [DEBUG] [LOCAL ] ANVS: Trimmed 36879 records to 24303 (keeping 200 days of data) [2025-10-17T17:15:47.159552] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-17T17:15:47.187321] [DEBUG] [LOCAL ] ANVS: Primary data saved (24303 records). [2025-10-17T17:15:47.187418] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-17T17:15:47.187538] [INFO ] [MAIN ] Update Progress: 124/2368 symbols completed. ANVS took 31.8s. Estimated remaining: 4h 44m 30s. Rate: 7.9 symbols/min [2025-10-17T17:15:47.360620] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:47.369993] [DEBUG] [LOCAL ] AP: Loaded 7398 existing records from primary storage. [2025-10-17T17:15:47.370157] [INFO ] [MAIN ] AP: Loaded 7398 existing records. [2025-10-17T17:15:47.570510] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:47.570730] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-17T17:15:47.570805] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-17T17:15:47.570974] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-17T17:15:47.571040] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-17T17:15:47.939499] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:15:47.961852] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:47.969832] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-17T17:15:48.659973] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T17:15:48.758039] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-17T17:15:49.335532] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T17:15:49.558086] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-17T17:15:49.929150] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:15:50.358036] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-17T17:15:50.938693] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T17:15:51.158026] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-17T17:15:51.506280] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T17:15:51.958041] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-17T17:15:52.737330] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:15:52.757983] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-17T17:15:52.853415] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T17:15:53.384488] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T17:15:53.558033] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-17T17:15:54.129314] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T17:15:54.358062] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-17T17:15:55.158067] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-17T17:15:55.766743] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:15:55.958072] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-17T17:15:56.083558] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:15:56.758022] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-17T17:15:57.159877] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T17:15:57.558045] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-17T17:15:58.358044] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-17T17:15:59.164828] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-17T17:15:59.184291] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T17:15:59.548389] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:15:59.614107] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T17:15:59.641337] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T17:15:59.958002] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-17T17:16:00.639913] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T17:16:00.758049] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-17T17:16:01.558023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-17T17:16:02.340346] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T17:16:02.357993] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-17T17:16:02.825893] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:16:03.158040] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-17T17:16:03.445898] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T17:16:03.958051] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-17T17:16:04.758089] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-17T17:16:05.242231] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T17:16:05.557996] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-17T17:16:05.943287] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T17:16:06.365126] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-17T17:16:06.369632] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T17:16:07.158063] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-17T17:16:07.188736] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T17:16:07.194789] [INFO ] [REMOTE ] AON: Full fetch complete (65030 records). [2025-10-17T17:16:07.194927] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-17T17:16:07.581344] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-17T17:16:07.581440] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-17T17:16:07.582199] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-17T17:16:07.582275] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-17T17:16:07.583725] [DEBUG] [LOCAL ] AON: Trimmed 65030 records to 45813 (keeping 200 days of data) [2025-10-17T17:16:07.872247] [DEBUG] [LOCAL ] AON: Primary data saved (45813 records). [2025-10-17T17:16:07.872534] [INFO ] [MAIN ] AON: Full history saved. [2025-10-17T17:16:07.872723] [INFO ] [MAIN ] Update Progress: 125/2368 symbols completed. AON took 50.0s. Estimated remaining: 4h 48m 17s. Rate: 7.8 symbols/min [2025-10-17T17:16:07.965106] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-17T17:16:08.047476] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:08.047942] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-17T17:16:08.048007] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-17T17:16:08.048246] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-17T17:16:08.048308] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-17T17:16:08.048363] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-17T17:16:08.048470] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-17T17:16:08.214675] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T17:16:08.469023] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:08.485848] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T17:16:08.492321] [INFO ] [REMOTE ] AORT: Full fetch complete (42328 records). [2025-10-17T17:16:08.492535] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-17T17:16:08.746304] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T17:16:08.763153] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-17T17:16:08.946511] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-17T17:16:08.946595] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-17T17:16:08.947126] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-17T17:16:08.947189] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-17T17:16:08.948363] [DEBUG] [LOCAL ] AORT: Trimmed 42328 records to 29531 (keeping 200 days of data) [2025-10-17T17:16:09.117406] [DEBUG] [LOCAL ] AORT: Primary data saved (29531 records). [2025-10-17T17:16:09.117568] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-17T17:16:09.117679] [INFO ] [MAIN ] Update Progress: 126/2368 symbols completed. AORT took 26.1s. Estimated remaining: 4h 46m 14s. Rate: 7.8 symbols/min [2025-10-17T17:16:09.294064] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:09.345911] [DEBUG] [LOCAL ] APD: Loaded 45857 existing records from primary storage. [2025-10-17T17:16:09.346235] [INFO ] [MAIN ] APD: Loaded 45857 existing records. [2025-10-17T17:16:09.538496] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:09.538729] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-17T17:16:09.538783] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-17T17:16:09.539133] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-17T17:16:09.539172] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-17T17:16:09.568851] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-17T17:16:09.907098] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:10.358086] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-17T17:16:10.612226] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:16:10.920954] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T17:16:11.152039] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T17:16:11.158546] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-17T17:16:11.958077] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-17T17:16:12.503986] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T17:16:12.758087] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-17T17:16:13.558053] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-17T17:16:13.628485] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:16:14.196110] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:16:14.358060] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-17T17:16:15.118483] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:16:15.158009] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-17T17:16:15.283777] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T17:16:15.958013] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-17T17:16:16.606600] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:16:16.758030] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-17T17:16:17.558051] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-17T17:16:17.776297] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T17:16:18.042888] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-17T17:16:18.259688] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:16:18.358048] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-17T17:16:19.158078] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-17T17:16:19.694249] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T17:16:19.958049] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-17T17:16:20.758007] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-17T17:16:20.937054] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:16:21.340891] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:16:21.347564] [INFO ] [REMOTE ] AOS: Full fetch complete (70995 records). [2025-10-17T17:16:21.347735] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-17T17:16:21.563222] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-17T17:16:21.787038] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-17T17:16:21.787126] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-17T17:16:21.787908] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-17T17:16:21.787973] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-17T17:16:21.789413] [DEBUG] [LOCAL ] AOS: Trimmed 70995 records to 49475 (keeping 200 days of data) [2025-10-17T17:16:22.132713] [DEBUG] [LOCAL ] AOS: Primary data saved (49475 records). [2025-10-17T17:16:22.132878] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-17T17:16:22.132963] [INFO ] [MAIN ] Update Progress: 127/2368 symbols completed. AOS took 36.1s. Estimated remaining: 4h 47m 41s. Rate: 7.8 symbols/min [2025-10-17T17:16:22.259553] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T17:16:22.317229] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:22.365872] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-17T17:16:22.369430] [DEBUG] [LOCAL ] APG: Loaded 50964 existing records from primary storage. [2025-10-17T17:16:22.369869] [INFO ] [MAIN ] APG: Loaded 50964 existing records. [2025-10-17T17:16:22.552468] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:22.552784] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-17T17:16:22.552920] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-17T17:16:22.553207] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-17T17:16:22.553298] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-17T17:16:22.914035] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:22.938017] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T17:16:23.158092] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-17T17:16:23.811288] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T17:16:23.958026] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-17T17:16:24.611846] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:16:24.758023] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-17T17:16:24.848125] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T17:16:24.849488] [INFO ] [REMOTE ] AP: Full fetch complete (9035 records). [2025-10-17T17:16:24.849565] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-17T17:16:24.850152] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:16:24.850242] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:16:24.850284] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:16:24.850359] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-17T17:16:24.850425] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-17T17:16:24.850460] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-17T17:16:24.850580] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-17T17:16:24.850688] [INFO ] [MAIN ] Update Progress: 128/2368 symbols completed. AP took 37.7s. Estimated remaining: 4h 46m 6s. Rate: 7.8 symbols/min [2025-10-17T17:16:25.015441] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:25.015622] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-17T17:16:25.015716] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-17T17:16:25.015871] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-17T17:16:25.015937] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-17T17:16:25.015993] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-17T17:16:25.016036] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-17T17:16:25.369985] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:25.558023] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-17T17:16:26.358052] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-17T17:16:26.698272] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:16:26.769872] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T17:16:27.158096] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-17T17:16:27.730073] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T17:16:27.958054] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-17T17:16:28.758020] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-17T17:16:29.016987] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:16:29.558012] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-17T17:16:29.665363] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T17:16:30.255289] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:16:30.358024] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-17T17:16:31.158044] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-17T17:16:31.243414] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:16:31.959925] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-17T17:16:31.965552] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:16:32.582996] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T17:16:32.758047] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-17T17:16:33.558013] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-17T17:16:34.087680] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-17T17:16:34.226118] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T17:16:34.358033] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-17T17:16:34.903550] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T17:16:35.158040] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-17T17:16:35.751225] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T17:16:35.758480] [INFO ] [REMOTE ] APAM: Full fetch complete (52144 records). [2025-10-17T17:16:35.758726] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-17T17:16:35.964196] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-17T17:16:36.155952] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-17T17:16:36.156053] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-17T17:16:36.156631] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-17T17:16:36.156712] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-17T17:16:36.157775] [DEBUG] [LOCAL ] APAM: Trimmed 52144 records to 36578 (keeping 200 days of data) [2025-10-17T17:16:36.371024] [DEBUG] [LOCAL ] APAM: Primary data saved (36578 records). [2025-10-17T17:16:36.371162] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-17T17:16:36.371276] [INFO ] [MAIN ] Update Progress: 129/2368 symbols completed. APAM took 28.5s. Estimated remaining: 4h 47m 6s. Rate: 7.8 symbols/min [2025-10-17T17:16:36.539010] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:36.590725] [DEBUG] [LOCAL ] APLE: Loaded 52352 existing records from primary storage. [2025-10-17T17:16:36.591027] [INFO ] [MAIN ] APLE: Loaded 52352 existing records. [2025-10-17T17:16:36.760593] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-17T17:16:36.765378] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:36.766565] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-17T17:16:36.766687] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-17T17:16:36.767264] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-17T17:16:36.767324] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-17T17:16:37.123117] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:37.150423] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:16:37.558054] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-17T17:16:38.193665] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T17:16:38.324505] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:16:38.358043] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-17T17:16:39.036062] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T17:16:39.158070] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-17T17:16:39.958068] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-17T17:16:40.195000] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T17:16:40.758131] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-17T17:16:41.144831] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T17:16:41.558025] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-17T17:16:41.873172] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T17:16:42.358011] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-17T17:16:43.081464] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T17:16:43.157982] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-17T17:16:43.491573] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T17:16:43.958104] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-17T17:16:44.376478] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-17T17:16:44.758074] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-17T17:16:45.339604] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T17:16:45.552165] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:16:45.563517] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-17T17:16:46.358065] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-17T17:16:46.517680] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:16:47.158054] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-17T17:16:47.465084] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T17:16:47.568572] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T17:16:47.958051] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-17T17:16:48.752070] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:16:48.763136] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-17T17:16:49.371964] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:16:49.378416] [INFO ] [REMOTE ] APD: Full fetch complete (67350 records). [2025-10-17T17:16:49.378530] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-17T17:16:49.565925] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-17T17:16:49.781909] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-17T17:16:49.782028] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-17T17:16:49.782970] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-17T17:16:49.783041] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-17T17:16:49.784918] [DEBUG] [LOCAL ] APD: Trimmed 67350 records to 46187 (keeping 200 days of data) [2025-10-17T17:16:50.102630] [DEBUG] [LOCAL ] APD: Primary data saved (46187 records). [2025-10-17T17:16:50.102858] [INFO ] [MAIN ] APD: Full history saved. [2025-10-17T17:16:50.104856] [INFO ] [MAIN ] Update Progress: 130/2368 symbols completed. APD took 41.0s. Estimated remaining: 4h 48m 42s. Rate: 7.8 symbols/min [2025-10-17T17:16:50.292551] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:50.362688] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-17T17:16:50.374432] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:16:50.409036] [DEBUG] [LOCAL ] APO: Loaded 53779 existing records from primary storage. [2025-10-17T17:16:50.409518] [INFO ] [MAIN ] APO: Loaded 53779 existing records. [2025-10-17T17:16:50.596400] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:50.596792] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-17T17:16:50.596855] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-17T17:16:50.597451] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-17T17:16:50.597541] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-17T17:16:50.970834] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:51.158058] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-17T17:16:51.496844] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:16:51.733716] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:16:51.958055] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-17T17:16:52.758009] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-17T17:16:53.558017] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-17T17:16:53.627568] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-17T17:16:53.885499] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T17:16:54.358069] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-17T17:16:54.496328] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:16:54.503546] [INFO ] [REMOTE ] APG: Full fetch complete (72204 records). [2025-10-17T17:16:54.503732] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-17T17:16:54.887033] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-17T17:16:54.887120] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-17T17:16:54.887871] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-17T17:16:54.887938] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-17T17:16:54.889348] [DEBUG] [LOCAL ] APG: Trimmed 72204 records to 51343 (keeping 200 days of data) [2025-10-17T17:16:55.169686] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-17T17:16:55.189179] [DEBUG] [LOCAL ] APG: Primary data saved (51343 records). [2025-10-17T17:16:55.189320] [INFO ] [MAIN ] APG: Full history saved. [2025-10-17T17:16:55.189401] [INFO ] [MAIN ] Update Progress: 131/2368 symbols completed. APG took 33.1s. Estimated remaining: 4h 47m 49s. Rate: 7.8 symbols/min [2025-10-17T17:16:55.358930] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:55.368328] [DEBUG] [LOCAL ] APOS: Loaded 7359 existing records from primary storage. [2025-10-17T17:16:55.368570] [INFO ] [MAIN ] APOS: Loaded 7359 existing records. [2025-10-17T17:16:55.546279] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:55.546605] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-17T17:16:55.546689] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-17T17:16:55.546925] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-17T17:16:55.546992] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-17T17:16:55.850071] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-17T17:16:55.955381] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:55.967349] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-17T17:16:55.988639] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:16:56.758035] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-17T17:16:57.027118] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T17:16:57.032995] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:16:57.558034] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-17T17:16:58.220992] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T17:16:58.319570] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:16:58.358015] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-17T17:16:59.158032] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-17T17:16:59.958081] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-17T17:17:00.267013] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T17:17:00.758124] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-17T17:17:01.558146] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-17T17:17:01.913812] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T17:17:01.949019] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-17T17:17:01.952818] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-17T17:17:02.358086] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-17T17:17:03.073872] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T17:17:03.093731] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T17:17:03.158069] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-17T17:17:03.721306] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:17:03.958042] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-17T17:17:04.758071] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-17T17:17:05.558038] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-17T17:17:06.214937] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T17:17:06.262341] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T17:17:06.357998] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-17T17:17:06.824812] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T17:17:07.158064] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-17T17:17:07.958012] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-17T17:17:08.003690] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T17:17:08.758059] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-17T17:17:08.794473] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T17:17:09.335012] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T17:17:09.343235] [INFO ] [REMOTE ] APLE: Full fetch complete (74734 records). [2025-10-17T17:17:09.343472] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-17T17:17:09.563614] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-17T17:17:09.766466] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-17T17:17:09.766619] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-17T17:17:09.767581] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-17T17:17:09.767672] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-17T17:17:09.769728] [DEBUG] [LOCAL ] APLE: Trimmed 74734 records to 52733 (keeping 200 days of data) [2025-10-17T17:17:10.109078] [DEBUG] [LOCAL ] APLE: Primary data saved (52733 records). [2025-10-17T17:17:10.109288] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-17T17:17:10.109395] [INFO ] [MAIN ] Update Progress: 132/2368 symbols completed. APLE took 33.7s. Estimated remaining: 4h 49m 43s. Rate: 7.7 symbols/min [2025-10-17T17:17:10.342203] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:10.343715] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-17T17:17:10.343774] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-17T17:17:10.343952] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-17T17:17:10.344037] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-17T17:17:10.344109] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-17T17:17:10.344146] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-17T17:17:10.377971] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-17T17:17:10.728290] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:10.902997] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T17:17:11.158009] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-17T17:17:11.348528] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-17T17:17:11.695998] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T17:17:11.699130] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-17T17:17:11.958028] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-17T17:17:12.480820] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T17:17:12.758050] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-17T17:17:13.558042] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-17T17:17:14.358067] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-17T17:17:15.035008] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T17:17:15.037408] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T17:17:15.039091] [INFO ] [REMOTE ] APOS: Full fetch complete (10232 records). [2025-10-17T17:17:15.039266] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-17T17:17:15.047044] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:17:15.047985] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:17:15.048125] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:17:15.048203] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-17T17:17:15.048284] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-17T17:17:15.048324] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-17T17:17:15.048574] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-17T17:17:15.048780] [INFO ] [MAIN ] Update Progress: 133/2368 symbols completed. APOS took 19.9s. Estimated remaining: 4h 48m 48s. Rate: 7.7 symbols/min [2025-10-17T17:17:15.048504] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-17T17:17:15.069871] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-17T17:17:15.162768] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-17T17:17:15.396502] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:15.658365] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-17T17:17:15.658480] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-17T17:17:15.659377] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-17T17:17:15.659719] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-17T17:17:15.685874] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 54471 (keeping 200 days of data) [2025-10-17T17:17:15.785383] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T17:17:15.796098] [DEBUG] [LOCAL ] AQN: Loaded 52131 existing records from primary storage. [2025-10-17T17:17:15.835614] [INFO ] [MAIN ] AQN: Loaded 52131 existing records. [2025-10-17T17:17:15.959743] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-17T17:17:16.041914] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:16.044633] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-17T17:17:16.046461] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-17T17:17:16.050105] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-17T17:17:16.051890] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-17T17:17:16.501741] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:16.660987] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-10-17T17:17:16.661131] [INFO ] [MAIN ] APH: Full history saved. [2025-10-17T17:17:16.663730] [INFO ] [MAIN ] Update Progress: 134/2368 symbols completed. APH took 51.8s. Estimated remaining: 4h 46m 58s. Rate: 7.8 symbols/min [2025-10-17T17:17:16.762099] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-17T17:17:16.834666] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:16.842750] [DEBUG] [LOCAL ] AQNB: Loaded 4077 existing records from primary storage. [2025-10-17T17:17:16.842987] [INFO ] [MAIN ] AQNB: Loaded 4077 existing records. [2025-10-17T17:17:17.021978] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:17.022298] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-17T17:17:17.022404] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-17T17:17:17.022799] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-17T17:17:17.022957] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-17T17:17:17.357848] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T17:17:17.426873] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:17.515014] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T17:17:17.557993] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-17T17:17:18.369331] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-17T17:17:18.375980] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:17:18.406666] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:17:19.158127] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-17T17:17:19.958073] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-17T17:17:20.513672] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T17:17:20.758095] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-17T17:17:21.250437] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:17:21.299594] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:17:21.347800] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-17T17:17:21.558026] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-17T17:17:22.358130] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-17T17:17:23.034162] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T17:17:23.158081] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-17T17:17:23.604400] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T17:17:23.960421] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-17T17:17:23.968302] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:17:24.758061] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-17T17:17:25.358035] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T17:17:25.558043] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-17T17:17:25.897440] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T17:17:25.904533] [INFO ] [REMOTE ] APO: Full fetch complete (77076 records). [2025-10-17T17:17:25.904699] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-17T17:17:25.905505] [FATAL] [VALIDATOR ] APO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:17:25.905596] [FATAL] [MAIN ] APO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:17:25.905673] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:17:25.905739] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-17T17:17:25.905819] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-17T17:17:25.905907] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-10-17T17:17:25.906213] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-10-17T17:17:25.907339] [INFO ] [MAIN ] Update Progress: 135/2368 symbols completed. APO took 35.8s. Estimated remaining: 4h 47m 15s. Rate: 7.8 symbols/min [2025-10-17T17:17:26.076743] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:26.133726] [DEBUG] [LOCAL ] AR: Loaded 53977 existing records from primary storage. [2025-10-17T17:17:26.134277] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:17:26.136567] [INFO ] [MAIN ] AR: Loaded 53977 existing records. [2025-10-17T17:17:26.310668] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:26.310870] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-17T17:17:26.310925] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-17T17:17:26.311297] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-17T17:17:26.311353] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-17T17:17:26.364495] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-17T17:17:26.667109] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:26.973128] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T17:17:27.158027] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-17T17:17:27.958068] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-17T17:17:28.643782] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:17:28.758036] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-17T17:17:29.177741] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T17:17:29.245789] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T17:17:29.558050] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-17T17:17:30.358127] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-17T17:17:30.764710] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-17T17:17:31.158084] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-17T17:17:31.728853] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:17:31.817232] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T17:17:31.958086] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-17T17:17:32.541781] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T17:17:32.542776] [INFO ] [REMOTE ] AQNB: Full fetch complete (5438 records). [2025-10-17T17:17:32.542845] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-17T17:17:32.763230] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-17T17:17:32.904623] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-17T17:17:32.904759] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-17T17:17:32.905012] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-17T17:17:32.905067] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-17T17:17:32.905433] [DEBUG] [LOCAL ] AQNB: Trimmed 5438 records to 4088 (keeping 200 days of data) [2025-10-17T17:17:32.929858] [DEBUG] [LOCAL ] AQNB: Primary data saved (4088 records). [2025-10-17T17:17:32.929942] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-17T17:17:32.930036] [INFO ] [MAIN ] Update Progress: 136/2368 symbols completed. AQNB took 16.3s. Estimated remaining: 4h 46m 56s. Rate: 7.8 symbols/min [2025-10-17T17:17:33.097158] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:33.097368] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-17T17:17:33.097408] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-17T17:17:33.097554] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-17T17:17:33.097603] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-17T17:17:33.097668] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-17T17:17:33.097724] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-17T17:17:33.445705] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:33.558020] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-17T17:17:34.358020] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-17T17:17:34.672431] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:17:34.830454] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:17:35.158103] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-17T17:17:35.958006] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-17T17:17:36.051139] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:17:36.758008] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-17T17:17:36.975144] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T17:17:37.547103] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:17:37.564516] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-17T17:17:38.246888] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:17:38.358078] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-17T17:17:39.158032] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-17T17:17:39.712137] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T17:17:39.958073] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-17T17:17:40.244938] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T17:17:40.649436] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:17:40.758041] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-17T17:17:41.558031] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-17T17:17:42.358042] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-17T17:17:42.668058] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-17T17:17:43.158079] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-17T17:17:43.675056] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-17T17:17:43.958080] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-17T17:17:44.074867] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-17T17:17:44.538811] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:17:44.758177] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-17T17:17:45.118388] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-10-17T17:17:45.557998] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-17T17:17:45.752153] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:17:46.358061] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-17T17:17:46.400175] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:17:47.158001] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-17T17:17:47.205551] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T17:17:47.958053] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-17T17:17:48.126734] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:17:48.745923] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:17:48.758154] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-17T17:17:49.558081] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-17T17:17:49.728486] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:17:50.358071] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-17T17:17:50.458572] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:17:51.158056] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-17T17:17:51.384090] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T17:17:51.958039] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-17T17:17:52.600034] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T17:17:52.736250] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:17:52.757994] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-17T17:17:53.558011] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-17T17:17:53.760072] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:17:53.768778] [INFO ] [REMOTE ] APTV: Full fetch complete (75924 records). [2025-10-17T17:17:53.768987] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-17T17:17:54.179309] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-17T17:17:54.179404] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-17T17:17:54.180159] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-17T17:17:54.180234] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-17T17:17:54.181996] [DEBUG] [LOCAL ] APTV: Trimmed 75924 records to 52719 (keeping 200 days of data) [2025-10-17T17:17:54.361732] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-17T17:17:54.419668] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:17:54.543920] [DEBUG] [LOCAL ] APTV: Primary data saved (52719 records). [2025-10-17T17:17:54.544056] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-17T17:17:54.544129] [INFO ] [MAIN ] Update Progress: 137/2368 symbols completed. APTV took 44.4s. Estimated remaining: 4h 50m 35s. Rate: 7.7 symbols/min [2025-10-17T17:17:54.716830] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:54.734730] [DEBUG] [LOCAL ] ARDC: Loaded 15429 existing records from primary storage. [2025-10-17T17:17:54.734973] [INFO ] [MAIN ] ARDC: Loaded 15429 existing records. [2025-10-17T17:17:54.912675] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:54.912909] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-17T17:17:54.912985] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-17T17:17:54.913197] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-17T17:17:54.913275] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-17T17:17:55.166851] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-17T17:17:55.286774] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:55.332981] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T17:17:55.339790] [INFO ] [REMOTE ] AQN: Full fetch complete (75000 records). [2025-10-17T17:17:55.339924] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-17T17:17:55.340767] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:17:55.340859] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:17:55.340904] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:17:55.340974] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-17T17:17:55.341043] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-17T17:17:55.341085] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-17T17:17:55.341211] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-17T17:17:55.341307] [INFO ] [MAIN ] Update Progress: 138/2368 symbols completed. AQN took 40.3s. Estimated remaining: 4h 48m 34s. Rate: 7.7 symbols/min [2025-10-17T17:17:55.511860] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:55.539434] [DEBUG] [LOCAL ] ARDT: Loaded 27912 existing records from primary storage. [2025-10-17T17:17:55.539791] [INFO ] [MAIN ] ARDT: Loaded 27912 existing records. [2025-10-17T17:17:55.722358] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:55.722569] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-17T17:17:55.722629] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-17T17:17:55.722853] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-17T17:17:55.722899] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-17T17:17:55.967825] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-17T17:17:56.086476] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:56.275180] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:17:56.758042] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-17T17:17:56.877109] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T17:17:56.893538] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T17:17:57.558070] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-17T17:17:57.916614] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:17:58.345586] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:17:58.357979] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-17T17:17:59.158033] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-17T17:17:59.221311] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:17:59.958049] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-17T17:18:00.758047] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-17T17:18:01.264729] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T17:18:01.447210] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:18:01.558065] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-17T17:18:02.358092] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-17T17:18:02.553870] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:18:02.560077] [INFO ] [REMOTE ] ARCO: Full fetch complete (65151 records). [2025-10-17T17:18:02.560226] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-17T17:18:02.943309] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-17T17:18:02.943409] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-17T17:18:02.944084] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-17T17:18:02.944268] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-17T17:18:02.954258] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:18:02.958168] [DEBUG] [LOCAL ] ARCO: Trimmed 65151 records to 45143 (keeping 200 days of data) [2025-10-17T17:18:03.160729] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-17T17:18:03.226336] [DEBUG] [LOCAL ] ARCO: Primary data saved (45143 records). [2025-10-17T17:18:03.226510] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-17T17:18:03.226628] [INFO ] [MAIN ] Update Progress: 139/2368 symbols completed. ARCO took 30.3s. Estimated remaining: 4h 48m 28s. Rate: 7.7 symbols/min [2025-10-17T17:18:03.392966] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:03.440251] [DEBUG] [LOCAL ] ARE: Loaded 51360 existing records from primary storage. [2025-10-17T17:18:03.440580] [INFO ] [MAIN ] ARE: Loaded 51360 existing records. [2025-10-17T17:18:03.614254] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:03.614513] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-17T17:18:03.614579] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-17T17:18:03.615020] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-17T17:18:03.615077] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-17T17:18:03.968449] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-17T17:18:03.974603] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:04.010210] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:18:04.576071] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:18:04.751440] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T17:18:04.757989] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-17T17:18:05.558036] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-17T17:18:06.361382] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-17T17:18:06.364918] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:18:06.468480] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T17:18:07.158037] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-17T17:18:07.331195] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:18:07.958010] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-17T17:18:08.070469] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T17:18:08.758100] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-17T17:18:09.557999] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-17T17:18:09.688534] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:18:10.357998] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-17T17:18:10.635027] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:18:10.967699] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T17:18:11.217954] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-17T17:18:11.230800] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:18:11.958056] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-17T17:18:12.758008] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-17T17:18:12.833994] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:18:13.558001] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-17T17:18:13.796421] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T17:18:14.015849] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T17:18:14.358047] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-17T17:18:15.158045] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-17T17:18:15.379419] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T17:18:15.958026] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-17T17:18:16.073561] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:18:16.108431] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T17:18:16.758037] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-17T17:18:17.558011] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-17T17:18:17.820399] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:18:18.090720] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T17:18:18.358062] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-17T17:18:19.107687] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T17:18:19.158036] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-17T17:18:19.772691] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T17:18:19.781436] [INFO ] [REMOTE ] AR: Full fetch complete (77737 records). [2025-10-17T17:18:19.781745] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-17T17:18:19.965733] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-17T17:18:20.186256] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-17T17:18:20.186353] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-17T17:18:20.187183] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-17T17:18:20.187250] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-17T17:18:20.189236] [DEBUG] [LOCAL ] AR: Trimmed 77737 records to 54366 (keeping 200 days of data) [2025-10-17T17:18:20.502580] [DEBUG] [LOCAL ] AR: Primary data saved (54366 records). [2025-10-17T17:18:20.502751] [INFO ] [MAIN ] AR: Full history saved. [2025-10-17T17:18:20.504137] [INFO ] [MAIN ] Update Progress: 140/2368 symbols completed. AR took 54.6s. Estimated remaining: 4h 50m 51s. Rate: 7.7 symbols/min [2025-10-17T17:18:20.676475] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:20.676764] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-17T17:18:20.676811] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-17T17:18:20.676888] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-17T17:18:20.676924] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-17T17:18:20.676963] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-17T17:18:20.676994] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-17T17:18:20.770234] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-17T17:18:21.047850] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:21.329563] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-17T17:18:21.368598] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:18:21.558036] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-17T17:18:21.781105] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T17:18:22.358117] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-17T17:18:23.158019] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-17T17:18:23.772710] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T17:18:23.958077] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-17T17:18:24.057299] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:18:24.201229] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:18:24.205082] [INFO ] [REMOTE ] ARDC: Full fetch complete (21383 records). [2025-10-17T17:18:24.205179] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-17T17:18:24.205943] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:18:24.206090] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:18:24.206146] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:18:24.206222] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-17T17:18:24.206297] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-17T17:18:24.206337] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-17T17:18:24.206499] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-17T17:18:24.206596] [INFO ] [MAIN ] Update Progress: 141/2368 symbols completed. ARDC took 29.7s. Estimated remaining: 4h 49m 38s. Rate: 7.7 symbols/min [2025-10-17T17:18:24.380443] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:24.425840] [DEBUG] [LOCAL ] ARI: Loaded 44048 existing records from primary storage. [2025-10-17T17:18:24.426247] [INFO ] [MAIN ] ARI: Loaded 44048 existing records. [2025-10-17T17:18:24.623438] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:24.623724] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-17T17:18:24.623784] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-17T17:18:24.623983] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-17T17:18:24.624024] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-17T17:18:24.766158] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-17T17:18:24.990410] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:25.061123] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:18:25.558022] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-17T17:18:26.180230] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T17:18:26.358046] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-17T17:18:26.967629] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:18:26.972203] [INFO ] [REMOTE ] ARDT: Full fetch complete (41612 records). [2025-10-17T17:18:26.972294] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-17T17:18:27.164270] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-17T17:18:27.379662] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-17T17:18:27.379774] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-17T17:18:27.380306] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-17T17:18:27.380352] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-17T17:18:27.381373] [DEBUG] [LOCAL ] ARDT: Trimmed 41612 records to 28112 (keeping 200 days of data) [2025-10-17T17:18:27.552800] [DEBUG] [LOCAL ] ARDT: Primary data saved (28112 records). [2025-10-17T17:18:27.552969] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-17T17:18:27.553086] [INFO ] [MAIN ] Update Progress: 142/2368 symbols completed. ARDT took 32.2s. Estimated remaining: 4h 48m 21s. Rate: 7.7 symbols/min [2025-10-17T17:18:27.724537] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:27.724766] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-17T17:18:27.724812] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-17T17:18:27.724927] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-17T17:18:27.724969] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-17T17:18:27.725030] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-17T17:18:27.725065] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-17T17:18:27.963266] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-17T17:18:28.083201] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:28.110526] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T17:18:28.664520] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:18:28.758062] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-17T17:18:29.558013] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-17T17:18:29.832571] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T17:18:30.357996] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-17T17:18:30.599855] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T17:18:30.973407] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:18:31.158015] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-17T17:18:31.958008] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-17T17:18:32.556910] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-17T17:18:32.716758] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T17:18:32.757989] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-17T17:18:33.558024] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-17T17:18:33.897343] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T17:18:34.357999] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-17T17:18:34.533944] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:18:34.904172] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T17:18:35.158025] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-17T17:18:35.629581] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:18:35.958032] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-17T17:18:36.745224] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:18:36.758046] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-17T17:18:37.558017] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-17T17:18:37.716088] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:18:38.358094] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-17T17:18:38.502555] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:18:39.158043] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-17T17:18:39.378775] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T17:18:39.385814] [INFO ] [REMOTE ] ARE: Full fetch complete (72629 records). [2025-10-17T17:18:39.385976] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-17T17:18:39.386912] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:18:39.387017] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:18:39.387062] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:18:39.387130] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-17T17:18:39.387254] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-17T17:18:39.387321] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-17T17:18:39.387554] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-10-17T17:18:39.389010] [INFO ] [MAIN ] Update Progress: 143/2368 symbols completed. ARE took 36.2s. Estimated remaining: 4h 49m 16s. Rate: 7.7 symbols/min [2025-10-17T17:18:39.562777] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:39.620028] [DEBUG] [LOCAL ] ARMK: Loaded 50753 existing records from primary storage. [2025-10-17T17:18:39.620438] [INFO ] [MAIN ] ARMK: Loaded 50753 existing records. [2025-10-17T17:18:39.804941] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:39.805423] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-17T17:18:39.805575] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-17T17:18:39.806044] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-17T17:18:39.806109] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-17T17:18:39.983679] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T17:18:39.980462] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-17T17:18:40.228898] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:40.671282] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:18:40.758036] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-17T17:18:41.558030] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-17T17:18:41.724607] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T17:18:42.358143] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-17T17:18:42.586040] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:18:43.016529] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T17:18:43.158016] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-17T17:18:43.671256] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:18:43.958060] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-17T17:18:44.407739] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:18:44.758034] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-17T17:18:45.543841] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:18:45.557972] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-17T17:18:46.017255] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:18:46.358029] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-17T17:18:46.662434] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:18:47.158036] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-17T17:18:47.896156] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T17:18:47.958063] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-17T17:18:48.758053] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-17T17:18:49.071036] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T17:18:49.249746] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T17:18:49.558023] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-17T17:18:50.363182] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-17T17:18:50.380472] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:18:50.817764] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T17:18:51.158062] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-17T17:18:51.549207] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T17:18:51.958040] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-17T17:18:52.758019] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-17T17:18:52.791933] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:18:53.558022] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-17T17:18:53.586043] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T17:18:54.312143] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:18:54.319546] [INFO ] [REMOTE ] ARI: Full fetch complete (62470 records). [2025-10-17T17:18:54.319763] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-17T17:18:54.365766] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-17T17:18:54.740021] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-17T17:18:54.740108] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-17T17:18:54.740998] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-17T17:18:54.741073] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-17T17:18:54.742777] [DEBUG] [LOCAL ] ARI: Trimmed 62470 records to 44332 (keeping 200 days of data) [2025-10-17T17:18:55.014509] [DEBUG] [LOCAL ] ARI: Primary data saved (44332 records). [2025-10-17T17:18:55.014694] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-17T17:18:55.014926] [INFO ] [MAIN ] Update Progress: 144/2368 symbols completed. ARI took 30.8s. Estimated remaining: 4h 51m 9s. Rate: 7.6 symbols/min [2025-10-17T17:18:55.159797] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-17T17:18:55.187148] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:55.187389] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-17T17:18:55.187594] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-17T17:18:55.187840] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-17T17:18:55.187992] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-17T17:18:55.188063] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-17T17:18:55.188100] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-17T17:18:55.331957] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T17:18:55.608007] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:55.958018] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-17T17:18:56.164106] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T17:18:56.758043] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-17T17:18:57.044453] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:18:57.050407] [INFO ] [REMOTE ] ARLO: Full fetch complete (63225 records). [2025-10-17T17:18:57.050513] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-17T17:18:57.431586] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-17T17:18:57.431721] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-17T17:18:57.432452] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-17T17:18:57.432636] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-17T17:18:57.434008] [DEBUG] [LOCAL ] ARLO: Trimmed 63225 records to 44394 (keeping 200 days of data) [2025-10-17T17:18:57.560718] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-17T17:18:57.619538] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T17:18:57.662143] [INFO ] [REMOTE ] ARES: Full fetch complete (71556 records). [2025-10-17T17:18:57.666120] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-17T17:18:58.024373] [DEBUG] [LOCAL ] ARLO: Primary data saved (44394 records). [2025-10-17T17:18:58.024711] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-17T17:18:58.024874] [INFO ] [MAIN ] Update Progress: 145/2368 symbols completed. ARLO took 30.5s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-17T17:18:58.226524] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-17T17:18:58.226711] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-17T17:18:58.227830] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-17T17:18:58.227955] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-17T17:18:58.237168] [DEBUG] [LOCAL ] ARES: Trimmed 71556 records to 50486 (keeping 200 days of data) [2025-10-17T17:18:58.380288] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:58.458990] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:18:58.492194] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-17T17:18:58.625956] [DEBUG] [LOCAL ] ARR: Loaded 52502 existing records from primary storage. [2025-10-17T17:18:58.628060] [INFO ] [MAIN ] ARR: Loaded 52502 existing records. [2025-10-17T17:18:58.817992] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:58.819575] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-17T17:18:58.820598] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-17T17:18:58.822667] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-17T17:18:58.822988] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-17T17:18:59.194753] [DEBUG] [LOCAL ] ARES: Primary data saved (50486 records). [2025-10-17T17:18:59.205472] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-17T17:18:59.207360] [INFO ] [MAIN ] Update Progress: 146/2368 symbols completed. ARES took 38.7s. Estimated remaining: 4h 47m 58s. Rate: 7.7 symbols/min [2025-10-17T17:18:59.315866] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:59.373831] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-17T17:18:59.464340] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:59.493318] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T17:18:59.542810] [DEBUG] [LOCAL ] ARW: Loaded 33338 existing records from primary storage. [2025-10-17T17:18:59.543118] [INFO ] [MAIN ] ARW: Loaded 33338 existing records. [2025-10-17T17:18:59.722741] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:59.722964] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-17T17:18:59.723013] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-17T17:18:59.723376] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-17T17:18:59.723439] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-17T17:18:59.959852] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-17T17:19:00.111435] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:00.335466] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T17:19:00.758088] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-17T17:19:01.558158] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-17T17:19:01.731101] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-17T17:19:02.077338] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T17:19:02.358090] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-17T17:19:02.637471] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T17:19:02.733454] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:19:03.158051] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-17T17:19:03.891856] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:19:03.957984] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-17T17:19:04.758116] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-17T17:19:04.814426] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T17:19:05.558047] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-17T17:19:05.618629] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T17:19:06.358060] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-17T17:19:06.968132] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-17T17:19:07.125805] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:19:07.158010] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-17T17:19:07.958186] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-17T17:19:08.154198] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:19:08.757188] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:19:08.767099] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-17T17:19:09.366451] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:19:09.558067] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-17T17:19:10.205306] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:19:10.358021] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-17T17:19:11.158064] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-17T17:19:11.448687] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T17:19:11.963344] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-17T17:19:11.990872] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:19:12.758012] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-17T17:19:13.182700] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:19:13.558045] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-17T17:19:13.746500] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:19:14.313608] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:19:14.358047] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-17T17:19:15.158067] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-17T17:19:15.276785] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T17:19:15.284639] [INFO ] [REMOTE ] ARMK: Full fetch complete (72989 records). [2025-10-17T17:19:15.284914] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-17T17:19:15.642063] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T17:19:15.730733] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-17T17:19:15.730840] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-17T17:19:15.731673] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-17T17:19:15.731745] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-17T17:19:15.733368] [DEBUG] [LOCAL ] ARMK: Trimmed 72989 records to 51136 (keeping 200 days of data) [2025-10-17T17:19:15.965675] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-17T17:19:16.040540] [DEBUG] [LOCAL ] ARMK: Primary data saved (51136 records). [2025-10-17T17:19:16.040734] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-17T17:19:16.041681] [INFO ] [MAIN ] Update Progress: 147/2368 symbols completed. ARMK took 36.7s. Estimated remaining: 4h 50m 7s. Rate: 7.7 symbols/min [2025-10-17T17:19:16.213215] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:16.214579] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-17T17:19:16.214634] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-17T17:19:16.214854] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-17T17:19:16.214910] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-17T17:19:16.214953] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-17T17:19:16.214987] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-17T17:19:16.596170] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:16.758023] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-17T17:19:17.162711] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:19:17.163027] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-17T17:19:17.163117] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:19:17.163163] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-17T17:19:17.163197] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:19:17.163235] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-17T17:19:17.163295] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-17T17:19:17.163333] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-17T17:19:17.163371] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-17T17:19:17.163417] [INFO ] [MAIN ] Update Progress: 148/2368 symbols completed. ARX took 1.1s. Estimated remaining: 4h 48m 19s. Rate: 7.7 symbols/min [2025-10-17T17:19:17.340228] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:17.370789] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-17T17:19:17.411506] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:19:17.466224] [DEBUG] [LOCAL ] AS: Loaded 53564 existing records from primary storage. [2025-10-17T17:19:17.466528] [INFO ] [MAIN ] AS: Loaded 53564 existing records. [2025-10-17T17:19:17.563323] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-17T17:19:17.644296] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:17.644510] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-17T17:19:17.644558] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-17T17:19:17.645288] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-17T17:19:17.645345] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-17T17:19:17.991830] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:18.358044] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-17T17:19:19.158087] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-17T17:19:19.584326] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T17:19:19.958036] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-17T17:19:20.148608] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:19:20.758058] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-17T17:19:20.915347] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:19:21.557989] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-17T17:19:21.882690] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:19:22.254009] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T17:19:22.358012] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-17T17:19:22.969513] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:19:23.158025] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-17T17:19:23.958039] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-17T17:19:24.230561] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:19:24.238071] [INFO ] [REMOTE ] AROC: Full fetch complete (71311 records). [2025-10-17T17:19:24.238434] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-17T17:19:24.652945] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-17T17:19:24.653153] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-17T17:19:24.654429] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-17T17:19:24.654537] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-17T17:19:24.679865] [DEBUG] [LOCAL ] AROC: Trimmed 71311 records to 49789 (keeping 200 days of data) [2025-10-17T17:19:24.680708] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T17:19:24.782279] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-17T17:19:25.009540] [DEBUG] [LOCAL ] AROC: Primary data saved (49789 records). [2025-10-17T17:19:25.009781] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-17T17:19:25.009886] [INFO ] [MAIN ] Update Progress: 149/2368 symbols completed. AROC took 30.0s. Estimated remaining: 4h 48m 12s. Rate: 7.7 symbols/min [2025-10-17T17:19:25.183780] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:25.204081] [DEBUG] [LOCAL ] ASA: Loaded 15405 existing records from primary storage. [2025-10-17T17:19:25.204420] [INFO ] [MAIN ] ASA: Loaded 15405 existing records. [2025-10-17T17:19:25.389486] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:25.389803] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-17T17:19:25.389856] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-17T17:19:25.390155] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-17T17:19:25.390248] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-17T17:19:25.559299] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-17T17:19:25.765266] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:25.799766] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:19:25.953891] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:19:26.358003] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-17T17:19:26.725951] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:19:27.158099] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-17T17:19:27.859220] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T17:19:27.958033] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-17T17:19:28.474842] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T17:19:28.541115] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T17:19:28.758038] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-17T17:19:29.558035] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-17T17:19:30.358053] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-17T17:19:30.727437] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:19:30.779256] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:19:30.839385] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T17:19:31.158101] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-17T17:19:31.958167] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-17T17:19:32.526298] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:19:32.758046] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-17T17:19:33.446042] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:19:33.453313] [INFO ] [REMOTE ] ARR: Full fetch complete (75468 records). [2025-10-17T17:19:33.453429] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-17T17:19:33.559072] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-17T17:19:33.855528] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-17T17:19:33.855618] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-17T17:19:33.856429] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-17T17:19:33.856495] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-17T17:19:33.858109] [DEBUG] [LOCAL ] ARR: Trimmed 75468 records to 52880 (keeping 200 days of data) [2025-10-17T17:19:34.090051] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:19:34.213902] [DEBUG] [LOCAL ] ARR: Primary data saved (52880 records). [2025-10-17T17:19:34.214061] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-17T17:19:34.214165] [INFO ] [MAIN ] Update Progress: 150/2368 symbols completed. ARR took 36.2s. Estimated remaining: 4h 48m 25s. Rate: 7.7 symbols/min [2025-10-17T17:19:34.362736] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-17T17:19:34.382869] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T17:19:34.454132] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:34.516972] [DEBUG] [LOCAL ] ASAN: Loaded 53123 existing records from primary storage. [2025-10-17T17:19:34.517399] [INFO ] [MAIN ] ASAN: Loaded 53123 existing records. [2025-10-17T17:19:34.780401] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:34.780782] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-17T17:19:34.780861] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-17T17:19:34.781398] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-17T17:19:34.781486] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-17T17:19:35.163232] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-17T17:19:35.295434] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:35.842593] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:19:35.957990] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-17T17:19:36.758067] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-17T17:19:36.886529] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:19:37.147215] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T17:19:37.152573] [INFO ] [REMOTE ] ARW: Full fetch complete (48485 records). [2025-10-17T17:19:37.152786] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-17T17:19:37.535515] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-17T17:19:37.535630] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-17T17:19:37.536317] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-17T17:19:37.536438] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-17T17:19:37.538277] [DEBUG] [LOCAL ] ARW: Trimmed 48485 records to 33602 (keeping 200 days of data) [2025-10-17T17:19:37.590456] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-17T17:19:37.754608] [DEBUG] [LOCAL ] ARW: Primary data saved (33602 records). [2025-10-17T17:19:37.754829] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-17T17:19:37.754936] [INFO ] [MAIN ] Update Progress: 151/2368 symbols completed. ARW took 38.5s. Estimated remaining: 4h 47m 14s. Rate: 7.7 symbols/min [2025-10-17T17:19:37.941700] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:38.000662] [DEBUG] [LOCAL ] ASB: Loaded 50019 existing records from primary storage. [2025-10-17T17:19:38.001106] [INFO ] [MAIN ] ASB: Loaded 50019 existing records. [2025-10-17T17:19:38.192442] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:38.192760] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-17T17:19:38.192820] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-17T17:19:38.193278] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-17T17:19:38.193319] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-17T17:19:38.359814] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-17T17:19:38.624091] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:38.697196] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T17:19:38.720974] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T17:19:39.158112] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-17T17:19:39.958115] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-17T17:19:40.176678] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:19:40.531112] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T17:19:40.758105] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-17T17:19:40.990834] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:19:41.558034] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-17T17:19:42.358070] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-17T17:19:42.592679] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:19:43.111558] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:19:43.158003] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-17T17:19:43.944632] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:19:43.957980] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-17T17:19:44.375317] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T17:19:44.758094] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-17T17:19:45.513137] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T17:19:45.557994] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-17T17:19:46.358056] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-17T17:19:46.485056] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:19:46.810528] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T17:19:47.158068] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-17T17:19:47.490027] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T17:19:47.958069] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-17T17:19:48.763747] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-17T17:19:48.769842] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:19:49.558008] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-17T17:19:49.793793] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T17:19:50.357990] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-17T17:19:50.417507] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T17:19:50.603552] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:19:51.158055] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-17T17:19:51.958022] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-17T17:19:52.139081] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:19:52.570438] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T17:19:52.595066] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T17:19:52.758023] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-17T17:19:53.558007] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-17T17:19:54.358012] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-17T17:19:54.495472] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:19:55.158006] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-17T17:19:55.432312] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T17:19:55.958000] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-17T17:19:55.988100] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:19:56.720830] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T17:19:56.757985] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-17T17:19:57.558111] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-17T17:19:57.923475] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:19:58.302773] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T17:19:58.358083] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-17T17:19:58.492358] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:19:59.158090] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-17T17:19:59.958099] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-17T17:20:00.358573] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-17T17:20:00.366713] [INFO ] [REMOTE ] AS: Full fetch complete (76881 records). [2025-10-17T17:20:00.366879] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-17T17:20:00.772534] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-17T17:20:00.768569] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-17T17:20:00.772796] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-17T17:20:00.775055] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-17T17:20:00.775145] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-17T17:20:00.776915] [DEBUG] [LOCAL ] AS: Trimmed 76881 records to 53954 (keeping 200 days of data) [2025-10-17T17:20:01.127204] [DEBUG] [LOCAL ] AS: Primary data saved (53954 records). [2025-10-17T17:20:01.127426] [INFO ] [MAIN ] AS: Full history saved. [2025-10-17T17:20:01.128675] [INFO ] [MAIN ] Update Progress: 152/2368 symbols completed. AS took 44.0s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-17T17:20:01.311226] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:01.360605] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T17:20:01.360895] [DEBUG] [LOCAL ] ASBA: Loaded 3483 existing records from primary storage. [2025-10-17T17:20:01.372801] [INFO ] [MAIN ] ASBA: Loaded 3483 existing records. [2025-10-17T17:20:01.551473] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:01.551712] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-17T17:20:01.551783] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-17T17:20:01.551961] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-17T17:20:01.552014] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-17T17:20:01.568145] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-17T17:20:01.981545] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:01.985208] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T17:20:02.358071] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-17T17:20:03.120877] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-17T17:20:03.124722] [INFO ] [REMOTE ] ASA: Full fetch complete (20407 records). [2025-10-17T17:20:03.124803] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-17T17:20:03.167531] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-17T17:20:03.495139] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-17T17:20:03.495226] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-17T17:20:03.495553] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-17T17:20:03.495595] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-17T17:20:03.496200] [DEBUG] [LOCAL ] ASA: Trimmed 20407 records to 15654 (keeping 200 days of data) [2025-10-17T17:20:03.587791] [DEBUG] [LOCAL ] ASA: Primary data saved (15654 records). [2025-10-17T17:20:03.587963] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-17T17:20:03.588058] [INFO ] [MAIN ] Update Progress: 153/2368 symbols completed. ASA took 38.6s. Estimated remaining: 4h 49m 28s. Rate: 7.7 symbols/min [2025-10-17T17:20:03.763955] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:03.802477] [DEBUG] [LOCAL ] ASC: Loaded 37642 existing records from primary storage. [2025-10-17T17:20:03.802818] [INFO ] [MAIN ] ASC: Loaded 37642 existing records. [2025-10-17T17:20:03.985845] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:03.986148] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-17T17:20:03.986260] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-17T17:20:03.986556] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-17T17:20:03.986610] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-17T17:20:04.088215] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:20:04.121988] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-17T17:20:04.219542] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-17T17:20:04.398982] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:04.429903] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T17:20:04.579316] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T17:20:04.758023] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-17T17:20:05.558033] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-17T17:20:05.942045] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-17T17:20:06.358038] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-17T17:20:06.467821] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:20:06.474678] [INFO ] [REMOTE ] ASB: Full fetch complete (71762 records). [2025-10-17T17:20:06.474849] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-17T17:20:06.475794] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:20:06.475888] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:20:06.475931] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:20:06.475986] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-17T17:20:06.476082] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-17T17:20:06.476133] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-10-17T17:20:06.476291] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-10-17T17:20:06.477511] [INFO ] [MAIN ] Update Progress: 154/2368 symbols completed. ASB took 28.7s. Estimated remaining: 4h 48m 9s. Rate: 7.7 symbols/min [2025-10-17T17:20:06.670811] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:06.697001] [DEBUG] [LOCAL ] ASG: Loaded 19723 existing records from primary storage. [2025-10-17T17:20:06.697286] [INFO ] [MAIN ] ASG: Loaded 19723 existing records. [2025-10-17T17:20:06.870062] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:06.870252] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-17T17:20:06.870324] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-17T17:20:06.870544] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-17T17:20:06.870614] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-17T17:20:07.163117] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-17T17:20:07.221000] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:07.823164] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T17:20:07.958005] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-17T17:20:08.593190] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T17:20:08.758038] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-17T17:20:09.558025] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-17T17:20:09.671809] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (3.31 seconds). [2025-10-17T17:20:09.990029] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T17:20:10.358070] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-17T17:20:10.674898] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T17:20:11.158039] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-17T17:20:11.550317] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T17:20:11.958072] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-17T17:20:12.168734] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T17:20:12.758103] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-17T17:20:13.558035] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-17T17:20:14.088319] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T17:20:14.204925] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T17:20:14.212589] [INFO ] [REMOTE ] ASAN: Full fetch complete (76642 records). [2025-10-17T17:20:14.212758] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-17T17:20:14.364383] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-17T17:20:14.645098] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-17T17:20:14.645188] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-17T17:20:14.646025] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-17T17:20:14.646102] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-17T17:20:14.647758] [DEBUG] [LOCAL ] ASAN: Trimmed 76642 records to 53507 (keeping 200 days of data) [2025-10-17T17:20:14.975380] [DEBUG] [LOCAL ] ASAN: Primary data saved (53507 records). [2025-10-17T17:20:14.975536] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-17T17:20:14.975621] [INFO ] [MAIN ] Update Progress: 155/2368 symbols completed. ASAN took 40.8s. Estimated remaining: 4h 48m 11s. Rate: 7.7 symbols/min [2025-10-17T17:20:15.157572] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:15.158164] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-17T17:20:15.200606] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T17:20:15.229536] [DEBUG] [LOCAL ] ASGI: Loaded 23140 existing records from primary storage. [2025-10-17T17:20:15.229892] [INFO ] [MAIN ] ASGI: Loaded 23140 existing records. [2025-10-17T17:20:15.431850] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:20:15.437725] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:15.442279] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-17T17:20:15.442899] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-17T17:20:15.443424] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-17T17:20:15.443489] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-17T17:20:15.811665] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:15.958041] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-17T17:20:16.027677] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:20:16.758057] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-17T17:20:17.271833] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T17:20:17.322347] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:20:17.558021] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-17T17:20:18.358051] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-17T17:20:18.773622] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T17:20:18.878855] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T17:20:19.158074] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-17T17:20:19.958074] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-17T17:20:20.213858] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T17:20:20.758013] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-17T17:20:21.398494] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T17:20:21.558027] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-17T17:20:21.699188] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T17:20:22.358014] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-17T17:20:22.673721] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T17:20:23.158031] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-17T17:20:23.415325] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T17:20:23.963121] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-17T17:20:23.970590] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:20:24.758033] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-17T17:20:25.050960] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T17:20:25.558022] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-17T17:20:25.797152] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T17:20:26.358098] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-17T17:20:26.751038] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T17:20:27.158110] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-17T17:20:27.320463] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:20:27.322017] [INFO ] [REMOTE ] ASBA: Full fetch complete (5312 records). [2025-10-17T17:20:27.322135] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-17T17:20:27.785733] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-17T17:20:27.785828] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-17T17:20:27.786001] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-17T17:20:27.786044] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-17T17:20:27.786526] [DEBUG] [LOCAL ] ASBA: Trimmed 5312 records to 3617 (keeping 200 days of data) [2025-10-17T17:20:27.809751] [DEBUG] [LOCAL ] ASBA: Primary data saved (3617 records). [2025-10-17T17:20:27.809908] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-17T17:20:27.810000] [INFO ] [MAIN ] Update Progress: 156/2368 symbols completed. ASBA took 26.7s. Estimated remaining: 4h 49m 14s. Rate: 7.6 symbols/min [2025-10-17T17:20:27.972709] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-17T17:20:28.011924] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:28.052231] [DEBUG] [LOCAL ] ASGN: Loaded 36906 existing records from primary storage. [2025-10-17T17:20:28.052559] [INFO ] [MAIN ] ASGN: Loaded 36906 existing records. [2025-10-17T17:20:28.248899] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:28.249165] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-17T17:20:28.249218] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-17T17:20:28.249420] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-17T17:20:28.249461] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-17T17:20:28.654178] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:28.722939] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T17:20:28.758002] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-17T17:20:29.065992] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T17:20:29.558049] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-17T17:20:30.298712] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:20:30.358018] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-17T17:20:30.657768] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T17:20:31.158060] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-17T17:20:31.824392] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:20:31.958005] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-17T17:20:32.300950] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:20:32.758082] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-17T17:20:33.523075] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:20:33.557989] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-17T17:20:33.941836] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:20:34.358092] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-17T17:20:35.158008] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-17T17:20:35.187417] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:20:35.778167] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:20:35.958030] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-17T17:20:36.612682] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T17:20:36.758035] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-17T17:20:37.490148] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:20:37.557999] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-17T17:20:38.210350] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T17:20:38.358015] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-17T17:20:38.967246] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:20:39.158055] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-17T17:20:39.472039] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T17:20:39.477238] [INFO ] [REMOTE ] ASC: Full fetch complete (56124 records). [2025-10-17T17:20:39.477347] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-17T17:20:39.848833] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-17T17:20:39.848918] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-17T17:20:39.849534] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-17T17:20:39.849574] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-17T17:20:39.850634] [DEBUG] [LOCAL ] ASC: Trimmed 56124 records to 37898 (keeping 200 days of data) [2025-10-17T17:20:39.959123] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-17T17:20:40.074591] [DEBUG] [LOCAL ] ASC: Primary data saved (37898 records). [2025-10-17T17:20:40.074778] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-17T17:20:40.074871] [INFO ] [MAIN ] Update Progress: 157/2368 symbols completed. ASC took 36.5s. Estimated remaining: 4h 50m 9s. Rate: 7.6 symbols/min [2025-10-17T17:20:40.287206] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T17:20:40.757985] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-17T17:20:41.075375] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T17:20:41.558009] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-17T17:20:41.901380] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:20:42.358061] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-17T17:20:42.593701] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T17:20:43.158097] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-17T17:20:43.759096] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T17:20:43.958008] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-17T17:20:44.427960] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:20:44.432548] [INFO ] [REMOTE ] ASGI: Full fetch complete (33316 records). [2025-10-17T17:20:44.432795] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-17T17:20:44.768548] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-17T17:20:44.822496] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-17T17:20:44.822622] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-17T17:20:44.823247] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-17T17:20:44.823310] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-17T17:20:44.824603] [DEBUG] [LOCAL ] ASGI: Trimmed 33316 records to 23311 (keeping 200 days of data) [2025-10-17T17:20:44.985486] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T17:20:44.995743] [INFO ] [REMOTE ] ASG: Full fetch complete (30919 records). [2025-10-17T17:20:44.996824] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-17T17:20:45.100546] [DEBUG] [LOCAL ] ASGI: Primary data saved (23311 records). [2025-10-17T17:20:45.104672] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-17T17:20:45.105168] [INFO ] [MAIN ] Update Progress: 158/2368 symbols completed. ASGI took 30.1s. Estimated remaining: 4h 49m 21s. Rate: 7.6 symbols/min [2025-10-17T17:20:45.397857] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-17T17:20:45.397936] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-17T17:20:45.398340] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-17T17:20:45.398403] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-17T17:20:45.399246] [DEBUG] [LOCAL ] ASG: Trimmed 30919 records to 19812 (keeping 200 days of data) [2025-10-17T17:20:45.508988] [DEBUG] [LOCAL ] ASG: Primary data saved (19812 records). [2025-10-17T17:20:45.509144] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-17T17:20:45.509229] [INFO ] [MAIN ] Update Progress: 159/2368 symbols completed. ASG took 39.0s. Estimated remaining: 4h 47m 29s. Rate: 7.7 symbols/min [2025-10-17T17:20:46.334426] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:20:46.341709] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-17T17:20:47.698205] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:20:47.705554] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-17T17:20:49.219741] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T17:20:49.228214] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-17T17:20:50.725938] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:20:50.734403] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-17T17:20:52.163622] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T17:20:52.172148] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-17T17:20:53.692951] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:20:53.698806] [INFO ] [REMOTE ] ASGN: Full fetch complete (53396 records). [2025-10-17T17:20:53.698938] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-17T17:20:54.078004] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-17T17:20:54.078122] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-17T17:20:54.078736] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-17T17:20:54.078800] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-17T17:20:54.080032] [DEBUG] [LOCAL ] ASGN: Trimmed 53396 records to 37201 (keeping 200 days of data) [2025-10-17T17:20:54.297326] [DEBUG] [LOCAL ] ASGN: Primary data saved (37201 records). [2025-10-17T17:20:54.297496] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-17T17:20:54.298530] [INFO ] [MAIN ] Update Progress: 160/2368 symbols completed. ASGN took 26.5s. Estimated remaining: 4h 47m 35s. Rate: 7.7 symbols/min [2025-10-17T17:20:54.942892] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.024722] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.093831] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.097968] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.110819] [DEBUG] [LOCAL ] ASR: Loaded 9418 existing records from primary storage. [2025-10-17T17:20:55.111127] [INFO ] [MAIN ] ASR: Loaded 9418 existing records. [2025-10-17T17:20:55.236481] [DEBUG] [LOCAL ] ASIX: Loaded 23274 existing records from primary storage. [2025-10-17T17:20:55.263738] [INFO ] [MAIN ] ASIX: Loaded 23274 existing records. [2025-10-17T17:20:55.295452] [DEBUG] [LOCAL ] ASH: Loaded 37839 existing records from primary storage. [2025-10-17T17:20:55.371916] [INFO ] [MAIN ] ASH: Loaded 37839 existing records. [2025-10-17T17:20:55.371241] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:55.432870] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-17T17:20:55.474346] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-17T17:20:55.562371] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-17T17:20:55.582605] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-17T17:20:55.656956] [DEBUG] [LOCAL ] ASPN: Loaded 50279 existing records from primary storage. [2025-10-17T17:20:55.793830] [INFO ] [MAIN ] ASPN: Loaded 50279 existing records. [2025-10-17T17:20:55.879599] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:55.908956] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-17T17:20:55.903719] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:55.920438] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-17T17:20:55.982424] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-17T17:20:55.994574] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-17T17:20:55.946505] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-17T17:20:56.037555] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-17T17:20:56.136108] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-17T17:20:56.242562] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-17T17:20:56.443923] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:56.497198] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-17T17:20:56.535754] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-17T17:20:56.627791] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:56.642091] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-17T17:20:56.647602] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-17T17:20:56.663907] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-17T17:20:57.149024] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:57.202987] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-17T17:20:57.442168] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:57.448169] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-17T17:20:57.525124] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:57.525480] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-17T17:20:57.565337] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:20:57.567387] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-17T17:20:58.215599] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T17:20:58.217739] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-17T17:20:58.555156] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T17:20:58.559003] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-17T17:20:58.833367] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:20:58.840188] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-17T17:20:58.861279] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T17:20:58.863441] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-17T17:20:59.196697] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:20:59.207070] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-17T17:20:59.381458] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:20:59.385543] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-17T17:20:59.611784] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T17:20:59.613882] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-17T17:21:00.335965] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T17:21:00.339935] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-17T17:21:00.355999] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T17:21:00.359214] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-17T17:21:00.383150] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T17:21:00.757996] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-17T17:21:01.160345] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T17:21:01.366562] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T17:21:01.542797] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T17:21:01.558052] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-17T17:21:02.310816] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:21:02.357993] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-17T17:21:03.158044] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-17T17:21:03.436272] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:21:03.961338] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-17T17:21:03.968303] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:21:04.008002] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T17:21:04.758065] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-17T17:21:05.553443] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T17:21:05.557971] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-17T17:21:05.748363] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T17:21:06.065554] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T17:21:06.358025] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-17T17:21:07.158034] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-17T17:21:07.662439] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:21:07.958022] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-17T17:21:08.336189] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T17:21:08.758049] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-17T17:21:09.451424] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:21:09.557990] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-17T17:21:09.786379] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:21:10.358051] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-17T17:21:11.158020] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-17T17:21:11.297109] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:21:11.433864] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T17:21:11.797521] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T17:21:11.958049] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-17T17:21:12.758083] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-17T17:21:12.793465] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:21:13.558020] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-17T17:21:13.654967] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T17:21:14.358073] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-17T17:21:15.163122] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-17T17:21:15.178810] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:21:15.285326] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T17:21:15.286862] [INFO ] [REMOTE ] ASR: Full fetch complete (12436 records). [2025-10-17T17:21:15.286931] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-17T17:21:15.658571] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-17T17:21:15.658667] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-17T17:21:15.658926] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-17T17:21:15.658966] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-17T17:21:15.659407] [DEBUG] [LOCAL ] ASR: Trimmed 12436 records to 9527 (keeping 200 days of data) [2025-10-17T17:21:15.716585] [DEBUG] [LOCAL ] ASR: Primary data saved (9527 records). [2025-10-17T17:21:15.716737] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-17T17:21:15.716826] [INFO ] [MAIN ] Update Progress: 161/2368 symbols completed. ASR took 21.4s. Estimated remaining: 4h 50m 34s. Rate: 7.6 symbols/min [2025-10-17T17:21:15.897184] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:15.955124] [DEBUG] [LOCAL ] ASX: Loaded 53264 existing records from primary storage. [2025-10-17T17:21:15.955444] [INFO ] [MAIN ] ASX: Loaded 53264 existing records. [2025-10-17T17:21:15.967059] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-17T17:21:16.149461] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:16.157073] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-17T17:21:16.168581] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-17T17:21:16.170028] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-17T17:21:16.169957] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T17:21:16.170228] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-17T17:21:16.534879] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:16.758030] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-17T17:21:17.558027] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-17T17:21:17.903275] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T17:21:18.357995] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-17T17:21:18.797741] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:21:18.843150] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T17:21:19.158046] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-17T17:21:19.538443] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:21:19.542782] [INFO ] [REMOTE ] ASIX: Full fetch complete (31047 records). [2025-10-17T17:21:19.542918] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-17T17:21:19.934914] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-17T17:21:19.934993] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-17T17:21:19.935405] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-17T17:21:19.935446] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-17T17:21:19.936242] [DEBUG] [LOCAL ] ASIX: Trimmed 31047 records to 23435 (keeping 200 days of data) [2025-10-17T17:21:19.992439] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-17T17:21:20.080530] [DEBUG] [LOCAL ] ASIX: Primary data saved (23435 records). [2025-10-17T17:21:20.080684] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-17T17:21:20.080782] [INFO ] [MAIN ] Update Progress: 162/2368 symbols completed. ASIX took 25.8s. Estimated remaining: 4h 49m 38s. Rate: 7.6 symbols/min [2025-10-17T17:21:20.249606] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:20.285743] [DEBUG] [LOCAL ] ATEN: Loaded 38592 existing records from primary storage. [2025-10-17T17:21:20.286037] [INFO ] [MAIN ] ATEN: Loaded 38592 existing records. [2025-10-17T17:21:20.461754] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:20.461992] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-17T17:21:20.462042] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-17T17:21:20.462361] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-17T17:21:20.462418] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-17T17:21:20.759896] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-17T17:21:20.841923] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:20.913448] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:21:21.558025] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-17T17:21:21.970634] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T17:21:22.358041] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-17T17:21:22.625269] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:21:22.804803] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:21:23.158057] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-17T17:21:23.958015] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-17T17:21:24.214663] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:21:24.295611] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:21:24.758058] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-17T17:21:25.251613] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T17:21:25.558063] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-17T17:21:26.358103] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-17T17:21:26.593415] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T17:21:26.603400] [INFO ] [REMOTE ] ASPN: Full fetch complete (72642 records). [2025-10-17T17:21:26.603594] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-17T17:21:27.049319] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-17T17:21:27.049449] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-17T17:21:27.050530] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-17T17:21:27.050690] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-17T17:21:27.052828] [DEBUG] [LOCAL ] ASPN: Trimmed 72642 records to 50648 (keeping 200 days of data) [2025-10-17T17:21:27.159155] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-17T17:21:27.175259] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:21:27.386698] [DEBUG] [LOCAL ] ASPN: Primary data saved (50648 records). [2025-10-17T17:21:27.386889] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-17T17:21:27.386990] [INFO ] [MAIN ] Update Progress: 163/2368 symbols completed. ASPN took 33.1s. Estimated remaining: 4h 49m 22s. Rate: 7.6 symbols/min [2025-10-17T17:21:27.560329] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:27.592060] [DEBUG] [LOCAL ] ATGE: Loaded 31229 existing records from primary storage. [2025-10-17T17:21:27.592332] [INFO ] [MAIN ] ATGE: Loaded 31229 existing records. [2025-10-17T17:21:27.779835] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:27.780868] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-17T17:21:27.780928] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-17T17:21:27.781615] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-17T17:21:27.781699] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-17T17:21:27.990835] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-17T17:21:27.981542] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T17:21:28.174791] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:28.758057] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-17T17:21:29.145393] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T17:21:29.295104] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T17:21:29.558034] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-17T17:21:30.134019] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T17:21:30.358048] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-17T17:21:30.831336] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T17:21:31.158042] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-17T17:21:31.958033] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-17T17:21:32.098439] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:21:32.758091] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-17T17:21:32.787559] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T17:21:32.793267] [INFO ] [REMOTE ] ASH: Full fetch complete (55686 records). [2025-10-17T17:21:32.793361] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-17T17:21:33.172181] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T17:21:33.212146] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-17T17:21:33.212213] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-17T17:21:33.212806] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-17T17:21:33.212875] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-17T17:21:33.213924] [DEBUG] [LOCAL ] ASH: Trimmed 55686 records to 38148 (keeping 200 days of data) [2025-10-17T17:21:33.443010] [DEBUG] [LOCAL ] ASH: Primary data saved (38148 records). [2025-10-17T17:21:33.443142] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-17T17:21:33.443224] [INFO ] [MAIN ] Update Progress: 164/2368 symbols completed. ASH took 39.1s. Estimated remaining: 4h 48m 50s. Rate: 7.6 symbols/min [2025-10-17T17:21:33.563138] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-17T17:21:33.615723] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:33.647095] [DEBUG] [LOCAL ] ATHM: Loaded 31712 existing records from primary storage. [2025-10-17T17:21:33.647392] [INFO ] [MAIN ] ATHM: Loaded 31712 existing records. [2025-10-17T17:21:33.821341] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:33.821550] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-17T17:21:33.821597] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-17T17:21:33.821846] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-17T17:21:33.821902] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-17T17:21:34.181233] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:34.205876] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T17:21:34.358020] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-17T17:21:35.157999] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-17T17:21:35.730763] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T17:21:35.958110] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-17T17:21:36.447456] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T17:21:36.595032] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:21:36.758045] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-17T17:21:37.526527] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:21:37.557986] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-17T17:21:38.242899] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T17:21:38.358045] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-17T17:21:38.770599] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:21:39.158027] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-17T17:21:39.961465] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-17T17:21:39.967063] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T17:21:40.673866] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T17:21:40.757993] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-17T17:21:41.481973] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T17:21:41.558032] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-17T17:21:41.815924] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T17:21:42.358020] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-17T17:21:42.841754] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:21:43.158027] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-17T17:21:43.958063] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-17T17:21:44.167305] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T17:21:44.683404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T17:21:44.758030] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-17T17:21:45.051329] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T17:21:45.558067] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-17T17:21:45.896356] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T17:21:45.901148] [INFO ] [REMOTE ] ATEN: Full fetch complete (56884 records). [2025-10-17T17:21:45.901254] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-17T17:21:46.279780] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-17T17:21:46.279874] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-17T17:21:46.280518] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-17T17:21:46.280561] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-17T17:21:46.282143] [DEBUG] [LOCAL ] ATEN: Trimmed 56884 records to 38815 (keeping 200 days of data) [2025-10-17T17:21:46.368718] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-17T17:21:46.518318] [DEBUG] [LOCAL ] ATEN: Primary data saved (38815 records). [2025-10-17T17:21:46.518535] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-17T17:21:46.518724] [INFO ] [MAIN ] Update Progress: 165/2368 symbols completed. ATEN took 26.4s. Estimated remaining: 4h 49m 52s. Rate: 7.6 symbols/min [2025-10-17T17:21:46.689487] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:46.698495] [DEBUG] [LOCAL ] ATHS: Loaded 6668 existing records from primary storage. [2025-10-17T17:21:46.698763] [INFO ] [MAIN ] ATHS: Loaded 6668 existing records. [2025-10-17T17:21:46.878824] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:46.879221] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-17T17:21:46.879389] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-17T17:21:46.879679] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-17T17:21:46.879818] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-17T17:21:47.051968] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T17:21:47.166117] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-17T17:21:47.302164] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:47.958084] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-17T17:21:48.208190] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:21:48.667116] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:21:48.758026] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-17T17:21:49.278432] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T17:21:49.558031] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-17T17:21:49.978342] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:21:50.358028] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-17T17:21:51.158075] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-17T17:21:51.426492] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T17:21:51.747796] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T17:21:51.958037] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-17T17:21:52.188815] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:21:52.758033] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-17T17:21:53.092181] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T17:21:53.558086] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-17T17:21:54.358013] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-17T17:21:54.466471] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T17:21:54.820782] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T17:21:55.158014] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-17T17:21:55.229016] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T17:21:55.958042] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-17T17:21:56.307171] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T17:21:56.758053] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-17T17:21:57.558016] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-17T17:21:57.824715] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:21:57.832324] [INFO ] [REMOTE ] ASX: Full fetch complete (76784 records). [2025-10-17T17:21:57.832445] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-17T17:21:58.292836] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-17T17:21:58.293086] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-17T17:21:58.295209] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T17:21:58.294499] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-17T17:21:58.301908] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-17T17:21:58.303555] [DEBUG] [LOCAL ] ASX: Trimmed 76784 records to 53653 (keeping 200 days of data) [2025-10-17T17:21:58.358388] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-17T17:21:58.650332] [DEBUG] [LOCAL ] ASX: Primary data saved (53653 records). [2025-10-17T17:21:58.650486] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-17T17:21:58.651755] [INFO ] [MAIN ] Update Progress: 166/2368 symbols completed. ASX took 42.9s. Estimated remaining: 4h 50m 40s. Rate: 7.6 symbols/min [2025-10-17T17:21:58.837720] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:58.848389] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T17:21:58.910616] [DEBUG] [LOCAL ] ATI: Loaded 51723 existing records from primary storage. [2025-10-17T17:21:58.910999] [INFO ] [MAIN ] ATI: Loaded 51723 existing records. [2025-10-17T17:21:59.129677] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:59.129911] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-17T17:21:59.129980] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-17T17:21:59.130226] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-17T17:21:59.130291] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-17T17:21:59.163273] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-17T17:21:59.485486] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:59.499257] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:21:59.958009] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-17T17:21:59.980771] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:22:00.758017] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-17T17:22:01.558097] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-17T17:22:02.082341] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-17T17:22:02.264969] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:22:02.268906] [INFO ] [REMOTE ] ATHM: Full fetch complete (49698 records). [2025-10-17T17:22:02.269002] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-17T17:22:02.269610] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:22:02.269734] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:22:02.269788] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:22:02.269845] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-17T17:22:02.269951] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-17T17:22:02.270017] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-17T17:22:02.270180] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-17T17:22:02.270289] [INFO ] [MAIN ] Update Progress: 167/2368 symbols completed. ATHM took 28.8s. Estimated remaining: 4h 49m 35s. Rate: 7.6 symbols/min [2025-10-17T17:22:02.367297] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-17T17:22:02.441834] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:02.487693] [DEBUG] [LOCAL ] ATKR: Loaded 35500 existing records from primary storage. [2025-10-17T17:22:02.488115] [INFO ] [MAIN ] ATKR: Loaded 35500 existing records. [2025-10-17T17:22:02.701258] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:02.701621] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-17T17:22:02.701762] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-17T17:22:02.707171] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-17T17:22:02.712006] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-17T17:22:02.756418] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:22:02.799685] [INFO ] [REMOTE ] ATGE: Full fetch complete (45995 records). [2025-10-17T17:22:02.804975] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-17T17:22:03.146293] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:22:03.176391] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-17T17:22:03.426881] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:03.530482] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-17T17:22:03.530603] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-17T17:22:03.531484] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-17T17:22:03.531564] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-17T17:22:03.533020] [DEBUG] [LOCAL ] ATGE: Trimmed 45995 records to 31377 (keeping 200 days of data) [2025-10-17T17:22:03.749277] [DEBUG] [LOCAL ] ATGE: Primary data saved (31377 records). [2025-10-17T17:22:03.749430] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-17T17:22:03.749530] [INFO ] [MAIN ] Update Progress: 168/2368 symbols completed. ATGE took 36.4s. Estimated remaining: 4h 48m 3s. Rate: 7.6 symbols/min [2025-10-17T17:22:03.935439] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:03.961189] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-17T17:22:03.980048] [DEBUG] [LOCAL ] ATMU: Loaded 39185 existing records from primary storage. [2025-10-17T17:22:03.980410] [INFO ] [MAIN ] ATMU: Loaded 39185 existing records. [2025-10-17T17:22:04.158970] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:04.159266] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-17T17:22:04.159323] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-17T17:22:04.159678] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-17T17:22:04.159740] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-17T17:22:04.523248] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:04.573321] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:22:04.758030] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-17T17:22:05.557994] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-17T17:22:05.664021] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:22:05.839541] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:22:06.358048] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-17T17:22:06.937733] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:22:07.035955] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T17:22:07.157991] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-17T17:22:07.850037] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T17:22:07.958262] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-17T17:22:08.758095] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-17T17:22:09.530015] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:22:09.557982] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-17T17:22:09.604084] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:22:10.358299] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-17T17:22:11.097271] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:22:11.158051] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-17T17:22:11.953327] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T17:22:11.961575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-17T17:22:12.655536] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T17:22:12.758072] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-17T17:22:13.317741] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T17:22:13.558047] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-17T17:22:14.160718] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:22:14.358057] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-17T17:22:15.090243] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:22:15.157989] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-17T17:22:15.937734] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:22:15.957992] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-17T17:22:16.671813] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T17:22:16.758073] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-17T17:22:17.558014] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-17T17:22:17.789389] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T17:22:18.358014] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-17T17:22:18.480579] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T17:22:18.860303] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T17:22:19.158036] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-17T17:22:19.416908] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:22:19.958030] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-17T17:22:20.301551] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T17:22:20.758009] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-17T17:22:20.771877] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T17:22:21.558048] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-17T17:22:22.242905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T17:22:22.358049] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-17T17:22:23.112821] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:22:23.157987] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-17T17:22:23.777159] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:22:23.958037] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-17T17:22:24.561969] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T17:22:24.758027] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-17T17:22:25.397355] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T17:22:25.519353] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T17:22:25.524706] [INFO ] [REMOTE ] ATKR: Full fetch complete (53369 records). [2025-10-17T17:22:25.524806] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-17T17:22:25.563973] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-17T17:22:25.907324] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-17T17:22:25.907401] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-17T17:22:25.908028] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-17T17:22:25.908091] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-17T17:22:25.909162] [DEBUG] [LOCAL ] ATKR: Trimmed 53369 records to 35684 (keeping 200 days of data) [2025-10-17T17:22:26.156380] [DEBUG] [LOCAL ] ATKR: Primary data saved (35684 records). [2025-10-17T17:22:26.156525] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-17T17:22:26.156623] [INFO ] [MAIN ] Update Progress: 169/2368 symbols completed. ATKR took 23.9s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-10-17T17:22:26.326546] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:26.367800] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-17T17:22:26.370673] [DEBUG] [LOCAL ] ATO: Loaded 42086 existing records from primary storage. [2025-10-17T17:22:26.370981] [INFO ] [MAIN ] ATO: Loaded 42086 existing records. [2025-10-17T17:22:26.553799] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:26.554034] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-17T17:22:26.554083] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-17T17:22:26.554406] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-17T17:22:26.554464] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-17T17:22:26.920790] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:27.158053] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-17T17:22:27.438344] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T17:22:27.819115] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T17:22:27.905548] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:22:27.958090] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-17T17:22:28.554739] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T17:22:28.556375] [INFO ] [REMOTE ] ATHS: Full fetch complete (9600 records). [2025-10-17T17:22:28.556475] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-17T17:22:28.765981] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-17T17:22:28.994172] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-17T17:22:28.994258] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-17T17:22:28.994514] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-17T17:22:28.994577] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-17T17:22:28.995050] [DEBUG] [LOCAL ] ATHS: Trimmed 9600 records to 6713 (keeping 200 days of data) [2025-10-17T17:22:29.037815] [DEBUG] [LOCAL ] ATHS: Primary data saved (6713 records). [2025-10-17T17:22:29.037951] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-17T17:22:29.038034] [INFO ] [MAIN ] Update Progress: 170/2368 symbols completed. ATHS took 42.5s. Estimated remaining: 4h 49m 52s. Rate: 7.6 symbols/min [2025-10-17T17:22:29.206178] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:29.238850] [DEBUG] [LOCAL ] ATR: Loaded 30763 existing records from primary storage. [2025-10-17T17:22:29.239127] [INFO ] [MAIN ] ATR: Loaded 30763 existing records. [2025-10-17T17:22:29.435538] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:29.435853] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-17T17:22:29.435917] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-17T17:22:29.436214] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-17T17:22:29.436274] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-17T17:22:29.563134] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-17T17:22:29.818535] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:29.896035] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T17:22:30.358044] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-17T17:22:31.158061] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-17T17:22:31.465637] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T17:22:31.958032] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-17T17:22:32.085407] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T17:22:32.749142] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:22:32.757978] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-17T17:22:32.788239] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T17:22:33.558042] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-17T17:22:33.922201] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:22:34.358075] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-17T17:22:35.044368] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:22:35.158037] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-17T17:22:35.958047] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-17T17:22:36.342671] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:22:36.398612] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T17:22:36.758053] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-17T17:22:37.398486] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:22:37.558060] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-17T17:22:38.027942] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:22:38.358088] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-17T17:22:39.160828] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-17T17:22:39.164529] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:22:39.659011] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T17:22:39.958024] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-17T17:22:40.758009] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-17T17:22:40.828789] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:22:40.835804] [INFO ] [REMOTE ] ATI: Full fetch complete (74040 records). [2025-10-17T17:22:40.835924] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-17T17:22:41.232535] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-17T17:22:41.232663] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-17T17:22:41.233458] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-17T17:22:41.233536] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-17T17:22:41.235385] [DEBUG] [LOCAL ] ATI: Trimmed 74040 records to 52088 (keeping 200 days of data) [2025-10-17T17:22:41.361074] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:22:41.563717] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-17T17:22:41.568849] [DEBUG] [LOCAL ] ATI: Primary data saved (52088 records). [2025-10-17T17:22:41.569059] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-17T17:22:41.569159] [INFO ] [MAIN ] Update Progress: 171/2368 symbols completed. ATI took 42.9s. Estimated remaining: 4h 50m 43s. Rate: 7.6 symbols/min [2025-10-17T17:22:41.740366] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:41.758708] [DEBUG] [LOCAL ] ATS: Loaded 17690 existing records from primary storage. [2025-10-17T17:22:41.758962] [INFO ] [MAIN ] ATS: Loaded 17690 existing records. [2025-10-17T17:22:41.952136] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:41.952481] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-17T17:22:41.952542] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-17T17:22:41.952806] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-17T17:22:41.952865] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-17T17:22:42.327084] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:42.341564] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T17:22:42.346901] [INFO ] [REMOTE ] ATMU: Full fetch complete (56889 records). [2025-10-17T17:22:42.347005] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-17T17:22:42.367701] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-17T17:22:42.730868] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-17T17:22:42.730967] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-17T17:22:42.731591] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-17T17:22:42.731638] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-17T17:22:42.732996] [DEBUG] [LOCAL ] ATMU: Trimmed 56889 records to 39475 (keeping 200 days of data) [2025-10-17T17:22:42.962058] [DEBUG] [LOCAL ] ATMU: Primary data saved (39475 records). [2025-10-17T17:22:42.962183] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-17T17:22:42.962262] [INFO ] [MAIN ] Update Progress: 172/2368 symbols completed. ATMU took 39.2s. Estimated remaining: 4h 49m 11s. Rate: 7.6 symbols/min [2025-10-17T17:22:43.078270] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:22:43.152949] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:43.157989] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-17T17:22:43.196417] [DEBUG] [LOCAL ] ATUS: Loaded 50229 existing records from primary storage. [2025-10-17T17:22:43.196752] [INFO ] [MAIN ] ATUS: Loaded 50229 existing records. [2025-10-17T17:22:43.374412] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:43.374747] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-17T17:22:43.375004] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-17T17:22:43.375335] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-17T17:22:43.375405] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-17T17:22:43.733806] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:43.958022] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-17T17:22:44.202438] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T17:22:44.332347] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:22:44.758013] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-17T17:22:45.558047] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-17T17:22:45.683774] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T17:22:46.358091] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-17T17:22:46.424290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:22:46.569370] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T17:22:47.158052] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-17T17:22:47.648203] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:22:47.958048] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-17T17:22:48.661863] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T17:22:48.758022] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-17T17:22:49.024264] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:22:49.558032] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-17T17:22:50.296096] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:22:50.357983] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-17T17:22:50.800533] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:22:51.158055] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-17T17:22:51.852843] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T17:22:51.958009] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-17T17:22:52.758023] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-17T17:22:53.558040] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-17T17:23:05.717973] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (13.76 seconds). [2025-10-17T17:23:05.740756] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (12.98 seconds). [2025-10-17T17:23:05.745894] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-17T17:23:05.741343] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-17T17:23:05.922849] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (12.36 seconds). [2025-10-17T17:23:05.932617] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-17T17:23:06.221570] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (15.06 seconds). [2025-10-17T17:23:06.228967] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-17T17:23:07.290400] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:23:07.295000] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-17T17:23:07.364875] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:23:07.371891] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-17T17:23:07.515421] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T17:23:07.525171] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-17T17:23:07.782892] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T17:23:07.788868] [INFO ] [REMOTE ] ATO: Full fetch complete (60691 records). [2025-10-17T17:23:07.788973] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-17T17:23:08.180426] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-17T17:23:08.180535] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-17T17:23:08.181287] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-17T17:23:08.181355] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-17T17:23:08.183042] [DEBUG] [LOCAL ] ATO: Trimmed 60691 records to 42359 (keeping 200 days of data) [2025-10-17T17:23:08.460200] [DEBUG] [LOCAL ] ATO: Primary data saved (42359 records). [2025-10-17T17:23:08.460356] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-17T17:23:08.460499] [INFO ] [MAIN ] Update Progress: 173/2368 symbols completed. ATO took 42.3s. Estimated remaining: 4h 52m 47s. Rate: 7.5 symbols/min [2025-10-17T17:23:08.586588] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T17:23:08.632933] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-17T17:23:08.673463] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:08.681677] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-17T17:23:08.683855] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:23:08.682277] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-17T17:23:08.689374] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-17T17:23:08.689497] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-17T17:23:08.689674] [INFO ] [REMOTE ] ATR: Full fetch complete (43987 records). [2025-10-17T17:23:08.689576] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-17T17:23:08.689962] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-17T17:23:08.690233] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-17T17:23:09.395757] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:09.415706] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-17T17:23:09.507958] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T17:23:09.551145] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-17T17:23:09.551370] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-17T17:23:09.551967] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-17T17:23:09.552469] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-17T17:23:09.552383] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-17T17:23:09.554515] [DEBUG] [LOCAL ] ATR: Trimmed 43987 records to 30974 (keeping 200 days of data) [2025-10-17T17:23:09.749327] [DEBUG] [LOCAL ] ATR: Primary data saved (30974 records). [2025-10-17T17:23:09.749678] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-17T17:23:09.749839] [INFO ] [MAIN ] Update Progress: 174/2368 symbols completed. ATR took 40.7s. Estimated remaining: 4h 51m 14s. Rate: 7.5 symbols/min [2025-10-17T17:23:09.866847] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T17:23:09.883328] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-17T17:23:09.980725] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:10.024481] [DEBUG] [LOCAL ] AUB: Loaded 46391 existing records from primary storage. [2025-10-17T17:23:10.024833] [INFO ] [MAIN ] AUB: Loaded 46391 existing records. [2025-10-17T17:23:10.200620] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:10.200880] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-17T17:23:10.200927] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-17T17:23:10.201228] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-17T17:23:10.201267] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-17T17:23:10.551545] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:10.551936] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-17T17:23:10.916866] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:23:10.921499] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-17T17:23:11.296845] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:23:11.308510] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-17T17:23:11.459603] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:23:11.470727] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-17T17:23:11.701788] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T17:23:11.705828] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-17T17:23:11.796038] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T17:23:11.804779] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-17T17:23:12.461081] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:23:12.466472] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-17T17:23:12.964463] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T17:23:12.975692] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-17T17:23:13.236302] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T17:23:13.247097] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-17T17:23:13.414918] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:23:13.433938] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-17T17:23:13.435091] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T17:23:13.440394] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-17T17:23:14.241303] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T17:23:14.252592] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-17T17:23:14.375329] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:23:14.379359] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-17T17:23:14.763300] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T17:23:14.773577] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-17T17:23:14.820034] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:23:14.828134] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-17T17:23:15.019496] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T17:23:15.021741] [INFO ] [REMOTE ] ATS: Full fetch complete (25464 records). [2025-10-17T17:23:15.021812] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-17T17:23:15.022285] [FATAL] [VALIDATOR ] ATS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:23:15.022363] [FATAL] [MAIN ] ATS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:23:15.022408] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:23:15.022466] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-17T17:23:15.022556] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-17T17:23:15.022608] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-10-17T17:23:15.022825] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-10-17T17:23:15.022914] [INFO ] [MAIN ] Update Progress: 175/2368 symbols completed. ATS took 33.5s. Estimated remaining: 4h 50m 32s. Rate: 7.5 symbols/min [2025-10-17T17:23:15.187071] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:15.193007] [DEBUG] [LOCAL ] AUNA: Loaded 5158 existing records from primary storage. [2025-10-17T17:23:15.193169] [INFO ] [MAIN ] AUNA: Loaded 5158 existing records. [2025-10-17T17:23:15.367841] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:15.368025] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-17T17:23:15.368070] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-17T17:23:15.368196] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-17T17:23:15.368233] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-17T17:23:15.639043] [DEBUG] [REMOTE ] ATUS: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-17T17:23:15.641686] [WARN ] [REMOTE ] ATUS: No data returned for month 2025-08 [2025-10-17T17:23:15.641791] [FATAL] [REMOTE ] ATUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:23:15.647628] [FATAL] [MAIN ] ATUS: Failed to fetch primary data. [2025-10-17T17:23:15.657943] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:23:15.668249] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-17T17:23:15.694079] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-10-17T17:23:15.701109] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-10-17T17:23:15.722848] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:15.723195] [DEBUG] [LOCAL ] ATUS: Deleted derivative data file. [2025-10-17T17:23:15.723155] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-17T17:23:15.724058] [INFO ] [MAIN ] Update Progress: 176/2368 symbols completed. ATUS took 32.8s. Estimated remaining: 4h 48m 54s. Rate: 7.6 symbols/min [2025-10-17T17:23:15.903071] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:15.941859] [DEBUG] [LOCAL ] AVA: Loaded 39001 existing records from primary storage. [2025-10-17T17:23:15.942166] [INFO ] [MAIN ] AVA: Loaded 39001 existing records. [2025-10-17T17:23:16.132139] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:16.132367] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-17T17:23:16.132421] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-17T17:23:16.132838] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-17T17:23:16.132896] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-17T17:23:16.492972] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:16.493366] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-17T17:23:16.708738] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T17:23:16.740310] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T17:23:16.757970] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-17T17:23:16.926846] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T17:23:17.569721] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-17T17:23:17.574731] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:23:18.310421] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T17:23:18.358036] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-17T17:23:18.560438] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:23:19.033946] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T17:23:19.157996] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-17T17:23:19.958014] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-17T17:23:20.076241] [DEBUG] [REMOTE ] AUB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T17:23:20.076540] [WARN ] [REMOTE ] AUB: No data returned for month 2025-05 [2025-10-17T17:23:20.076696] [FATAL] [REMOTE ] AUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:23:20.076816] [FATAL] [MAIN ] AUB: Failed to fetch primary data. [2025-10-17T17:23:20.076902] [WARN ] [MAIN ] AUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:23:20.076998] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-17T17:23:20.077077] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-10-17T17:23:20.077118] [INFO ] [LOCAL ] AUB: Starting deletion of derivative data. [2025-10-17T17:23:20.077269] [DEBUG] [LOCAL ] AUB: Deleted derivative data file. [2025-10-17T17:23:20.077351] [INFO ] [MAIN ] Update Progress: 177/2368 symbols completed. AUB took 10.3s. Estimated remaining: 4h 48m 2s. Rate: 7.6 symbols/min [2025-10-17T17:23:20.162546] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:23:20.264998] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:20.276865] [DEBUG] [LOCAL ] AVAL: Loaded 8650 existing records from primary storage. [2025-10-17T17:23:20.277177] [INFO ] [MAIN ] AVAL: Loaded 8650 existing records. [2025-10-17T17:23:20.466010] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:20.466431] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-17T17:23:20.466492] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-17T17:23:20.466821] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-17T17:23:20.466887] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-17T17:23:20.763454] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-17T17:23:20.876768] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:21.558036] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-17T17:23:22.137430] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:23:22.358061] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-17T17:23:22.730389] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-17T17:23:22.916327] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T17:23:23.158051] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-17T17:23:23.958047] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-17T17:23:24.546809] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T17:23:24.758027] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-17T17:23:25.558040] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-17T17:23:25.989907] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:23:26.245609] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:23:26.289840] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-17T17:23:26.357992] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-17T17:23:27.158038] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-17T17:23:27.653548] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T17:23:27.834538] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-17T17:23:27.958060] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-17T17:23:28.758112] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-17T17:23:29.558046] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-17T17:23:29.561138] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T17:23:30.191975] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:23:30.357999] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-17T17:23:30.835773] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T17:23:31.158035] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-17T17:23:31.951725] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T17:23:31.958003] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-17T17:23:32.038613] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:23:32.698315] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T17:23:32.700211] [INFO ] [REMOTE ] AUNA: Full fetch complete (7759 records). [2025-10-17T17:23:32.700300] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-17T17:23:32.763260] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-17T17:23:33.066671] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-17T17:23:33.066764] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-17T17:23:33.066977] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-17T17:23:33.067016] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-17T17:23:33.067394] [DEBUG] [LOCAL ] AUNA: Trimmed 7759 records to 5186 (keeping 200 days of data) [2025-10-17T17:23:33.096481] [DEBUG] [LOCAL ] AUNA: Primary data saved (5186 records). [2025-10-17T17:23:33.096580] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-17T17:23:33.096690] [INFO ] [MAIN ] Update Progress: 178/2368 symbols completed. AUNA took 18.1s. Estimated remaining: 4h 48m 58s. Rate: 7.6 symbols/min [2025-10-17T17:23:33.262625] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:33.307104] [DEBUG] [LOCAL ] AVB: Loaded 42587 existing records from primary storage. [2025-10-17T17:23:33.307413] [INFO ] [MAIN ] AVB: Loaded 42587 existing records. [2025-10-17T17:23:33.481372] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:33.481607] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-17T17:23:33.481682] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-17T17:23:33.481940] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-17T17:23:33.481995] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-17T17:23:33.563124] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-17T17:23:33.847405] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:34.358025] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-17T17:23:34.994942] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T17:23:35.030523] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:23:35.044877] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T17:23:35.157997] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-17T17:23:35.779711] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T17:23:35.958098] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-17T17:23:36.758040] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-17T17:23:37.558058] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-17T17:23:38.018494] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T17:23:38.226447] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T17:23:38.260009] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:23:38.358049] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-17T17:23:39.158040] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-17T17:23:39.958035] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-17T17:23:40.005245] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:23:40.755358] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T17:23:40.763273] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-17T17:23:40.917784] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T17:23:41.558032] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-17T17:23:41.950591] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:23:42.358073] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-17T17:23:43.158071] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-17T17:23:43.248898] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T17:23:43.549315] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T17:23:43.958043] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-17T17:23:44.577972] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:23:44.758039] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-17T17:23:45.558030] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-17T17:23:46.349375] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T17:23:46.354486] [INFO ] [REMOTE ] AVA: Full fetch complete (55531 records). [2025-10-17T17:23:46.354636] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-17T17:23:46.386553] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-17T17:23:46.747406] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-17T17:23:46.747807] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-17T17:23:46.749379] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-17T17:23:46.749588] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-17T17:23:46.772963] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-17T17:23:46.773249] [DEBUG] [LOCAL ] AVA: Trimmed 55531 records to 39279 (keeping 200 days of data) [2025-10-17T17:23:46.781418] [INFO ] [REMOTE ] AU: Full fetch complete (76566 records). [2025-10-17T17:23:46.781795] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-17T17:23:46.988680] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:23:47.109373] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T17:23:47.160894] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-17T17:23:47.473607] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-17T17:23:47.474065] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-17T17:23:47.481709] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-17T17:23:47.481795] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-17T17:23:47.507437] [DEBUG] [LOCAL ] AU: Trimmed 76566 records to 53857 (keeping 200 days of data) [2025-10-17T17:23:47.510962] [DEBUG] [LOCAL ] AVA: Primary data saved (39279 records). [2025-10-17T17:23:47.511392] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-17T17:23:47.511496] [INFO ] [MAIN ] Update Progress: 179/2368 symbols completed. AVA took 31.8s. Estimated remaining: 4h 50m 9s. Rate: 7.5 symbols/min [2025-10-17T17:23:47.780970] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:47.782294] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-17T17:23:47.782712] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-17T17:23:47.784025] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-17T17:23:47.785016] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-17T17:23:47.785874] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-17T17:23:47.787439] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-17T17:23:47.963197] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-17T17:23:48.316907] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:48.440239] [DEBUG] [LOCAL ] AU: Primary data saved (53857 records). [2025-10-17T17:23:48.440400] [INFO ] [MAIN ] AU: Full history saved. [2025-10-17T17:23:48.440478] [INFO ] [MAIN ] Update Progress: 180/2368 symbols completed. AU took 40.0s. Estimated remaining: 4h 48m 36s. Rate: 7.6 symbols/min [2025-10-17T17:23:48.614436] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:48.614834] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-10-17T17:23:48.614888] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-10-17T17:23:48.614999] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-17T17:23:48.615041] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-17T17:23:48.615088] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-17T17:23:48.615126] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-17T17:23:48.762339] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-17T17:23:48.827448] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T17:23:48.984861] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:49.006690] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T17:23:49.048076] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:23:49.048319] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-17T17:23:49.048408] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:23:49.048484] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-17T17:23:49.048549] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:23:49.048620] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-17T17:23:49.048719] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-17T17:23:49.048763] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-17T17:23:49.048804] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-17T17:23:49.048849] [INFO ] [MAIN ] Update Progress: 181/2368 symbols completed. AVBC took 1.5s. Estimated remaining: 4h 46m 60s. Rate: 7.6 symbols/min [2025-10-17T17:23:49.217428] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:49.245149] [DEBUG] [LOCAL ] AVK: Loaded 18751 existing records from primary storage. [2025-10-17T17:23:49.245455] [INFO ] [MAIN ] AVK: Loaded 18751 existing records. [2025-10-17T17:23:49.438703] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:49.438910] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-17T17:23:49.438962] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-17T17:23:49.439279] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-17T17:23:49.439337] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-17T17:23:49.563151] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-17T17:23:49.804388] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:50.358032] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-17T17:23:51.020922] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T17:23:51.157996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-17T17:23:51.734673] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T17:23:51.957999] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-17T17:23:51.979172] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:23:52.758013] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-17T17:23:53.098786] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T17:23:53.561831] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-17T17:23:53.564742] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T17:23:54.358105] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-17T17:23:54.537563] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T17:23:54.776003] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-17T17:23:55.158102] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-17T17:23:55.958073] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-17T17:23:56.284290] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:23:56.463524] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-17T17:23:56.758063] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-17T17:23:57.558055] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-17T17:23:57.871086] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T17:23:57.873017] [INFO ] [REMOTE ] AVAL: Full fetch complete (14935 records). [2025-10-17T17:23:57.873137] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-17T17:23:58.239526] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-17T17:23:58.239615] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-17T17:23:58.239916] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-17T17:23:58.239970] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-17T17:23:58.240443] [DEBUG] [LOCAL ] AVAL: Trimmed 14935 records to 8705 (keeping 200 days of data) [2025-10-17T17:23:58.292038] [DEBUG] [LOCAL ] AVAL: Primary data saved (8705 records). [2025-10-17T17:23:58.292143] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-17T17:23:58.292223] [INFO ] [MAIN ] Update Progress: 182/2368 symbols completed. AVAL took 38.2s. Estimated remaining: 4h 47m 8s. Rate: 7.6 symbols/min [2025-10-17T17:23:58.363126] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-17T17:23:58.478286] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:58.512132] [DEBUG] [LOCAL ] AVNS: Loaded 33913 existing records from primary storage. [2025-10-17T17:23:58.512407] [INFO ] [MAIN ] AVNS: Loaded 33913 existing records. [2025-10-17T17:23:58.646779] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:23:58.714061] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:58.714267] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-17T17:23:58.714315] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-17T17:23:58.714522] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-17T17:23:58.714572] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-17T17:23:59.062425] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:59.158014] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-17T17:23:59.390597] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T17:23:59.958056] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-17T17:24:00.446723] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T17:24:00.758088] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-17T17:24:01.155482] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T17:24:01.558032] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-17T17:24:02.091039] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:24:02.358017] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-17T17:24:02.624062] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T17:24:03.158067] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-17T17:24:03.757089] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T17:24:03.958024] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-17T17:24:04.012248] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:24:04.758060] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-17T17:24:05.558071] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-17T17:24:05.630942] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:24:05.957328] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T17:24:06.357996] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-17T17:24:06.735304] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T17:24:07.158092] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-17T17:24:07.928510] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:24:07.958002] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-17T17:24:08.390261] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T17:24:08.758097] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-17T17:24:09.215401] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:24:09.558036] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-17T17:24:09.830387] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T17:24:10.358089] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-17T17:24:10.501560] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T17:24:11.158040] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-17T17:24:11.958638] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-17T17:24:11.972809] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T17:24:12.274838] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T17:24:12.758066] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-17T17:24:13.113346] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T17:24:13.558051] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-17T17:24:14.358023] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-17T17:24:14.502850] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T17:24:14.775679] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T17:24:14.778479] [INFO ] [REMOTE ] AVD: Full fetch complete (32787 records). [2025-10-17T17:24:14.778631] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-17T17:24:15.158092] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-17T17:24:15.170409] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-17T17:24:15.170509] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-17T17:24:15.171781] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-17T17:24:15.171847] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-17T17:24:15.172901] [DEBUG] [LOCAL ] AVD: Trimmed 32787 records to 22021 (keeping 200 days of data) [2025-10-17T17:24:15.292356] [DEBUG] [LOCAL ] AVD: Primary data saved (22021 records). [2025-10-17T17:24:15.292480] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-17T17:24:15.292551] [INFO ] [MAIN ] Update Progress: 183/2368 symbols completed. AVD took 26.9s. Estimated remaining: 4h 48m 49s. Rate: 7.6 symbols/min [2025-10-17T17:24:15.464783] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:15.509163] [DEBUG] [LOCAL ] AVNT: Loaded 39339 existing records from primary storage. [2025-10-17T17:24:15.509526] [INFO ] [MAIN ] AVNT: Loaded 39339 existing records. [2025-10-17T17:24:15.687546] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T17:24:15.725510] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:15.726917] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-17T17:24:15.726998] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-17T17:24:15.727286] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-17T17:24:15.727354] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-17T17:24:15.967000] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-17T17:24:16.097870] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:16.336026] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T17:24:16.758117] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-17T17:24:17.372309] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:24:17.558039] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-17T17:24:18.063253] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T17:24:18.358141] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-17T17:24:19.048121] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:24:19.158037] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-17T17:24:19.383750] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T17:24:19.958109] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-17T17:24:20.758102] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-17T17:24:21.169219] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T17:24:21.175365] [INFO ] [REMOTE ] AVB: Full fetch complete (59166 records). [2025-10-17T17:24:21.175519] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-17T17:24:21.494517] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:24:21.568633] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-17T17:24:21.595801] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-17T17:24:21.595977] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-17T17:24:21.596779] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-17T17:24:21.596845] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-17T17:24:21.598607] [DEBUG] [LOCAL ] AVB: Trimmed 59166 records to 42866 (keeping 200 days of data) [2025-10-17T17:24:21.866816] [DEBUG] [LOCAL ] AVB: Primary data saved (42866 records). [2025-10-17T17:24:21.866942] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-17T17:24:21.867051] [INFO ] [MAIN ] Update Progress: 184/2368 symbols completed. AVB took 48.8s. Estimated remaining: 4h 48m 25s. Rate: 7.6 symbols/min [2025-10-17T17:24:21.983248] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T17:24:22.030785] [INFO ] [REMOTE ] AVK: Full fetch complete (26680 records). [2025-10-17T17:24:22.053121] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-17T17:24:22.055572] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:22.363124] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-17T17:24:22.520635] [DEBUG] [LOCAL ] AVTR: Loaded 53962 existing records from primary storage. [2025-10-17T17:24:22.519379] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-17T17:24:22.520868] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-17T17:24:22.521344] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-17T17:24:22.521501] [INFO ] [MAIN ] AVTR: Loaded 53962 existing records. [2025-10-17T17:24:22.564686] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-17T17:24:22.640095] [DEBUG] [LOCAL ] AVK: Trimmed 26680 records to 18858 (keeping 200 days of data) [2025-10-17T17:24:22.755183] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:22.755541] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-17T17:24:22.764289] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-17T17:24:22.764956] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-17T17:24:22.765127] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-17T17:24:23.250839] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:23.256721] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-17T17:24:23.261842] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:24:23.280138] [DEBUG] [LOCAL ] AVK: Primary data saved (18858 records). [2025-10-17T17:24:23.280363] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-17T17:24:23.280472] [INFO ] [MAIN ] Update Progress: 185/2368 symbols completed. AVK took 34.2s. Estimated remaining: 4h 47m 0s. Rate: 7.6 symbols/min [2025-10-17T17:24:23.471881] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:23.472256] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-17T17:24:23.472393] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-17T17:24:23.472623] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-17T17:24:23.472751] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-17T17:24:23.472809] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-17T17:24:23.472845] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-17T17:24:23.616128] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:24:23.899156] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:23.958067] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-17T17:24:24.736786] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T17:24:24.757999] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-17T17:24:25.347844] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:24:25.558051] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-17T17:24:26.155665] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:24:26.358108] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-17T17:24:27.105115] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:24:27.157988] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-17T17:24:27.900098] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:24:27.958035] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-17T17:24:28.758016] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-17T17:24:28.859537] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:24:29.388004] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:24:29.558075] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-17T17:24:30.358034] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-17T17:24:30.461141] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:24:31.022046] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T17:24:31.158029] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-17T17:24:31.504881] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T17:24:31.958047] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-17T17:24:32.763108] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-17T17:24:32.777350] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:24:33.492541] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:24:33.557997] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-17T17:24:34.358029] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-17T17:24:34.499841] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T17:24:35.121317] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:24:35.158018] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-17T17:24:35.966367] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-17T17:24:35.998633] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:24:36.205186] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:24:36.758027] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-17T17:24:37.558004] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-17T17:24:37.870107] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T17:24:38.335682] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:24:38.357999] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-17T17:24:38.727628] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:24:39.158063] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-17T17:24:39.857701] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:24:39.958037] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-17T17:24:40.280265] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:24:40.285016] [INFO ] [REMOTE ] AVNS: Full fetch complete (48385 records). [2025-10-17T17:24:40.285128] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-17T17:24:40.659033] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-17T17:24:40.659133] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-17T17:24:40.659740] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-17T17:24:40.659807] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-17T17:24:40.660999] [DEBUG] [LOCAL ] AVNS: Trimmed 48385 records to 34111 (keeping 200 days of data) [2025-10-17T17:24:40.758869] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-17T17:24:40.856376] [DEBUG] [LOCAL ] AVNS: Primary data saved (34111 records). [2025-10-17T17:24:40.856519] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-17T17:24:40.856598] [INFO ] [MAIN ] Update Progress: 186/2368 symbols completed. AVNS took 42.6s. Estimated remaining: 4h 48m 46s. Rate: 7.6 symbols/min [2025-10-17T17:24:41.025745] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:41.049484] [DEBUG] [LOCAL ] AWF: Loaded 24143 existing records from primary storage. [2025-10-17T17:24:41.049782] [INFO ] [MAIN ] AWF: Loaded 24143 existing records. [2025-10-17T17:24:41.234795] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:41.235241] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-17T17:24:41.235356] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-17T17:24:41.235801] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-17T17:24:41.235864] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-17T17:24:41.368119] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:24:41.563115] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-17T17:24:41.630717] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:42.333785] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T17:24:42.357997] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-17T17:24:43.044555] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:24:43.158047] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-17T17:24:43.798782] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T17:24:43.958062] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-17T17:24:44.542619] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T17:24:44.758023] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-17T17:24:45.562288] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-17T17:24:45.564431] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:24:45.570505] [INFO ] [REMOTE ] AVNT: Full fetch complete (56363 records). [2025-10-17T17:24:45.570892] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-17T17:24:45.972126] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-17T17:24:45.972291] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-17T17:24:45.973038] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-17T17:24:45.973105] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-17T17:24:45.974750] [DEBUG] [LOCAL ] AVNT: Trimmed 56363 records to 39562 (keeping 200 days of data) [2025-10-17T17:24:46.257603] [DEBUG] [LOCAL ] AVNT: Primary data saved (39562 records). [2025-10-17T17:24:46.259532] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-17T17:24:46.259774] [INFO ] [MAIN ] Update Progress: 187/2368 symbols completed. AVNT took 31.0s. Estimated remaining: 4h 48m 9s. Rate: 7.6 symbols/min [2025-10-17T17:24:46.259396] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:24:46.363707] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-17T17:24:46.450016] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:46.482579] [DEBUG] [LOCAL ] AWI: Loaded 25598 existing records from primary storage. [2025-10-17T17:24:46.483089] [INFO ] [MAIN ] AWI: Loaded 25598 existing records. [2025-10-17T17:24:46.671445] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:46.671726] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-17T17:24:46.671785] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-17T17:24:46.671981] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-17T17:24:46.672019] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-17T17:24:47.050884] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:47.079057] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:24:47.158010] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-17T17:24:47.552210] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:24:47.958056] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-17T17:24:48.758064] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-17T17:24:49.045821] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T17:24:49.096813] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T17:24:49.558037] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-17T17:24:49.911878] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T17:24:50.358045] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-17T17:24:50.872947] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:24:51.040983] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:24:51.158052] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-17T17:24:51.958056] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-17T17:24:52.307787] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T17:24:52.758093] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-17T17:24:53.569562] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-17T17:24:53.571751] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T17:24:53.882581] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T17:24:54.358047] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-17T17:24:55.016044] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T17:24:55.138089] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:24:55.157984] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-17T17:24:55.958019] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-17T17:24:56.578719] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T17:24:56.758057] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-17T17:24:57.503120] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:24:57.509084] [INFO ] [REMOTE ] AVY: Full fetch complete (56647 records). [2025-10-17T17:24:57.509232] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-17T17:24:57.563297] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-17T17:24:57.889167] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-17T17:24:57.889243] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-17T17:24:57.889846] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-17T17:24:57.889908] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-17T17:24:57.891031] [DEBUG] [LOCAL ] AVY: Trimmed 56647 records to 38653 (keeping 200 days of data) [2025-10-17T17:24:58.126705] [DEBUG] [LOCAL ] AVY: Primary data saved (38653 records). [2025-10-17T17:24:58.126835] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-17T17:24:58.126906] [INFO ] [MAIN ] Update Progress: 188/2368 symbols completed. AVY took 34.8s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-17T17:24:58.310897] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:24:58.328507] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:58.360375] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-17T17:24:58.382682] [DEBUG] [LOCAL ] AWK: Loaded 48909 existing records from primary storage. [2025-10-17T17:24:58.383042] [INFO ] [MAIN ] AWK: Loaded 48909 existing records. [2025-10-17T17:24:58.559150] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:58.559391] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-17T17:24:58.559437] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-17T17:24:58.559747] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-17T17:24:58.559808] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-17T17:24:58.687060] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T17:24:58.925343] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:59.158012] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-17T17:24:59.539045] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T17:24:59.958036] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-17T17:25:00.757994] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-17T17:25:01.258424] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T17:25:01.321634] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:25:01.558030] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-17T17:25:02.068689] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:25:02.358041] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-17T17:25:02.912933] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T17:25:03.158076] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-17T17:25:03.511355] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T17:25:03.958039] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-17T17:25:04.758015] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-17T17:25:04.884841] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:25:05.433041] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:25:05.558047] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-17T17:25:05.795047] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:25:06.358032] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-17T17:25:07.158085] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-17T17:25:07.587591] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T17:25:07.738514] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T17:25:07.958082] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-17T17:25:08.758085] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-17T17:25:09.196286] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T17:25:09.233031] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:25:09.238781] [INFO ] [REMOTE ] AWF: Full fetch complete (35909 records). [2025-10-17T17:25:09.238952] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-17T17:25:09.563238] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-17T17:25:09.621865] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-17T17:25:09.621942] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-17T17:25:09.622372] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-17T17:25:09.622412] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-17T17:25:09.623184] [DEBUG] [LOCAL ] AWF: Trimmed 35909 records to 24387 (keeping 200 days of data) [2025-10-17T17:25:09.765408] [DEBUG] [LOCAL ] AWF: Primary data saved (24387 records). [2025-10-17T17:25:09.765539] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-17T17:25:09.765618] [INFO ] [MAIN ] Update Progress: 189/2368 symbols completed. AWF took 28.9s. Estimated remaining: 4h 49m 21s. Rate: 7.5 symbols/min [2025-10-17T17:25:09.932799] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:09.956009] [DEBUG] [LOCAL ] AWP: Loaded 21759 existing records from primary storage. [2025-10-17T17:25:09.956253] [INFO ] [MAIN ] AWP: Loaded 21759 existing records. [2025-10-17T17:25:10.131453] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:10.142307] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-17T17:25:10.142628] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:25:10.146560] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-17T17:25:10.146932] [INFO ] [REMOTE ] AWI: Full fetch complete (36045 records). [2025-10-17T17:25:10.147085] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-17T17:25:10.147047] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-17T17:25:10.147254] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-17T17:25:10.362873] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-17T17:25:10.857135] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:10.895625] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-17T17:25:10.895736] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-17T17:25:10.896181] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-17T17:25:10.896223] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-17T17:25:10.897061] [DEBUG] [LOCAL ] AWI: Trimmed 36045 records to 25722 (keeping 200 days of data) [2025-10-17T17:25:11.051759] [DEBUG] [LOCAL ] AWI: Primary data saved (25722 records). [2025-10-17T17:25:11.051895] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-17T17:25:11.051981] [INFO ] [MAIN ] Update Progress: 190/2368 symbols completed. AWI took 24.8s. Estimated remaining: 4h 47m 56s. Rate: 7.6 symbols/min [2025-10-17T17:25:11.163143] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-17T17:25:11.220141] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:11.240774] [DEBUG] [LOCAL ] AWR: Loaded 23000 existing records from primary storage. [2025-10-17T17:25:11.241040] [INFO ] [MAIN ] AWR: Loaded 23000 existing records. [2025-10-17T17:25:11.417942] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:11.418385] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-17T17:25:11.418529] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-17T17:25:11.418958] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-17T17:25:11.419111] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-17T17:25:11.780439] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-17T17:25:11.820269] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:11.958005] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-17T17:25:12.267302] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T17:25:12.730085] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:25:12.758039] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-17T17:25:13.558039] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-17T17:25:13.996067] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T17:25:14.030007] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:25:14.358044] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-17T17:25:15.158029] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-17T17:25:15.426231] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:25:15.437222] [INFO ] [REMOTE ] AVTR: Full fetch complete (77647 records). [2025-10-17T17:25:15.437388] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-17T17:25:15.844466] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-17T17:25:15.844555] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-17T17:25:15.845366] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-17T17:25:15.845430] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-17T17:25:15.846948] [DEBUG] [LOCAL ] AVTR: Trimmed 77647 records to 54352 (keeping 200 days of data) [2025-10-17T17:25:15.958188] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-17T17:25:16.099736] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:25:16.210085] [DEBUG] [LOCAL ] AVTR: Primary data saved (54352 records). [2025-10-17T17:25:16.210237] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-17T17:25:16.210322] [INFO ] [MAIN ] Update Progress: 191/2368 symbols completed. AVTR took 54.3s. Estimated remaining: 4h 47m 17s. Rate: 7.6 symbols/min [2025-10-17T17:25:16.380142] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:16.407262] [DEBUG] [LOCAL ] AX: Loaded 28285 existing records from primary storage. [2025-10-17T17:25:16.407562] [INFO ] [MAIN ] AX: Loaded 28285 existing records. [2025-10-17T17:25:16.563455] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T17:25:16.602422] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:16.602592] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-17T17:25:16.602695] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-17T17:25:16.602957] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-17T17:25:16.602996] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-17T17:25:16.758038] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-17T17:25:16.971032] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:17.001051] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T17:25:17.558039] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-17T17:25:17.902086] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:25:18.358067] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-17T17:25:18.633154] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:25:19.158091] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-17T17:25:19.831769] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:25:19.958068] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-17T17:25:20.574575] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:25:20.758036] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-17T17:25:21.376117] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:25:21.558045] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-17T17:25:21.813813] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:25:22.358064] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-17T17:25:22.579188] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T17:25:23.158048] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-17T17:25:23.438370] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:25:23.958020] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-17T17:25:24.323528] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:25:24.758046] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-17T17:25:25.404794] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:25:25.558041] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-17T17:25:26.054468] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:25:26.358106] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-17T17:25:26.872305] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:25:27.158045] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-17T17:25:27.958087] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-17T17:25:28.235714] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:25:28.554955] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T17:25:28.758008] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-17T17:25:28.987407] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:25:29.558021] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-17T17:25:30.025690] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:25:30.358031] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-17T17:25:30.803545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T17:25:31.158033] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-17T17:25:31.958005] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-17T17:25:32.130493] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T17:25:32.196633] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T17:25:32.758020] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-17T17:25:32.990689] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:25:33.558049] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-17T17:25:34.358037] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-17T17:25:34.426102] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:25:34.836328] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:25:35.158043] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-17T17:25:35.245776] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:25:35.958075] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-17T17:25:36.123829] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T17:25:36.758048] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-17T17:25:37.557985] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-17T17:25:37.598150] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T17:25:37.795458] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:25:37.803149] [INFO ] [REMOTE ] AWP: Full fetch complete (31876 records). [2025-10-17T17:25:37.803937] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-17T17:25:38.176563] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-17T17:25:38.176673] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-17T17:25:38.177110] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-17T17:25:38.177153] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-17T17:25:38.178895] [DEBUG] [LOCAL ] AWP: Trimmed 31876 records to 21887 (keeping 200 days of data) [2025-10-17T17:25:38.302102] [DEBUG] [LOCAL ] AWP: Primary data saved (21887 records). [2025-10-17T17:25:38.302228] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-17T17:25:38.302305] [INFO ] [MAIN ] Update Progress: 192/2368 symbols completed. AWP took 28.5s. Estimated remaining: 4h 49m 50s. Rate: 7.5 symbols/min [2025-10-17T17:25:38.364444] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-17T17:25:38.495571] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:38.543091] [DEBUG] [LOCAL ] AXL: Loaded 50921 existing records from primary storage. [2025-10-17T17:25:38.543416] [INFO ] [MAIN ] AXL: Loaded 50921 existing records. [2025-10-17T17:25:38.713041] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:25:38.748968] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:38.749614] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-17T17:25:38.749954] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-17T17:25:38.750345] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-17T17:25:38.750403] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-17T17:25:39.159240] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:39.159364] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-17T17:25:39.957998] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-17T17:25:40.247407] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:25:40.254672] [INFO ] [REMOTE ] AWK: Full fetch complete (70882 records). [2025-10-17T17:25:40.254833] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-17T17:25:40.661843] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:25:40.692843] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-17T17:25:40.693184] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-17T17:25:40.693994] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-17T17:25:40.694079] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-17T17:25:40.695968] [DEBUG] [LOCAL ] AWK: Trimmed 70882 records to 49233 (keeping 200 days of data) [2025-10-17T17:25:40.760578] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-17T17:25:41.000557] [DEBUG] [LOCAL ] AWK: Primary data saved (49233 records). [2025-10-17T17:25:41.000770] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-17T17:25:41.001740] [INFO ] [MAIN ] Update Progress: 193/2368 symbols completed. AWK took 42.9s. Estimated remaining: 4h 48m 42s. Rate: 7.5 symbols/min [2025-10-17T17:25:41.179011] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:41.231583] [DEBUG] [LOCAL ] AXP: Loaded 53555 existing records from primary storage. [2025-10-17T17:25:41.231943] [INFO ] [MAIN ] AXP: Loaded 53555 existing records. [2025-10-17T17:25:41.407547] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:41.407855] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-17T17:25:41.407918] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-17T17:25:41.408485] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-17T17:25:41.408549] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-17T17:25:41.586876] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-17T17:25:41.808726] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:41.835702] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T17:25:42.038992] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T17:25:42.358019] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-17T17:25:42.476225] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T17:25:43.158004] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-17T17:25:43.762710] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:25:43.958034] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-17T17:25:44.288224] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:25:44.758031] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-17T17:25:45.554373] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T17:25:45.564000] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-17T17:25:45.607329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T17:25:45.610819] [INFO ] [REMOTE ] AWR: Full fetch complete (32324 records). [2025-10-17T17:25:45.610902] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-17T17:25:45.969469] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-17T17:25:45.969548] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-17T17:25:45.969993] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-17T17:25:45.970057] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-17T17:25:45.970886] [DEBUG] [LOCAL ] AWR: Trimmed 32324 records to 23114 (keeping 200 days of data) [2025-10-17T17:25:46.107275] [DEBUG] [LOCAL ] AWR: Primary data saved (23114 records). [2025-10-17T17:25:46.107398] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-17T17:25:46.107495] [INFO ] [MAIN ] Update Progress: 194/2368 symbols completed. AWR took 35.1s. Estimated remaining: 4h 48m 2s. Rate: 7.5 symbols/min [2025-10-17T17:25:46.272477] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:46.272670] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-17T17:25:46.272725] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-17T17:25:46.272837] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-17T17:25:46.272878] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-17T17:25:46.272918] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-17T17:25:46.272950] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-17T17:25:46.365918] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-17T17:25:46.620005] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:46.982384] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T17:25:46.986164] [INFO ] [REMOTE ] AX: Full fetch complete (42053 records). [2025-10-17T17:25:46.986270] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-17T17:25:46.986840] [FATAL] [VALIDATOR ] AX: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:25:46.986930] [FATAL] [MAIN ] AX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:25:46.986992] [WARN ] [MAIN ] AX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:25:46.987063] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-17T17:25:46.987128] [DEBUG] [LOCAL ] AX: No primary data file found to delete. [2025-10-17T17:25:46.987163] [INFO ] [LOCAL ] AX: Starting deletion of derivative data. [2025-10-17T17:25:46.987378] [DEBUG] [LOCAL ] AX: Deleted derivative data file. [2025-10-17T17:25:46.987485] [INFO ] [MAIN ] Update Progress: 195/2368 symbols completed. AX took 30.8s. Estimated remaining: 4h 46m 35s. Rate: 7.6 symbols/min [2025-10-17T17:25:47.154142] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:47.158061] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-17T17:25:47.192385] [DEBUG] [LOCAL ] AXS: Loaded 38896 existing records from primary storage. [2025-10-17T17:25:47.192700] [INFO ] [MAIN ] AXS: Loaded 38896 existing records. [2025-10-17T17:25:47.368638] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:47.368866] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-17T17:25:47.368912] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-17T17:25:47.369301] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-17T17:25:47.369356] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-17T17:25:47.727071] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:47.844705] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:25:47.884618] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T17:25:47.958029] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-17T17:25:48.758092] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-17T17:25:49.336195] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T17:25:49.558037] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-17T17:25:50.206937] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T17:25:50.358027] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-17T17:25:50.808120] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T17:25:50.826013] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:25:51.158040] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-17T17:25:51.958041] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-17T17:25:52.531014] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T17:25:52.758061] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-17T17:25:53.558008] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-17T17:25:54.062899] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T17:25:54.096488] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T17:25:54.141925] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:25:54.358058] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-17T17:25:55.158087] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-17T17:25:55.958131] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-17T17:25:56.394721] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T17:25:56.758079] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-17T17:25:56.952422] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:25:57.342018] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:25:57.398807] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T17:25:57.558071] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-17T17:25:58.140063] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T17:25:58.358084] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-17T17:25:59.158097] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-17T17:25:59.727258] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T17:25:59.958077] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-17T17:26:00.173518] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T17:26:00.758052] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-17T17:26:01.558075] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-17T17:26:01.884494] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T17:26:02.190972] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T17:26:02.358052] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-17T17:26:02.488955] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T17:26:02.667290] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T17:26:03.158037] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-17T17:26:03.731184] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:26:03.958106] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-17T17:26:04.547098] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T17:26:04.548207] [INFO ] [REMOTE ] AXR: Full fetch complete (4435 records). [2025-10-17T17:26:04.548333] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-17T17:26:04.763706] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-17T17:26:04.928725] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-17T17:26:04.928854] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-17T17:26:04.929063] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-17T17:26:04.929148] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-17T17:26:04.929816] [DEBUG] [LOCAL ] AXR: Trimmed 4435 records to 2975 (keeping 200 days of data) [2025-10-17T17:26:04.949001] [DEBUG] [LOCAL ] AXR: Primary data saved (2975 records). [2025-10-17T17:26:04.949154] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-17T17:26:04.949239] [INFO ] [MAIN ] Update Progress: 196/2368 symbols completed. AXR took 18.8s. Estimated remaining: 4h 48m 19s. Rate: 7.5 symbols/min [2025-10-17T17:26:05.124225] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:05.193828] [DEBUG] [LOCAL ] AXTA: Loaded 52641 existing records from primary storage. [2025-10-17T17:26:05.194345] [INFO ] [MAIN ] AXTA: Loaded 52641 existing records. [2025-10-17T17:26:05.401309] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:05.401663] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-17T17:26:05.401732] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-17T17:26:05.402215] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-17T17:26:05.402275] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-17T17:26:05.563372] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-17T17:26:05.782731] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:06.358060] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-17T17:26:07.158043] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-17T17:26:07.193526] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T17:26:07.266879] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:26:07.958078] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-17T17:26:08.058191] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:26:08.636559] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:26:08.758091] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-17T17:26:09.558018] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-17T17:26:09.665937] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T17:26:10.357995] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-17T17:26:10.472133] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:26:10.661987] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:26:11.158070] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-17T17:26:11.958050] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-17T17:26:12.060009] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T17:26:12.371572] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T17:26:12.758067] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-17T17:26:13.222711] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:26:13.558039] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-17T17:26:14.358096] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-17T17:26:14.456968] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:26:15.158046] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-17T17:26:15.718386] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-17T17:26:15.958025] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-17T17:26:16.167792] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:26:16.683235] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:26:16.758009] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-17T17:26:17.558092] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-17T17:26:18.063441] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-17T17:26:18.235213] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:26:18.358051] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-17T17:26:19.158059] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-17T17:26:19.608485] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T17:26:19.615601] [INFO ] [REMOTE ] AXL: Full fetch complete (73085 records). [2025-10-17T17:26:19.615785] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-17T17:26:19.972038] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:26:19.970471] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-17T17:26:20.044792] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-17T17:26:20.044906] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-17T17:26:20.044542] [INFO ] [REMOTE ] AXS: Full fetch complete (55938 records). [2025-10-17T17:26:20.045724] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-17T17:26:20.045948] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-17T17:26:20.046071] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-17T17:26:20.154399] [DEBUG] [LOCAL ] AXL: Trimmed 73085 records to 51268 (keeping 200 days of data) [2025-10-17T17:26:20.670239] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-17T17:26:20.671726] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-17T17:26:20.673033] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-17T17:26:20.673114] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-17T17:26:20.684490] [DEBUG] [LOCAL ] AXS: Trimmed 55938 records to 39196 (keeping 200 days of data) [2025-10-17T17:26:20.887273] [DEBUG] [LOCAL ] AXL: Primary data saved (51268 records). [2025-10-17T17:26:20.891137] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-17T17:26:20.891319] [INFO ] [MAIN ] Update Progress: 197/2368 symbols completed. AXL took 42.6s. Estimated remaining: 4h 49m 39s. Rate: 7.5 symbols/min [2025-10-17T17:26:21.024614] [DEBUG] [LOCAL ] AXS: Primary data saved (39196 records). [2025-10-17T17:26:21.024780] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-17T17:26:21.024880] [INFO ] [MAIN ] Update Progress: 198/2368 symbols completed. AXS took 34.0s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-17T17:26:21.201054] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T17:26:21.213215] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-17T17:26:22.232600] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T17:26:22.244463] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-17T17:26:22.966700] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:26:22.977832] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-17T17:26:24.377357] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T17:26:24.392948] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-17T17:26:24.527550] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T17:26:24.538624] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-17T17:26:26.063783] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T17:26:26.075919] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-17T17:26:26.243587] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:26:26.256729] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-17T17:26:27.820028] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T17:26:27.832275] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-17T17:26:28.387047] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T17:26:28.395493] [INFO ] [REMOTE ] AXP: Full fetch complete (77092 records). [2025-10-17T17:26:28.395806] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-17T17:26:28.836278] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-17T17:26:28.836377] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-17T17:26:28.837308] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-17T17:26:28.837378] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-17T17:26:28.839033] [DEBUG] [LOCAL ] AXP: Trimmed 77092 records to 53945 (keeping 200 days of data) [2025-10-17T17:26:29.201637] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:26:29.214427] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-17T17:26:29.236946] [DEBUG] [LOCAL ] AXP: Primary data saved (53945 records). [2025-10-17T17:26:29.237107] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-17T17:26:29.238313] [INFO ] [MAIN ] Update Progress: 199/2368 symbols completed. AXP took 48.2s. Estimated remaining: 4h 47m 59s. Rate: 7.5 symbols/min [2025-10-17T17:26:30.858101] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T17:26:30.865678] [INFO ] [REMOTE ] AXTA: Full fetch complete (75391 records). [2025-10-17T17:26:30.865813] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-17T17:26:31.256676] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-17T17:26:31.256763] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-17T17:26:31.257525] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-17T17:26:31.257591] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-17T17:26:31.259072] [DEBUG] [LOCAL ] AXTA: Trimmed 75391 records to 53031 (keeping 200 days of data) [2025-10-17T17:26:31.571907] [DEBUG] [LOCAL ] AXTA: Primary data saved (53031 records). [2025-10-17T17:26:31.572136] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-17T17:26:31.573087] [INFO ] [MAIN ] Update Progress: 200/2368 symbols completed. AXTA took 26.6s. Estimated remaining: 4h 46m 50s. Rate: 7.6 symbols/min [2025-10-17T17:26:32.062456] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.245715] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.275175] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.252677] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.276424] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-17T17:26:32.276618] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-17T17:26:32.276796] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-17T17:26:32.276863] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-17T17:26:32.276942] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-17T17:26:32.277027] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-17T17:26:32.313116] [DEBUG] [LOCAL ] AZO: Loaded 11071 existing records from primary storage. [2025-10-17T17:26:32.347210] [INFO ] [MAIN ] AZO: Loaded 11071 existing records. [2025-10-17T17:26:32.588693] [DEBUG] [LOCAL ] AYI: Loaded 25059 existing records from primary storage. [2025-10-17T17:26:32.588597] [DEBUG] [LOCAL ] AZZ: Loaded 22902 existing records from primary storage. [2025-10-17T17:26:32.614940] [INFO ] [MAIN ] AYI: Loaded 25059 existing records. [2025-10-17T17:26:32.637993] [INFO ] [MAIN ] AZZ: Loaded 22902 existing records. [2025-10-17T17:26:32.982134] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:32.990234] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-17T17:26:33.042304] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-17T17:26:33.153594] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-17T17:26:33.219244] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:33.266424] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:33.266865] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-17T17:26:33.270561] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:33.267699] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-17T17:26:33.237543] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-17T17:26:33.282275] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-17T17:26:33.292163] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-17T17:26:33.292340] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-17T17:26:33.301715] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-17T17:26:33.306932] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-17T17:26:33.301583] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-17T17:26:33.338709] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-17T17:26:34.216217] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:34.307445] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-17T17:26:34.349793] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:34.356968] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-17T17:26:34.435829] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:34.436140] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-17T17:26:34.779415] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T17:26:34.786192] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-17T17:26:35.107598] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T17:26:35.111170] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-17T17:26:35.317223] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T17:26:35.322671] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-17T17:26:35.519934] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:26:35.524366] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-17T17:26:35.897442] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:26:35.903481] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-17T17:26:36.021268] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T17:26:36.024066] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-17T17:26:36.101864] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:26:36.102178] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-17T17:26:36.102268] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:26:36.102359] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-17T17:26:36.102444] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:26:36.102531] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-17T17:26:36.102613] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-17T17:26:36.102711] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-17T17:26:36.102785] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-17T17:26:36.102851] [INFO ] [MAIN ] Update Progress: 201/2368 symbols completed. B took 4.5s. Estimated remaining: 4h 46m 5s. Rate: 7.6 symbols/min [2025-10-17T17:26:36.268901] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:36.325384] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-17T17:26:36.325707] [INFO ] [MAIN ] BA: Loaded 54180 existing records. [2025-10-17T17:26:36.503853] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:36.504056] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-17T17:26:36.504102] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-17T17:26:36.504520] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-17T17:26:36.504558] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-17T17:26:36.768911] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T17:26:36.807243] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-17T17:26:36.884701] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:26:36.897571] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:36.900319] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-17T17:26:36.919623] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T17:26:37.557989] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-17T17:26:37.915184] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T17:26:38.358007] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-17T17:26:38.570123] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T17:26:39.159089] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-17T17:26:39.184112] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-17T17:26:39.214372] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:26:39.958066] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-17T17:26:40.231693] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T17:26:40.758081] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-17T17:26:41.558012] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-17T17:26:42.086448] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T17:26:42.125456] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T17:26:42.358063] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-17T17:26:42.516182] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T17:26:43.158037] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-17T17:26:43.958012] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-17T17:26:44.245979] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T17:26:44.269460] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T17:26:44.758010] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-17T17:26:44.881026] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:26:45.558032] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-17T17:26:46.358044] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-17T17:26:46.467946] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T17:26:46.988386] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T17:26:47.158017] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-17T17:26:47.395201] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:26:47.958068] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-17T17:26:48.758043] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-17T17:26:49.060752] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T17:26:49.489598] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T17:26:49.558042] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-17T17:26:50.341093] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T17:26:50.357987] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-17T17:26:50.399293] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T17:26:51.158058] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-17T17:26:51.958050] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-17T17:26:52.218784] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:26:52.741935] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T17:26:52.757992] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-17T17:26:52.860450] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-17T17:26:53.558083] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-17T17:26:53.695062] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T17:26:54.358071] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-17T17:26:54.694379] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T17:26:55.158005] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-17T17:26:55.641177] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:26:55.944967] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:26:55.946868] [INFO ] [REMOTE ] AZO: Full fetch complete (15923 records). [2025-10-17T17:26:55.946939] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-17T17:26:55.967848] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-17T17:26:56.321389] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-17T17:26:56.321469] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-17T17:26:56.321781] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-17T17:26:56.321841] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-17T17:26:56.322550] [DEBUG] [LOCAL ] AZO: Trimmed 15923 records to 11148 (keeping 200 days of data) [2025-10-17T17:26:56.391208] [DEBUG] [LOCAL ] AZO: Primary data saved (11148 records). [2025-10-17T17:26:56.391344] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-17T17:26:56.391426] [INFO ] [MAIN ] Update Progress: 202/2368 symbols completed. AZO took 24.8s. Estimated remaining: 4h 48m 10s. Rate: 7.5 symbols/min [2025-10-17T17:26:56.558388] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:56.613929] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-17T17:26:56.614263] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-10-17T17:26:56.763269] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-17T17:26:56.795047] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:56.796515] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-17T17:26:56.796579] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-17T17:26:56.797118] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-17T17:26:56.797176] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-17T17:26:57.203771] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:57.558068] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-17T17:26:57.925990] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:26:58.358117] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-17T17:26:58.513954] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-17T17:26:58.572055] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T17:26:59.158032] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-17T17:26:59.958036] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-17T17:27:00.758090] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-17T17:27:01.111899] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T17:27:01.298282] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.94 seconds). [2025-10-17T17:27:01.558061] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-17T17:27:01.889791] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-17T17:27:02.231484] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:27:02.358095] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-17T17:27:02.460072] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T17:27:02.464617] [INFO ] [REMOTE ] AZZ: Full fetch complete (31995 records). [2025-10-17T17:27:02.464823] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-17T17:27:02.849031] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-17T17:27:02.849136] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-17T17:27:02.849764] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-17T17:27:02.849838] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-17T17:27:02.851208] [DEBUG] [LOCAL ] AZZ: Trimmed 31995 records to 23075 (keeping 200 days of data) [2025-10-17T17:27:03.007455] [DEBUG] [LOCAL ] AZZ: Primary data saved (23075 records). [2025-10-17T17:27:03.007996] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-17T17:27:03.008111] [INFO ] [MAIN ] Update Progress: 203/2368 symbols completed. AZZ took 31.4s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-17T17:27:03.166341] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-17T17:27:03.196566] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:03.261771] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-17T17:27:03.262457] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-10-17T17:27:03.451687] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:03.452043] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-17T17:27:03.452098] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-17T17:27:03.452752] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-17T17:27:03.452829] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-17T17:27:03.828126] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:03.958053] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-17T17:27:04.758102] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-17T17:27:04.955416] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-17T17:27:05.097052] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:27:05.208821] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T17:27:05.558030] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-17T17:27:06.358086] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-17T17:27:06.830284] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:27:06.836266] [INFO ] [REMOTE ] AYI: Full fetch complete (37011 records). [2025-10-17T17:27:06.836476] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-17T17:27:07.159369] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-17T17:27:07.354740] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-17T17:27:07.354950] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-17T17:27:07.355466] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-17T17:27:07.355545] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-17T17:27:07.391318] [DEBUG] [LOCAL ] AYI: Trimmed 37011 records to 25175 (keeping 200 days of data) [2025-10-17T17:27:07.393741] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-17T17:27:07.571365] [DEBUG] [LOCAL ] AYI: Primary data saved (25175 records). [2025-10-17T17:27:07.571502] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-17T17:27:07.571589] [INFO ] [MAIN ] Update Progress: 204/2368 symbols completed. AYI took 36.0s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-17T17:27:07.748780] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:07.798133] [DEBUG] [LOCAL ] BAH: Loaded 52097 existing records from primary storage. [2025-10-17T17:27:07.798454] [INFO ] [MAIN ] BAH: Loaded 52097 existing records. [2025-10-17T17:27:07.966896] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-17T17:27:07.973539] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:07.974903] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-17T17:27:07.974972] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-17T17:27:07.975355] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-17T17:27:07.975397] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-17T17:27:08.324673] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:08.668950] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-17T17:27:08.758029] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-17T17:27:09.558073] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-17T17:27:09.754773] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-17T17:27:10.358056] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-17T17:27:10.532347] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-17T17:27:11.158117] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-17T17:27:11.429460] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:27:11.503339] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-17T17:27:11.511885] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-17T17:27:11.512068] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-17T17:27:11.916218] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-17T17:27:11.916312] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-17T17:27:11.917102] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-17T17:27:11.917169] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-17T17:27:11.918760] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54570 (keeping 200 days of data) [2025-10-17T17:27:11.969795] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-17T17:27:12.267244] [DEBUG] [LOCAL ] BA: Primary data saved (54570 records). [2025-10-17T17:27:12.267401] [INFO ] [MAIN ] BA: Full history saved. [2025-10-17T17:27:12.268150] [INFO ] [MAIN ] Update Progress: 205/2368 symbols completed. BA took 36.2s. Estimated remaining: 4h 46m 21s. Rate: 7.6 symbols/min [2025-10-17T17:27:12.436675] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:12.475314] [DEBUG] [LOCAL ] BAK: Loaded 39589 existing records from primary storage. [2025-10-17T17:27:12.475671] [INFO ] [MAIN ] BAK: Loaded 39589 existing records. [2025-10-17T17:27:12.653419] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:12.653670] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-17T17:27:12.653731] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-17T17:27:12.654061] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-17T17:27:12.654102] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-17T17:27:13.026287] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:13.026965] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-17T17:27:13.139195] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-17T17:27:13.193755] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T17:27:13.557993] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-17T17:27:13.757453] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T17:27:14.358086] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-17T17:27:15.111889] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:27:15.158048] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-17T17:27:15.958074] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-17T17:27:16.033832] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-17T17:27:16.686882] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T17:27:16.757987] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-17T17:27:17.054371] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-17T17:27:17.558008] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-17T17:27:17.652187] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:27:18.358036] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-17T17:27:19.158044] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-17T17:27:19.313366] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-17T17:27:19.915248] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T17:27:19.958026] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-17T17:27:20.125379] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-17T17:27:20.587995] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:27:20.758019] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-17T17:27:21.558007] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-17T17:27:21.668290] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T17:27:22.358032] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-17T17:27:23.147278] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-17T17:27:23.158332] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-17T17:27:23.958085] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-17T17:27:24.137799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:27:24.241020] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-17T17:27:24.545895] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T17:27:24.758084] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-17T17:27:25.558039] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-17T17:27:26.111060] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-17T17:27:26.358007] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-17T17:27:26.518865] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:27:27.158032] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-17T17:27:27.958063] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-17T17:27:28.295671] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-17T17:27:28.758049] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-17T17:27:28.799338] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-17T17:27:29.015190] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:27:29.062412] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:27:29.558068] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-17T17:27:30.358046] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-17T17:27:31.158064] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-17T17:27:31.270569] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T17:27:31.381730] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-17T17:27:31.897093] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:27:31.958039] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-17T17:27:32.758073] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-17T17:27:33.228588] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:27:33.558007] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-17T17:27:33.722504] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:27:34.358049] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-17T17:27:35.158037] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-17T17:27:35.590448] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-17T17:27:35.849437] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:27:35.891342] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-17T17:27:35.958018] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-17T17:27:36.758086] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-17T17:27:37.100150] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T17:27:37.107437] [INFO ] [REMOTE ] BAH: Full fetch complete (75236 records). [2025-10-17T17:27:37.107593] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-17T17:27:37.512297] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-17T17:27:37.512378] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-17T17:27:37.513131] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-17T17:27:37.513196] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-17T17:27:37.514576] [DEBUG] [LOCAL ] BAH: Trimmed 75236 records to 52467 (keeping 200 days of data) [2025-10-17T17:27:37.570252] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-17T17:27:37.834553] [DEBUG] [LOCAL ] BAH: Primary data saved (52467 records). [2025-10-17T17:27:37.834716] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-17T17:27:37.835363] [INFO ] [MAIN ] Update Progress: 206/2368 symbols completed. BAH took 30.3s. Estimated remaining: 4h 49m 18s. Rate: 7.5 symbols/min [2025-10-17T17:27:38.001250] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:38.050286] [DEBUG] [LOCAL ] BALL: Loaded 52278 existing records from primary storage. [2025-10-17T17:27:38.050598] [INFO ] [MAIN ] BALL: Loaded 52278 existing records. [2025-10-17T17:27:38.226821] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:38.227155] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-17T17:27:38.227208] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-17T17:27:38.227497] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-17T17:27:38.227555] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-17T17:27:38.581765] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:38.582087] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-17T17:27:38.603074] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-17T17:27:38.611088] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-17T17:27:38.611212] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-17T17:27:39.001598] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-17T17:27:39.001714] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-17T17:27:39.002476] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-17T17:27:39.002521] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-17T17:27:39.004091] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-17T17:27:39.371323] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-17T17:27:39.374393] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-17T17:27:39.373979] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:27:39.374808] [INFO ] [MAIN ] Update Progress: 207/2368 symbols completed. BABA took 43.0s. Estimated remaining: 4h 48m 2s. Rate: 7.5 symbols/min [2025-10-17T17:27:39.477728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-17T17:27:39.488468] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-17T17:27:39.542581] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-17T17:27:39.549362] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-17T17:27:39.634840] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:39.672346] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-17T17:27:39.678367] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-17T17:27:39.696956] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-17T17:27:39.707382] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-17T17:27:39.707456] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-17T17:27:39.707535] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-17T17:27:40.407107] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:40.407524] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-17T17:27:40.408235] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-17T17:27:40.408177] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-17T17:27:40.409190] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-17T17:27:40.410229] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-17T17:27:40.412341] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54588 (keeping 200 days of data) [2025-10-17T17:27:40.549008] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:27:40.759446] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-17T17:27:40.788366] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-17T17:27:40.788970] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-17T17:27:40.789060] [INFO ] [MAIN ] Update Progress: 208/2368 symbols completed. BAC took 37.8s. Estimated remaining: 4h 46m 46s. Rate: 7.5 symbols/min [2025-10-17T17:27:40.967580] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:41.021627] [DEBUG] [LOCAL ] BAM: Loaded 52489 existing records from primary storage. [2025-10-17T17:27:41.022073] [INFO ] [MAIN ] BAM: Loaded 52489 existing records. [2025-10-17T17:27:41.205879] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:41.206312] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-17T17:27:41.206370] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-17T17:27:41.206863] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-17T17:27:41.206924] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-17T17:27:41.396683] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T17:27:41.575036] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-17T17:27:41.614866] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:41.629026] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T17:27:42.190457] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T17:27:42.358009] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-17T17:27:42.651022] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:27:43.158045] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-17T17:27:43.958001] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-17T17:27:44.130514] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T17:27:44.619230] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T17:27:44.625164] [INFO ] [REMOTE ] BAK: Full fetch complete (56883 records). [2025-10-17T17:27:44.625272] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-17T17:27:44.773300] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-17T17:27:45.025087] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-17T17:27:45.025189] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-17T17:27:45.025942] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-17T17:27:45.026070] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-17T17:27:45.027324] [DEBUG] [LOCAL ] BAK: Trimmed 56883 records to 39871 (keeping 200 days of data) [2025-10-17T17:27:45.252329] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:27:45.271230] [DEBUG] [LOCAL ] BAK: Primary data saved (39871 records). [2025-10-17T17:27:45.271344] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-17T17:27:45.271418] [INFO ] [MAIN ] Update Progress: 209/2368 symbols completed. BAK took 33.0s. Estimated remaining: 4h 46m 2s. Rate: 7.5 symbols/min [2025-10-17T17:27:45.448379] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:45.504042] [DEBUG] [LOCAL ] BANC: Loaded 51734 existing records from primary storage. [2025-10-17T17:27:45.504354] [INFO ] [MAIN ] BANC: Loaded 51734 existing records. [2025-10-17T17:27:45.567331] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-17T17:27:45.700787] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:45.701045] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-17T17:27:45.701099] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-17T17:27:45.701530] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-17T17:27:45.701588] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-17T17:27:46.074465] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:46.358005] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-17T17:27:46.657823] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T17:27:46.972617] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:27:47.158012] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-17T17:27:47.245997] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T17:27:47.908029] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T17:27:47.957992] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-17T17:27:48.758075] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-17T17:27:49.482014] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T17:27:49.565298] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-17T17:27:49.567774] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:27:50.358067] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-17T17:27:51.158067] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-17T17:27:51.324323] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T17:27:51.368634] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T17:27:51.958026] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-17T17:27:52.762183] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-17T17:27:52.764775] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:27:52.798944] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T17:27:53.558085] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-17T17:27:54.358008] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-17T17:27:54.391079] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T17:27:54.464310] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:27:55.158042] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-17T17:27:55.958023] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-17T17:27:56.217955] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:27:56.526543] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T17:27:56.589283] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:27:56.758001] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-17T17:27:57.288716] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T17:27:57.558049] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-17T17:27:58.358047] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-17T17:27:59.158074] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-17T17:27:59.335399] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:27:59.958098] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-17T17:28:00.166340] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T17:28:00.645328] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:28:00.758013] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-17T17:28:01.334052] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:28:01.558026] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-17T17:28:02.358087] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-17T17:28:02.694406] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:28:03.158002] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-17T17:28:03.336574] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:28:03.958065] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-17T17:28:04.097930] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:28:04.532493] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:28:04.723426] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T17:28:04.726330] [INFO ] [REMOTE ] BALY: Full fetch complete (16297 records). [2025-10-17T17:28:04.726421] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-17T17:28:04.763157] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-17T17:28:04.911461] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T17:28:04.911789] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:28:04.911876] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:28:04.911970] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-17T17:28:04.912063] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-17T17:28:04.912118] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-17T17:28:04.912165] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-17T17:28:04.912225] [INFO ] [MAIN ] Update Progress: 210/2368 symbols completed. BALY took 25.5s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-17T17:28:05.087108] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:05.114609] [DEBUG] [LOCAL ] BAP: Loaded 25985 existing records from primary storage. [2025-10-17T17:28:05.114889] [INFO ] [MAIN ] BAP: Loaded 25985 existing records. [2025-10-17T17:28:05.290152] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:05.290395] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-17T17:28:05.290454] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-17T17:28:05.290961] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-17T17:28:05.291021] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-17T17:28:05.563104] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-17T17:28:05.641994] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:06.358023] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-17T17:28:06.555203] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T17:28:07.158051] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-17T17:28:07.280930] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:28:07.824817] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:28:07.958043] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-17T17:28:08.710283] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T17:28:08.758041] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-17T17:28:09.100619] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:28:09.558027] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-17T17:28:10.358063] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-17T17:28:10.398008] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:28:11.158032] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-17T17:28:11.282149] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T17:28:11.958126] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-17T17:28:12.103226] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T17:28:12.552402] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:28:12.758054] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-17T17:28:13.558029] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-17T17:28:13.853582] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:28:13.861232] [INFO ] [REMOTE ] BALL: Full fetch complete (75578 records). [2025-10-17T17:28:13.861411] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-17T17:28:14.264063] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-17T17:28:14.264170] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-17T17:28:14.264948] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-17T17:28:14.265130] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-17T17:28:14.266597] [DEBUG] [LOCAL ] BALL: Trimmed 75578 records to 52656 (keeping 200 days of data) [2025-10-17T17:28:14.358749] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-17T17:28:14.607156] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:28:14.632691] [DEBUG] [LOCAL ] BALL: Primary data saved (52656 records). [2025-10-17T17:28:14.633141] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-17T17:28:14.633411] [INFO ] [MAIN ] Update Progress: 211/2368 symbols completed. BALL took 36.8s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-17T17:28:14.817799] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:14.835576] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:28:14.876051] [DEBUG] [LOCAL ] BARK: Loaded 38444 existing records from primary storage. [2025-10-17T17:28:14.876366] [INFO ] [MAIN ] BARK: Loaded 38444 existing records. [2025-10-17T17:28:15.054226] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:15.054431] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-17T17:28:15.054479] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-17T17:28:15.054889] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-17T17:28:15.054948] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-17T17:28:15.163110] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-17T17:28:15.408615] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:15.958081] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-17T17:28:16.155492] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:28:16.202260] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:28:16.758067] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-17T17:28:17.558011] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-17T17:28:17.693247] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:28:18.058878] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T17:28:18.358030] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-17T17:28:19.158012] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-17T17:28:19.186454] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T17:28:19.267968] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T17:28:19.958083] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-17T17:28:20.702426] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:28:20.757990] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-17T17:28:21.558042] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-17T17:28:21.609534] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T17:28:22.358006] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-17T17:28:22.689370] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T17:28:22.697832] [INFO ] [REMOTE ] BAM: Full fetch complete (75097 records). [2025-10-17T17:28:22.721124] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-17T17:28:22.723262] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T17:28:23.123059] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-17T17:28:23.123161] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-17T17:28:23.124046] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-17T17:28:23.124114] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-17T17:28:23.125587] [DEBUG] [LOCAL ] BAM: Trimmed 75097 records to 52877 (keeping 200 days of data) [2025-10-17T17:28:23.178386] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-17T17:28:23.447924] [DEBUG] [LOCAL ] BAM: Primary data saved (52877 records). [2025-10-17T17:28:23.448085] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-17T17:28:23.448183] [INFO ] [MAIN ] Update Progress: 212/2368 symbols completed. BAM took 42.7s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-17T17:28:23.622751] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:23.676117] [DEBUG] [LOCAL ] BAX: Loaded 53919 existing records from primary storage. [2025-10-17T17:28:23.676448] [INFO ] [MAIN ] BAX: Loaded 53919 existing records. [2025-10-17T17:28:23.864337] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:23.864910] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-17T17:28:23.864973] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-17T17:28:23.873404] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-17T17:28:23.887623] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-17T17:28:23.930779] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:28:23.963673] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-17T17:28:24.283060] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:24.758043] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-17T17:28:25.069454] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T17:28:25.076694] [INFO ] [REMOTE ] BANC: Full fetch complete (74180 records). [2025-10-17T17:28:25.076861] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-17T17:28:25.077703] [FATAL] [VALIDATOR ] BANC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:28:25.077802] [FATAL] [MAIN ] BANC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:28:25.077866] [WARN ] [MAIN ] BANC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:28:25.077955] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-17T17:28:25.078038] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-17T17:28:25.078132] [INFO ] [LOCAL ] BANC: Starting deletion of derivative data. [2025-10-17T17:28:25.078317] [DEBUG] [LOCAL ] BANC: Deleted derivative data file. [2025-10-17T17:28:25.079113] [INFO ] [MAIN ] Update Progress: 213/2368 symbols completed. BANC took 39.8s. Estimated remaining: 4h 46m 51s. Rate: 7.5 symbols/min [2025-10-17T17:28:25.256104] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:25.271845] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T17:28:25.325938] [DEBUG] [LOCAL ] BB: Loaded 53298 existing records from primary storage. [2025-10-17T17:28:25.326270] [INFO ] [MAIN ] BB: Loaded 53298 existing records. [2025-10-17T17:28:25.501617] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:25.501849] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-17T17:28:25.501900] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-17T17:28:25.502391] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-17T17:28:25.502448] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-17T17:28:25.564034] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-17T17:28:25.857135] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:26.125823] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:28:26.358016] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-17T17:28:26.922414] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T17:28:27.158043] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-17T17:28:27.776189] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T17:28:27.958031] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-17T17:28:28.588999] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T17:28:28.592842] [INFO ] [REMOTE ] BAP: Full fetch complete (37442 records). [2025-10-17T17:28:28.592948] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-17T17:28:28.762734] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-17T17:28:28.976884] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-17T17:28:28.976967] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-17T17:28:28.977425] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-17T17:28:28.977465] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-17T17:28:28.978366] [DEBUG] [LOCAL ] BAP: Trimmed 37442 records to 26192 (keeping 200 days of data) [2025-10-17T17:28:29.134855] [DEBUG] [LOCAL ] BAP: Primary data saved (26192 records). [2025-10-17T17:28:29.134987] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-17T17:28:29.135064] [INFO ] [MAIN ] Update Progress: 214/2368 symbols completed. BAP took 24.2s. Estimated remaining: 4h 46m 4s. Rate: 7.5 symbols/min [2025-10-17T17:28:29.302723] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:29.354478] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-17T17:28:29.355062] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-10-17T17:28:29.492550] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:28:29.563075] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-17T17:28:29.586444] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:29.588241] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-17T17:28:29.588371] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-17T17:28:29.588625] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-17T17:28:29.588721] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-17T17:28:29.951213] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:30.358089] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-17T17:28:30.845673] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:28:31.089283] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:28:31.157997] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-17T17:28:31.958042] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-17T17:28:32.758070] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-17T17:28:32.855416] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:28:33.201566] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-17T17:28:33.558008] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-17T17:28:33.790210] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:28:34.358025] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-17T17:28:34.823488] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-17T17:28:35.158030] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-17T17:28:35.857249] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:28:35.963843] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-17T17:28:35.969426] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-17T17:28:36.758032] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-17T17:28:37.378075] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T17:28:37.379396] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-17T17:28:37.558030] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-17T17:28:38.358023] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-17T17:28:38.928486] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:28:39.158008] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-17T17:28:39.268978] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-17T17:28:39.958093] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-17T17:28:40.086299] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:28:40.562289] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T17:28:40.567919] [INFO ] [REMOTE ] BARK: Full fetch complete (56314 records). [2025-10-17T17:28:40.568082] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-17T17:28:40.763134] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-17T17:28:40.978102] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-17T17:28:40.978204] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-17T17:28:40.979063] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-17T17:28:40.979149] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-17T17:28:40.981040] [DEBUG] [LOCAL ] BARK: Trimmed 56314 records to 38766 (keeping 200 days of data) [2025-10-17T17:28:41.204537] [DEBUG] [LOCAL ] BARK: Primary data saved (38766 records). [2025-10-17T17:28:41.204715] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-17T17:28:41.204837] [INFO ] [MAIN ] Update Progress: 215/2368 symbols completed. BARK took 26.6s. Estimated remaining: 4h 46m 37s. Rate: 7.5 symbols/min [2025-10-17T17:28:41.369239] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:41.410354] [DEBUG] [LOCAL ] BBAR: Loaded 42696 existing records from primary storage. [2025-10-17T17:28:41.410685] [INFO ] [MAIN ] BBAR: Loaded 42696 existing records. [2025-10-17T17:28:41.563236] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-17T17:28:41.601538] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:41.601899] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-17T17:28:41.601960] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-17T17:28:41.602337] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-17T17:28:41.602393] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-17T17:28:41.965362] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:42.081179] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-17T17:28:42.358009] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-17T17:28:42.516997] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:28:43.158043] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-17T17:28:43.958065] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-17T17:28:44.016553] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T17:28:44.355922] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-17T17:28:44.758084] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-17T17:28:44.917263] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:28:45.558036] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-17T17:28:45.924564] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T17:28:45.972619] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T17:28:46.358065] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-17T17:28:47.158046] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-17T17:28:47.444799] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T17:28:47.904420] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:28:47.957987] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-17T17:28:48.758141] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-17T17:28:49.423282] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:28:49.558786] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-17T17:28:49.558717] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-17T17:28:50.358045] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-17T17:28:50.667725] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:28:51.133637] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:28:51.157976] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-17T17:28:51.958022] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-17T17:28:52.685898] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:28:52.757980] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-17T17:28:53.000425] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-17T17:28:53.558030] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-17T17:28:53.987987] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T17:28:54.324316] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:28:54.357978] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-17T17:28:55.158030] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-17T17:28:55.888565] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:28:55.958002] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-17T17:28:56.202498] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-17T17:28:56.758006] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-17T17:28:56.868141] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T17:28:57.284426] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:28:57.558039] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-17T17:28:58.358050] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-17T17:28:59.158035] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-17T17:28:59.489672] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T17:28:59.573850] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-17T17:28:59.640994] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T17:28:59.958106] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-17T17:29:00.758147] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-17T17:29:01.357934] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-17T17:29:01.558116] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-17T17:29:01.639141] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T17:29:01.645539] [INFO ] [REMOTE ] BBAR: Full fetch complete (61305 records). [2025-10-17T17:29:01.645718] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-17T17:29:02.035372] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-17T17:29:02.035506] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-17T17:29:02.036398] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-17T17:29:02.036471] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-17T17:29:02.038422] [DEBUG] [LOCAL ] BBAR: Trimmed 61305 records to 42985 (keeping 200 days of data) [2025-10-17T17:29:02.312304] [DEBUG] [LOCAL ] BBAR: Primary data saved (42985 records). [2025-10-17T17:29:02.312485] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-17T17:29:02.312587] [INFO ] [MAIN ] Update Progress: 216/2368 symbols completed. BBAR took 21.1s. Estimated remaining: 4h 48m 40s. Rate: 7.5 symbols/min [2025-10-17T17:29:02.358945] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-17T17:29:02.499121] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:02.556667] [DEBUG] [LOCAL ] BBD: Loaded 53650 existing records from primary storage. [2025-10-17T17:29:02.557150] [INFO ] [MAIN ] BBD: Loaded 53650 existing records. [2025-10-17T17:29:02.747908] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:02.748490] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-17T17:29:02.748679] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-17T17:29:02.749125] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-17T17:29:02.749188] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-17T17:29:03.140473] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-17T17:29:03.215536] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-17T17:29:03.241967] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:03.351067] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T17:29:03.958095] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-17T17:29:04.758106] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-17T17:29:05.196097] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-17T17:29:05.512937] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-17T17:29:05.520595] [INFO ] [REMOTE ] BB: Full fetch complete (76989 records). [2025-10-17T17:29:05.520782] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-17T17:29:05.563362] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-17T17:29:05.919154] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T17:29:05.952990] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-17T17:29:05.953176] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-17T17:29:05.954005] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-17T17:29:05.954116] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-17T17:29:05.955518] [DEBUG] [LOCAL ] BB: Trimmed 76989 records to 53673 (keeping 200 days of data) [2025-10-17T17:29:06.251864] [DEBUG] [LOCAL ] BB: Primary data saved (53673 records). [2025-10-17T17:29:06.252073] [INFO ] [MAIN ] BB: Full history saved. [2025-10-17T17:29:06.252731] [INFO ] [MAIN ] Update Progress: 217/2368 symbols completed. BB took 41.2s. Estimated remaining: 4h 47m 51s. Rate: 7.5 symbols/min [2025-10-17T17:29:06.363103] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-17T17:29:06.422814] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:06.423077] [DEBUG] [LOCAL ] BBDC: No existing data file found in primary storage. [2025-10-17T17:29:06.423128] [WARN ] [MAIN ] BBDC: No existing data found, performing full refresh instead. [2025-10-17T17:29:06.423239] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-17T17:29:06.423280] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-17T17:29:06.423321] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-17T17:29:06.423356] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-17T17:29:06.775562] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:06.817968] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T17:29:07.158056] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-17T17:29:07.958103] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-17T17:29:08.068180] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-17T17:29:08.205325] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T17:29:08.667264] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T17:29:08.758049] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-17T17:29:09.557989] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-17T17:29:09.648782] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:29:10.358003] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-17T17:29:10.452151] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:29:10.804172] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:29:11.158048] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-17T17:29:11.933506] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:29:11.958007] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-17T17:29:12.758074] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-17T17:29:13.558081] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-17T17:29:13.766731] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:29:14.120540] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.96 seconds). [2025-10-17T17:29:14.146558] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-17T17:29:14.147038] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-17T17:29:14.148333] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:29:14.364897] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-17T17:29:14.586220] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-17T17:29:14.586316] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-17T17:29:14.587244] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-17T17:29:14.587323] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-17T17:29:14.588933] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-17T17:29:14.901246] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-17T17:29:14.901384] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-17T17:29:14.901462] [INFO ] [MAIN ] Update Progress: 218/2368 symbols completed. BBAI took 45.8s. Estimated remaining: 4h 47m 49s. Rate: 7.5 symbols/min [2025-10-17T17:29:15.068963] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:15.076108] [DEBUG] [LOCAL ] BBDO: Loaded 5066 existing records from primary storage. [2025-10-17T17:29:15.076291] [INFO ] [MAIN ] BBDO: Loaded 5066 existing records. [2025-10-17T17:29:15.164475] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-17T17:29:15.253954] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:15.254163] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-17T17:29:15.254210] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-17T17:29:15.254361] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-17T17:29:15.254399] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-17T17:29:15.636872] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T17:29:15.635732] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:15.644575] [INFO ] [REMOTE ] BAX: Full fetch complete (77614 records). [2025-10-17T17:29:15.644705] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-17T17:29:15.967231] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-17T17:29:16.041715] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-17T17:29:16.041881] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-17T17:29:16.042705] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-17T17:29:16.042770] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-17T17:29:16.044234] [DEBUG] [LOCAL ] BAX: Trimmed 77614 records to 54309 (keeping 200 days of data) [2025-10-17T17:29:16.401737] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T17:29:16.417429] [DEBUG] [LOCAL ] BAX: Primary data saved (54309 records). [2025-10-17T17:29:16.418312] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-17T17:29:16.418474] [INFO ] [MAIN ] Update Progress: 219/2368 symbols completed. BAX took 53.0s. Estimated remaining: 4h 46m 37s. Rate: 7.5 symbols/min [2025-10-17T17:29:16.596399] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T17:29:16.631562] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:16.652142] [DEBUG] [LOCAL ] BBN: Loaded 18148 existing records from primary storage. [2025-10-17T17:29:16.652387] [INFO ] [MAIN ] BBN: Loaded 18148 existing records. [2025-10-17T17:29:16.763121] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-17T17:29:16.838094] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:16.838428] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-17T17:29:16.838479] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-17T17:29:16.838801] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-17T17:29:16.838859] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-17T17:29:17.024702] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T17:29:17.213819] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:17.558053] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-17T17:29:18.336425] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:29:18.357980] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-17T17:29:18.759735] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T17:29:19.158075] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-17T17:29:19.820471] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T17:29:19.834469] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:29:19.958044] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-17T17:29:20.758045] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-17T17:29:20.925581] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T17:29:21.558032] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-17T17:29:22.172570] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:29:22.358048] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-17T17:29:22.472832] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T17:29:23.158040] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-17T17:29:23.337344] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T17:29:23.958049] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-17T17:29:24.111495] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T17:29:24.758022] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-17T17:29:25.210980] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T17:29:25.558017] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-17T17:29:25.796937] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:29:26.358027] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-17T17:29:27.035480] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:29:27.158086] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-17T17:29:27.882801] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T17:29:27.958011] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-17T17:29:28.160786] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T17:29:28.628806] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T17:29:28.758025] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-17T17:29:29.558041] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-17T17:29:30.255293] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T17:29:30.260748] [INFO ] [REMOTE ] BBDC: Full fetch complete (48854 records). [2025-10-17T17:29:30.260845] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-17T17:29:30.363902] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-17T17:29:30.656069] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-17T17:29:30.656151] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-17T17:29:30.656772] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-17T17:29:30.656837] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-17T17:29:30.657891] [DEBUG] [LOCAL ] BBDC: Trimmed 48854 records to 33616 (keeping 200 days of data) [2025-10-17T17:29:30.855933] [DEBUG] [LOCAL ] BBDC: Primary data saved (33616 records). [2025-10-17T17:29:30.856286] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-17T17:29:30.856404] [INFO ] [MAIN ] Update Progress: 220/2368 symbols completed. BBDC took 24.6s. Estimated remaining: 4h 47m 32s. Rate: 7.5 symbols/min [2025-10-17T17:29:31.055831] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:31.057627] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-17T17:29:31.057488] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T17:29:31.057754] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-17T17:29:31.058009] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-17T17:29:31.068559] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-17T17:29:31.068633] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-17T17:29:31.068713] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-17T17:29:31.163402] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-17T17:29:31.190498] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T17:29:31.429573] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:31.958035] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-17T17:29:32.164170] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:29:32.164474] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-17T17:29:32.164562] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:29:32.164608] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-17T17:29:32.164663] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:29:32.164728] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-17T17:29:32.164787] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-17T17:29:32.164839] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-17T17:29:32.164880] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-17T17:29:32.164926] [INFO ] [MAIN ] Update Progress: 221/2368 symbols completed. BBT took 1.3s. Estimated remaining: 4h 46m 18s. Rate: 7.5 symbols/min [2025-10-17T17:29:32.342089] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:32.342507] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-17T17:29:32.342838] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-17T17:29:32.343002] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-17T17:29:32.343076] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-17T17:29:32.343149] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-17T17:29:32.343219] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-17T17:29:32.696305] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:32.758016] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-17T17:29:32.964176] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:29:33.558037] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-17T17:29:33.606491] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:29:34.173438] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-17T17:29:34.358024] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-17T17:29:34.842696] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T17:29:35.158032] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-17T17:29:35.819748] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T17:29:35.958041] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-17T17:29:36.522028] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:29:36.757997] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-17T17:29:37.398857] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T17:29:37.558064] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-17T17:29:38.358046] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-17T17:29:39.134839] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T17:29:39.136222] [INFO ] [REMOTE ] BBDO: Full fetch complete (7492 records). [2025-10-17T17:29:39.136291] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-17T17:29:39.167266] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-17T17:29:39.510332] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-17T17:29:39.510466] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-17T17:29:39.510810] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-17T17:29:39.510983] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-17T17:29:39.523221] [DEBUG] [LOCAL ] BBDO: Trimmed 7492 records to 5104 (keeping 200 days of data) [2025-10-17T17:29:39.559353] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T17:29:39.591182] [DEBUG] [LOCAL ] BBDO: Primary data saved (5104 records). [2025-10-17T17:29:39.591328] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-17T17:29:39.591416] [INFO ] [MAIN ] Update Progress: 222/2368 symbols completed. BBDO took 24.7s. Estimated remaining: 4h 46m 5s. Rate: 7.5 symbols/min [2025-10-17T17:29:39.761555] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:39.776751] [DEBUG] [LOCAL ] BBUC: Loaded 13949 existing records from primary storage. [2025-10-17T17:29:39.776987] [INFO ] [MAIN ] BBUC: Loaded 13949 existing records. [2025-10-17T17:29:39.844525] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:29:39.963391] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-17T17:29:39.963244] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:39.964863] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-17T17:29:39.964951] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-17T17:29:39.965190] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-17T17:29:39.965247] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-17T17:29:40.329066] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:40.758037] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-17T17:29:41.558068] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-17T17:29:41.832706] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:29:41.964813] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:29:42.141388] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T17:29:42.358110] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-17T17:29:43.102113] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T17:29:43.158108] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-17T17:29:43.842446] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T17:29:43.958032] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-17T17:29:44.758044] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-17T17:29:45.528363] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:29:45.558016] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-17T17:29:45.755236] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:29:45.763444] [INFO ] [REMOTE ] BBD: Full fetch complete (77276 records). [2025-10-17T17:29:45.763693] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-17T17:29:46.165617] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-17T17:29:46.165865] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-17T17:29:46.166828] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-17T17:29:46.166897] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-17T17:29:46.168533] [DEBUG] [LOCAL ] BBD: Trimmed 77276 records to 54039 (keeping 200 days of data) [2025-10-17T17:29:46.352041] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T17:29:46.377724] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-17T17:29:46.500102] [DEBUG] [LOCAL ] BBD: Primary data saved (54039 records). [2025-10-17T17:29:46.500272] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-17T17:29:46.500359] [INFO ] [MAIN ] Update Progress: 223/2368 symbols completed. BBD took 44.2s. Estimated remaining: 4h 45m 46s. Rate: 7.5 symbols/min [2025-10-17T17:29:46.665205] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:46.712849] [DEBUG] [LOCAL ] BBVA: Loaded 49475 existing records from primary storage. [2025-10-17T17:29:46.713202] [INFO ] [MAIN ] BBVA: Loaded 49475 existing records. [2025-10-17T17:29:46.895215] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:46.895464] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-17T17:29:46.895513] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-17T17:29:46.895914] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-17T17:29:46.895999] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-17T17:29:46.992841] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T17:29:47.163735] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-17T17:29:47.258725] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:47.673234] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:29:47.958056] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-17T17:29:48.758073] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-17T17:29:48.999271] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:29:49.558066] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-17T17:29:50.101876] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T17:29:50.358085] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-17T17:29:50.588134] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:29:50.645220] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-17T17:29:51.158099] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-17T17:29:51.958048] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-17T17:29:52.395448] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:29:52.662047] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T17:29:52.758086] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-17T17:29:53.417259] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T17:29:53.558068] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-17T17:29:54.358098] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-17T17:29:54.467139] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T17:29:55.158036] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-17T17:29:55.489727] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:29:55.958087] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-17T17:29:56.081390] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T17:29:56.083782] [INFO ] [REMOTE ] BBU: Full fetch complete (7445 records). [2025-10-17T17:29:56.083854] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-17T17:29:56.431564] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-17T17:29:56.431662] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-17T17:29:56.431873] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-17T17:29:56.431914] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-17T17:29:56.432307] [DEBUG] [LOCAL ] BBU: Trimmed 7445 records to 5708 (keeping 200 days of data) [2025-10-17T17:29:56.465056] [DEBUG] [LOCAL ] BBU: Primary data saved (5708 records). [2025-10-17T17:29:56.465181] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-17T17:29:56.465252] [INFO ] [MAIN ] Update Progress: 224/2368 symbols completed. BBU took 24.3s. Estimated remaining: 4h 45m 57s. Rate: 7.5 symbols/min [2025-10-17T17:29:56.634956] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:56.674081] [DEBUG] [LOCAL ] BBW: Loaded 27636 existing records from primary storage. [2025-10-17T17:29:56.674332] [INFO ] [MAIN ] BBW: Loaded 27636 existing records. [2025-10-17T17:29:56.763285] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-17T17:29:56.854924] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:56.855229] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-17T17:29:56.855279] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-17T17:29:56.855633] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-17T17:29:56.855735] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-17T17:29:57.219853] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:57.558046] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-17T17:29:57.641692] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:29:57.945709] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:29:57.948113] [INFO ] [REMOTE ] BBN: Full fetch complete (25376 records). [2025-10-17T17:29:57.948195] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-17T17:29:58.342604] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-17T17:29:58.342708] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-17T17:29:58.343091] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-17T17:29:58.343133] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-17T17:29:58.343790] [DEBUG] [LOCAL ] BBN: Trimmed 25376 records to 18233 (keeping 200 days of data) [2025-10-17T17:29:58.390040] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-17T17:29:58.455671] [DEBUG] [LOCAL ] BBN: Primary data saved (18233 records). [2025-10-17T17:29:58.455837] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-17T17:29:58.455934] [INFO ] [MAIN ] Update Progress: 225/2368 symbols completed. BBN took 42.0s. Estimated remaining: 4h 44m 52s. Rate: 7.5 symbols/min [2025-10-17T17:29:58.622813] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:58.674947] [DEBUG] [LOCAL ] BBWI: Loaded 53974 existing records from primary storage. [2025-10-17T17:29:58.675280] [INFO ] [MAIN ] BBWI: Loaded 53974 existing records. [2025-10-17T17:29:58.853465] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:58.853819] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-17T17:29:58.853881] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-17T17:29:58.854398] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-17T17:29:58.854437] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-17T17:29:59.132686] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:29:59.160166] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-17T17:29:59.244614] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:59.358767] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:29:59.958043] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-17T17:30:00.758109] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-17T17:30:01.310270] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T17:30:01.558048] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-17T17:30:01.857666] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:30:02.330588] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:30:02.357997] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-17T17:30:03.158084] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-17T17:30:03.547699] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:30:03.958006] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-17T17:30:04.266019] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T17:30:04.301340] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:30:04.758044] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-17T17:30:05.549293] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:30:05.557975] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-17T17:30:06.358002] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-17T17:30:06.678462] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T17:30:06.717093] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T17:30:06.935795] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T17:30:07.158042] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-17T17:30:07.957999] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-17T17:30:08.329938] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T17:30:08.758078] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-17T17:30:09.558007] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-17T17:30:09.805502] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T17:30:10.099808] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T17:30:10.358071] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-17T17:30:11.158003] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-17T17:30:11.442305] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T17:30:11.958048] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-17T17:30:12.308550] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T17:30:12.577679] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T17:30:12.758026] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-17T17:30:13.558061] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-17T17:30:13.590275] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T17:30:13.710162] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:30:14.358032] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-17T17:30:14.773837] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T17:30:15.158044] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-17T17:30:15.450323] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T17:30:15.958030] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-17T17:30:16.471611] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T17:30:16.758083] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-17T17:30:17.189976] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T17:30:17.193133] [INFO ] [REMOTE ] BBUC: Full fetch complete (19110 records). [2025-10-17T17:30:17.193222] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-17T17:30:17.558574] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-17T17:30:17.588343] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-17T17:30:17.588425] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-17T17:30:17.588829] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-17T17:30:17.588891] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-17T17:30:17.589474] [DEBUG] [LOCAL ] BBUC: Trimmed 19110 records to 14077 (keeping 200 days of data) [2025-10-17T17:30:17.680994] [DEBUG] [LOCAL ] BBUC: Primary data saved (14077 records). [2025-10-17T17:30:17.681141] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-17T17:30:17.681227] [INFO ] [MAIN ] Update Progress: 226/2368 symbols completed. BBUC took 38.1s. Estimated remaining: 4h 46m 31s. Rate: 7.5 symbols/min [2025-10-17T17:30:17.852250] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:17.915496] [DEBUG] [LOCAL ] BBY: Loaded 53831 existing records from primary storage. [2025-10-17T17:30:17.915881] [INFO ] [MAIN ] BBY: Loaded 53831 existing records. [2025-10-17T17:30:18.099630] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:18.099897] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-17T17:30:18.099948] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-17T17:30:18.100506] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-17T17:30:18.100565] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-17T17:30:18.362491] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-17T17:30:18.485480] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:18.512682] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T17:30:18.539323] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T17:30:19.158024] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-17T17:30:19.958003] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-17T17:30:20.206747] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T17:30:20.758000] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-17T17:30:20.950231] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T17:30:21.326516] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T17:30:21.558026] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-17T17:30:22.358009] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-17T17:30:22.588146] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T17:30:22.713272] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:30:23.158049] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-17T17:30:23.957992] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-17T17:30:24.060323] [DEBUG] [REMOTE ] BBWI: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T17:30:24.060663] [WARN ] [REMOTE ] BBWI: No data returned for month 2025-07 [2025-10-17T17:30:24.060756] [FATAL] [REMOTE ] BBWI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:30:24.060844] [FATAL] [MAIN ] BBWI: Failed to fetch primary data. [2025-10-17T17:30:24.060909] [WARN ] [MAIN ] BBWI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:30:24.060999] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-17T17:30:24.061103] [DEBUG] [LOCAL ] BBWI: No primary data file found to delete. [2025-10-17T17:30:24.061148] [INFO ] [LOCAL ] BBWI: Starting deletion of derivative data. [2025-10-17T17:30:24.061300] [DEBUG] [LOCAL ] BBWI: Deleted derivative data file. [2025-10-17T17:30:24.061384] [INFO ] [MAIN ] Update Progress: 227/2368 symbols completed. BBWI took 25.6s. Estimated remaining: 4h 46m 7s. Rate: 7.5 symbols/min [2025-10-17T17:30:24.247809] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:24.248075] [DEBUG] [LOCAL ] BC: No existing data file found in primary storage. [2025-10-17T17:30:24.248197] [WARN ] [MAIN ] BC: No existing data found, performing full refresh instead. [2025-10-17T17:30:24.248346] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-17T17:30:24.248497] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-17T17:30:24.248599] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-17T17:30:24.248682] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-17T17:30:24.390986] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T17:30:24.664454] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:24.758015] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-17T17:30:25.484709] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-17T17:30:25.557995] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-17T17:30:26.314506] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T17:30:26.358009] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-17T17:30:27.158054] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-17T17:30:27.316942] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T17:30:27.906079] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:30:27.957986] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-17T17:30:28.594903] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T17:30:28.600058] [INFO ] [REMOTE ] BBW: Full fetch complete (39754 records). [2025-10-17T17:30:28.600157] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-17T17:30:28.760401] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-17T17:30:28.986512] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-17T17:30:28.986604] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-17T17:30:28.987145] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-17T17:30:28.987212] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-17T17:30:28.988284] [DEBUG] [LOCAL ] BBW: Trimmed 39754 records to 27830 (keeping 200 days of data) [2025-10-17T17:30:29.161686] [DEBUG] [LOCAL ] BBW: Primary data saved (27830 records). [2025-10-17T17:30:29.161840] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-17T17:30:29.161968] [INFO ] [MAIN ] Update Progress: 228/2368 symbols completed. BBW took 32.7s. Estimated remaining: 4h 45m 32s. Rate: 7.5 symbols/min [2025-10-17T17:30:29.337007] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:29.395767] [DEBUG] [LOCAL ] BCAT: Loaded 34487 existing records from primary storage. [2025-10-17T17:30:29.397942] [INFO ] [MAIN ] BCAT: Loaded 34487 existing records. [2025-10-17T17:30:29.397752] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:30:29.564350] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-17T17:30:29.588752] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:29.589019] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-17T17:30:29.589069] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-17T17:30:29.589408] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-17T17:30:29.589449] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-17T17:30:29.936966] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:30.358066] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-17T17:30:30.496093] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T17:30:30.965967] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:30:31.158019] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-17T17:30:31.839329] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T17:30:31.958051] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-17T17:30:32.758036] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-17T17:30:33.354373] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T17:30:33.362405] [INFO ] [REMOTE ] BBVA: Full fetch complete (71805 records). [2025-10-17T17:30:33.362629] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-17T17:30:33.570761] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-17T17:30:33.809390] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-17T17:30:33.821604] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-17T17:30:33.823466] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-17T17:30:33.825117] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-17T17:30:33.824691] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:30:33.835259] [DEBUG] [LOCAL ] BBVA: Trimmed 71805 records to 49862 (keeping 200 days of data) [2025-10-17T17:30:34.167432] [DEBUG] [LOCAL ] BBVA: Primary data saved (49862 records). [2025-10-17T17:30:34.167636] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-17T17:30:34.167784] [INFO ] [MAIN ] Update Progress: 229/2368 symbols completed. BBVA took 47.7s. Estimated remaining: 4h 44m 56s. Rate: 7.5 symbols/min [2025-10-17T17:30:34.360077] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-17T17:30:34.407680] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:34.448483] [DEBUG] [LOCAL ] BCC: Loaded 28737 existing records from primary storage. [2025-10-17T17:30:34.448973] [INFO ] [MAIN ] BCC: Loaded 28737 existing records. [2025-10-17T17:30:34.695358] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:34.717898] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-17T17:30:34.718132] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-17T17:30:34.718942] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-17T17:30:34.721241] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-17T17:30:34.721120] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T17:30:35.116779] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:35.158008] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-17T17:30:35.332068] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:30:35.763785] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:30:35.958023] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-17T17:30:36.653383] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:30:36.757998] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-17T17:30:37.442265] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:30:37.558036] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-17T17:30:38.223325] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:30:38.358002] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-17T17:30:39.158000] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-17T17:30:39.394466] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T17:30:39.840245] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:30:39.957992] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-17T17:30:40.379838] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T17:30:40.758018] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-17T17:30:41.463600] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T17:30:41.557996] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-17T17:30:42.358022] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-17T17:30:43.024459] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T17:30:43.059886] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:30:43.158046] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-17T17:30:43.958105] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-17T17:30:43.987632] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T17:30:44.758071] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-17T17:30:44.858367] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T17:30:44.865026] [INFO ] [REMOTE ] BC: Full fetch complete (63667 records). [2025-10-17T17:30:44.865283] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-17T17:30:45.257561] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:30:45.279717] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-17T17:30:45.280214] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-17T17:30:45.281090] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-17T17:30:45.281179] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-17T17:30:45.282580] [DEBUG] [LOCAL ] BC: Trimmed 63667 records to 44654 (keeping 200 days of data) [2025-10-17T17:30:45.549775] [DEBUG] [LOCAL ] BC: Primary data saved (44654 records). [2025-10-17T17:30:45.549941] [INFO ] [MAIN ] BC: Full history saved. [2025-10-17T17:30:45.550064] [INFO ] [MAIN ] Update Progress: 230/2368 symbols completed. BC took 21.5s. Estimated remaining: 4h 45m 19s. Rate: 7.5 symbols/min [2025-10-17T17:30:45.563289] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-17T17:30:45.719606] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:45.769573] [DEBUG] [LOCAL ] BCE: Loaded 52634 existing records from primary storage. [2025-10-17T17:30:45.769935] [INFO ] [MAIN ] BCE: Loaded 52634 existing records. [2025-10-17T17:30:45.943070] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:45.943537] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-17T17:30:45.943699] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-17T17:30:45.944327] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-17T17:30:45.944395] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-17T17:30:46.316966] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:30:46.321471] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:46.357983] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-17T17:30:47.158024] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-17T17:30:47.378131] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T17:30:47.958029] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-17T17:30:48.490979] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T17:30:48.664509] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T17:30:48.758021] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-17T17:30:49.558013] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-17T17:30:49.918807] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T17:30:50.012670] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:30:50.358065] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-17T17:30:51.158049] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-17T17:30:51.178108] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:30:51.958049] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-17T17:30:52.397244] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:30:52.758070] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-17T17:30:52.986706] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:30:53.092064] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T17:30:53.558034] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-17T17:30:54.358065] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-17T17:30:54.619834] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T17:30:54.958996] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:30:55.158080] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-17T17:30:55.504136] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T17:30:55.958113] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-17T17:30:56.684579] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:30:56.758052] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-17T17:30:57.558045] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-17T17:30:57.832598] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:30:58.266728] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T17:30:58.358014] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-17T17:30:59.158046] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-17T17:30:59.562579] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T17:30:59.841563] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:30:59.846690] [INFO ] [REMOTE ] BCAT: Full fetch complete (50025 records). [2025-10-17T17:30:59.846835] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-17T17:30:59.963243] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-17T17:31:00.234165] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-17T17:31:00.234292] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-17T17:31:00.235061] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-17T17:31:00.235130] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-17T17:31:00.236808] [DEBUG] [LOCAL ] BCAT: Trimmed 50025 records to 34802 (keeping 200 days of data) [2025-10-17T17:31:00.466300] [DEBUG] [LOCAL ] BCAT: Primary data saved (34802 records). [2025-10-17T17:31:00.466566] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-17T17:31:00.466810] [INFO ] [MAIN ] Update Progress: 231/2368 symbols completed. BCAT took 31.3s. Estimated remaining: 4h 46m 15s. Rate: 7.5 symbols/min [2025-10-17T17:31:00.659584] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:00.659895] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-17T17:31:00.659955] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-17T17:31:00.660098] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-17T17:31:00.660141] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-17T17:31:00.660184] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-17T17:31:00.660218] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-17T17:31:00.763407] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-17T17:31:01.062312] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:01.451788] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-17T17:31:01.459269] [INFO ] [REMOTE ] BBY: Full fetch complete (77399 records). [2025-10-17T17:31:01.459405] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-17T17:31:01.561178] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-17T17:31:01.918968] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T17:31:01.919325] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-17T17:31:01.919701] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-17T17:31:01.926995] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-17T17:31:01.928105] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-17T17:31:01.931302] [DEBUG] [LOCAL ] BBY: Trimmed 77399 records to 54218 (keeping 200 days of data) [2025-10-17T17:31:02.265076] [DEBUG] [LOCAL ] BBY: Primary data saved (54218 records). [2025-10-17T17:31:02.265214] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-17T17:31:02.265295] [INFO ] [MAIN ] Update Progress: 232/2368 symbols completed. BBY took 44.6s. Estimated remaining: 4h 45m 10s. Rate: 7.5 symbols/min [2025-10-17T17:31:02.362724] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-17T17:31:02.438546] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:02.465012] [DEBUG] [LOCAL ] BCO: Loaded 25583 existing records from primary storage. [2025-10-17T17:31:02.465273] [INFO ] [MAIN ] BCO: Loaded 25583 existing records. [2025-10-17T17:31:02.652636] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:02.653244] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-17T17:31:02.653445] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-17T17:31:02.653745] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-17T17:31:02.663788] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-17T17:31:02.724919] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:31:02.821016] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:31:03.093462] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:03.158045] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-17T17:31:03.615160] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:31:03.958045] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-17T17:31:04.220957] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T17:31:04.758053] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-17T17:31:05.325082] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:31:05.558003] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-17T17:31:05.846150] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T17:31:06.358111] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-17T17:31:06.877712] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T17:31:07.158103] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-17T17:31:07.958026] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-17T17:31:08.216984] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T17:31:08.354695] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T17:31:08.758027] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-17T17:31:09.212827] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T17:31:09.558021] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-17T17:31:10.102592] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T17:31:10.358072] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-17T17:31:11.038195] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T17:31:11.158019] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-17T17:31:11.590116] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T17:31:11.958037] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-17T17:31:12.483128] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:31:12.758052] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-17T17:31:13.349248] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T17:31:13.558024] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-17T17:31:14.049148] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:31:14.358056] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-17T17:31:14.638342] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T17:31:15.158035] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-17T17:31:15.877081] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:31:15.881809] [INFO ] [REMOTE ] BCC: Full fetch complete (41136 records). [2025-10-17T17:31:15.881947] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-17T17:31:15.882639] [FATAL] [VALIDATOR ] BCC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:31:15.882752] [FATAL] [MAIN ] BCC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:31:15.882813] [WARN ] [MAIN ] BCC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:31:15.882859] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-17T17:31:15.882915] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-17T17:31:15.882950] [INFO ] [LOCAL ] BCC: Starting deletion of derivative data. [2025-10-17T17:31:15.883072] [DEBUG] [LOCAL ] BCC: Deleted derivative data file. [2025-10-17T17:31:15.883144] [INFO ] [MAIN ] Update Progress: 233/2368 symbols completed. BCC took 41.7s. Estimated remaining: 4h 45m 53s. Rate: 7.5 symbols/min [2025-10-17T17:31:15.963169] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-17T17:31:16.059830] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:16.113715] [DEBUG] [LOCAL ] BCS: Loaded 53832 existing records from primary storage. [2025-10-17T17:31:16.114056] [INFO ] [MAIN ] BCS: Loaded 53832 existing records. [2025-10-17T17:31:16.298247] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:16.298530] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-17T17:31:16.298582] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-17T17:31:16.299072] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-17T17:31:16.299139] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-17T17:31:16.713050] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:16.716495] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:31:16.758022] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-17T17:31:17.274027] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:31:17.558106] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-17T17:31:18.358073] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-17T17:31:18.705321] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T17:31:18.789452] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T17:31:19.158028] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-17T17:31:19.815682] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T17:31:19.958032] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-17T17:31:20.447937] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T17:31:20.758063] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-17T17:31:21.558025] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-17T17:31:21.669451] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T17:31:22.183325] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T17:31:22.188931] [INFO ] [REMOTE ] BCH: Full fetch complete (41965 records). [2025-10-17T17:31:22.189077] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-17T17:31:22.363872] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-17T17:31:22.589975] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-17T17:31:22.590066] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-17T17:31:22.590593] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-17T17:31:22.590637] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-17T17:31:22.591745] [DEBUG] [LOCAL ] BCH: Trimmed 41965 records to 30818 (keeping 200 days of data) [2025-10-17T17:31:22.770301] [DEBUG] [LOCAL ] BCH: Primary data saved (30818 records). [2025-10-17T17:31:22.770454] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-17T17:31:22.770530] [INFO ] [MAIN ] Update Progress: 234/2368 symbols completed. BCH took 22.3s. Estimated remaining: 4h 45m 34s. Rate: 7.5 symbols/min [2025-10-17T17:31:22.941046] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:22.976029] [DEBUG] [LOCAL ] BCSF: Loaded 28381 existing records from primary storage. [2025-10-17T17:31:22.976451] [INFO ] [MAIN ] BCSF: Loaded 28381 existing records. [2025-10-17T17:31:23.162250] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:23.158568] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-17T17:31:23.162901] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-17T17:31:23.163994] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-17T17:31:23.164375] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-17T17:31:23.164434] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-17T17:31:23.536354] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T17:31:23.567802] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:23.958065] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-17T17:31:24.180581] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T17:31:24.685381] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:31:24.758041] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-17T17:31:24.860959] [DEBUG] [REMOTE ] BCO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T17:31:24.861280] [WARN ] [REMOTE ] BCO: No data returned for month 2025-05 [2025-10-17T17:31:24.861371] [FATAL] [REMOTE ] BCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:31:24.861454] [FATAL] [MAIN ] BCO: Failed to fetch primary data. [2025-10-17T17:31:24.861521] [WARN ] [MAIN ] BCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:31:24.861598] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-17T17:31:24.861691] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-10-17T17:31:24.861751] [INFO ] [LOCAL ] BCO: Starting deletion of derivative data. [2025-10-17T17:31:24.861902] [DEBUG] [LOCAL ] BCO: Deleted derivative data file. [2025-10-17T17:31:24.861992] [INFO ] [MAIN ] Update Progress: 235/2368 symbols completed. BCO took 22.6s. Estimated remaining: 4h 44m 33s. Rate: 7.5 symbols/min [2025-10-17T17:31:25.036108] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:25.036346] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-10-17T17:31:25.036391] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-10-17T17:31:25.036506] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-17T17:31:25.036547] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-17T17:31:25.036591] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-17T17:31:25.036623] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-17T17:31:25.408872] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:25.518330] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T17:31:25.558016] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-17T17:31:26.358047] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-17T17:31:26.847105] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T17:31:27.158025] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-17T17:31:27.958021] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-17T17:31:28.119082] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T17:31:28.126330] [INFO ] [REMOTE ] BCE: Full fetch complete (76118 records). [2025-10-17T17:31:28.126477] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-17T17:31:28.578973] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-17T17:31:28.579126] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-17T17:31:28.586010] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-17T17:31:28.586139] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-17T17:31:28.599753] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T17:31:28.606354] [DEBUG] [LOCAL ] BCE: Trimmed 76118 records to 53022 (keeping 200 days of data) [2025-10-17T17:31:28.781763] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-17T17:31:28.945220] [DEBUG] [LOCAL ] BCE: Primary data saved (53022 records). [2025-10-17T17:31:28.945377] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-17T17:31:28.945463] [INFO ] [MAIN ] Update Progress: 236/2368 symbols completed. BCE took 43.4s. Estimated remaining: 4h 43m 49s. Rate: 7.5 symbols/min [2025-10-17T17:31:29.131266] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:29.156594] [DEBUG] [LOCAL ] BDC: Loaded 24680 existing records from primary storage. [2025-10-17T17:31:29.156880] [INFO ] [MAIN ] BDC: Loaded 24680 existing records. [2025-10-17T17:31:29.338887] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:29.339098] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-17T17:31:29.339147] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-17T17:31:29.339473] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-17T17:31:29.339530] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-17T17:31:29.564370] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-17T17:31:29.707388] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:29.996067] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T17:31:30.083202] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:31:30.358036] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-17T17:31:30.473934] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T17:31:31.158014] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-17T17:31:31.286599] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T17:31:31.958023] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-17T17:31:32.302512] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T17:31:32.758003] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-17T17:31:33.141768] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:31:33.558026] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-17T17:31:34.358073] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-17T17:31:34.575063] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:31:34.614139] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:31:35.158017] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-17T17:31:35.469874] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T17:31:35.958099] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-17T17:31:36.758012] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-17T17:31:37.113787] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T17:31:37.148750] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T17:31:37.558025] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-17T17:31:38.042795] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:31:38.358045] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-17T17:31:38.585600] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:31:39.158051] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-17T17:31:39.958015] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-17T17:31:40.259773] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T17:31:40.421634] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:31:40.758004] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-17T17:31:41.049250] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:31:41.558031] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-17T17:31:42.358068] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-17T17:31:42.532441] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T17:31:42.724921] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T17:31:43.158034] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-17T17:31:43.559826] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T17:31:43.958036] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-17T17:31:44.758047] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-17T17:31:44.953355] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T17:31:45.101464] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:31:45.558071] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-17T17:31:46.200818] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T17:31:46.358052] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-17T17:31:46.778737] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T17:31:46.782889] [INFO ] [REMOTE ] BCX: Full fetch complete (33802 records). [2025-10-17T17:31:46.782979] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-17T17:31:47.170560] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-17T17:31:47.187152] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-17T17:31:47.187300] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-17T17:31:47.187851] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-17T17:31:47.187949] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-17T17:31:47.188949] [DEBUG] [LOCAL ] BCX: Trimmed 33802 records to 22404 (keeping 200 days of data) [2025-10-17T17:31:47.330341] [DEBUG] [LOCAL ] BCX: Primary data saved (22404 records). [2025-10-17T17:31:47.330475] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-17T17:31:47.330548] [INFO ] [MAIN ] Update Progress: 237/2368 symbols completed. BCX took 22.5s. Estimated remaining: 4h 45m 15s. Rate: 7.5 symbols/min [2025-10-17T17:31:47.551696] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T17:31:47.958102] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-17T17:31:48.069987] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T17:31:48.758099] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-17T17:31:49.558016] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-17T17:31:49.890511] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T17:31:49.997235] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T17:31:50.358035] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-17T17:31:50.434452] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T17:31:51.158053] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-17T17:31:51.958067] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-17T17:31:52.098760] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T17:31:52.365452] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T17:31:52.373095] [INFO ] [REMOTE ] BCS: Full fetch complete (77513 records). [2025-10-17T17:31:52.373254] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-17T17:31:52.765914] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-17T17:31:52.765242] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-17T17:31:52.766797] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-17T17:31:52.767687] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-17T17:31:52.767846] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-17T17:31:52.769489] [DEBUG] [LOCAL ] BCS: Trimmed 77513 records to 54222 (keeping 200 days of data) [2025-10-17T17:31:53.104708] [DEBUG] [LOCAL ] BCS: Primary data saved (54222 records). [2025-10-17T17:31:53.104867] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-17T17:31:53.104950] [INFO ] [MAIN ] Update Progress: 238/2368 symbols completed. BCS took 37.2s. Estimated remaining: 4h 44m 46s. Rate: 7.5 symbols/min [2025-10-17T17:31:53.308762] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T17:31:53.558027] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-17T17:31:54.175472] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:31:54.358022] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-17T17:31:54.665722] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T17:31:55.158076] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-17T17:31:55.520819] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:31:55.958069] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-17T17:31:56.570481] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T17:31:56.758062] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-17T17:31:57.159350] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T17:31:57.558138] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-17T17:31:58.082697] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T17:31:58.088077] [INFO ] [REMOTE ] BCSF: Full fetch complete (39642 records). [2025-10-17T17:31:58.088214] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-17T17:31:58.514197] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-17T17:31:58.514310] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-17T17:31:58.515189] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-17T17:31:58.515260] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-17T17:31:58.516540] [DEBUG] [LOCAL ] BCSF: Trimmed 39642 records to 28764 (keeping 200 days of data) [2025-10-17T17:31:58.703230] [DEBUG] [LOCAL ] BCSF: Primary data saved (28764 records). [2025-10-17T17:31:58.703574] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-17T17:31:58.709537] [INFO ] [MAIN ] Update Progress: 239/2368 symbols completed. BCSF took 35.9s. Estimated remaining: 4h 44m 17s. Rate: 7.5 symbols/min [2025-10-17T17:31:58.719122] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:31:58.724624] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-17T17:31:59.841305] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:31:59.844927] [INFO ] [REMOTE ] BDC: Full fetch complete (35859 records). [2025-10-17T17:31:59.845060] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-17T17:32:00.214963] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-17T17:32:00.215088] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-17T17:32:00.215558] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-17T17:32:00.215603] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-17T17:32:00.216399] [DEBUG] [LOCAL ] BDC: Trimmed 35859 records to 24777 (keeping 200 days of data) [2025-10-17T17:32:00.368394] [DEBUG] [LOCAL ] BDC: Primary data saved (24777 records). [2025-10-17T17:32:00.368529] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-17T17:32:00.368612] [INFO ] [MAIN ] Update Progress: 240/2368 symbols completed. BDC took 31.4s. Estimated remaining: 4h 43m 13s. Rate: 7.5 symbols/min [2025-10-17T17:32:01.085544] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.141332] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.080941] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.144454] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.209600] [DEBUG] [LOCAL ] BDJ: Loaded 29694 existing records from primary storage. [2025-10-17T17:32:01.211525] [INFO ] [MAIN ] BDJ: Loaded 29694 existing records. [2025-10-17T17:32:01.365949] [DEBUG] [LOCAL ] BE: Loaded 54051 existing records from primary storage. [2025-10-17T17:32:01.349417] [DEBUG] [LOCAL ] BDN: Loaded 48013 existing records from primary storage. [2025-10-17T17:32:01.383265] [INFO ] [MAIN ] BE: Loaded 54051 existing records. [2025-10-17T17:32:01.387315] [INFO ] [MAIN ] BDN: Loaded 48013 existing records. [2025-10-17T17:32:01.558099] [DEBUG] [LOCAL ] BDX: Loaded 52564 existing records from primary storage. [2025-10-17T17:32:01.688405] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:01.731940] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-17T17:32:01.721420] [INFO ] [MAIN ] BDX: Loaded 52564 existing records. [2025-10-17T17:32:01.737507] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-17T17:32:01.837690] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-17T17:32:01.881710] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-17T17:32:01.910243] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:02.025461] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-17T17:32:02.089960] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-17T17:32:02.206092] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-17T17:32:02.232361] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:02.264633] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-17T17:32:02.275142] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-17T17:32:02.418851] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:02.351024] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-17T17:32:02.517383] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-17T17:32:02.517686] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-17T17:32:02.480248] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-17T17:32:02.536267] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-17T17:32:02.674411] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-17T17:32:02.784226] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-17T17:32:03.263097] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.346544] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-17T17:32:03.631445] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.681882] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-17T17:32:03.739735] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.742913] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-17T17:32:03.823916] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.824219] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-17T17:32:04.895503] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:32:04.902070] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-17T17:32:05.531592] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:32:05.541461] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-17T17:32:05.722475] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:32:05.733372] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-17T17:32:05.786552] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T17:32:05.793334] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-17T17:32:05.852134] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-17T17:32:05.863051] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-17T17:32:06.971151] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T17:32:06.977163] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-17T17:32:07.207006] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T17:32:07.216855] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-17T17:32:07.449224] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:32:07.698362] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T17:32:07.781335] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T17:32:07.958014] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-17T17:32:08.409622] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T17:32:08.758094] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-17T17:32:09.558258] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-17T17:32:09.887409] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T17:32:10.045986] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T17:32:10.358039] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-17T17:32:11.105465] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:32:11.158005] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-17T17:32:11.228238] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T17:32:11.958055] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-17T17:32:12.758015] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-17T17:32:12.921638] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:32:13.558039] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-17T17:32:14.250977] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T17:32:14.296265] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T17:32:14.358039] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-17T17:32:15.158006] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-17T17:32:15.560686] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T17:32:15.958003] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-17T17:32:16.051325] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:32:16.542727] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:32:16.758036] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-17T17:32:17.558024] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-17T17:32:17.865734] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:32:18.358017] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-17T17:32:18.424578] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:32:18.769373] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T17:32:19.158028] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-17T17:32:19.958060] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-17T17:32:20.411040] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T17:32:20.758084] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-17T17:32:21.558019] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-17T17:32:21.653446] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:32:21.721144] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:32:21.762997] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-17T17:32:22.358065] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-17T17:32:23.158000] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-17T17:32:23.296299] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:32:23.958017] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-17T17:32:24.173141] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T17:32:24.348875] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T17:32:24.758066] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-17T17:32:25.558079] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-17T17:32:25.768452] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T17:32:26.358080] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-17T17:32:26.391885] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:32:27.132940] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T17:32:27.137624] [INFO ] [REMOTE ] BDJ: Full fetch complete (42991 records). [2025-10-17T17:32:27.137775] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-17T17:32:27.168325] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-17T17:32:27.534241] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-17T17:32:27.534324] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-17T17:32:27.534871] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-17T17:32:27.534942] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-17T17:32:27.536027] [DEBUG] [LOCAL ] BDJ: Trimmed 42991 records to 29832 (keeping 200 days of data) [2025-10-17T17:32:27.714891] [DEBUG] [LOCAL ] BDJ: Primary data saved (29832 records). [2025-10-17T17:32:27.715041] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-17T17:32:27.715127] [INFO ] [MAIN ] Update Progress: 241/2368 symbols completed. BDJ took 27.3s. Estimated remaining: 4h 45m 55s. Rate: 7.4 symbols/min [2025-10-17T17:32:27.886336] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:27.886524] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-17T17:32:27.886671] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-17T17:32:27.886789] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-17T17:32:27.886831] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-17T17:32:27.886873] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-17T17:32:27.886905] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-17T17:32:27.960123] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-17T17:32:28.298907] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T17:32:28.304723] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:28.758049] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-17T17:32:29.194704] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:32:29.558002] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-17T17:32:29.813814] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T17:32:30.358082] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-17T17:32:30.553940] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:32:30.560978] [INFO ] [REMOTE ] BDX: Full fetch complete (75557 records). [2025-10-17T17:32:30.561136] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-17T17:32:30.960085] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-17T17:32:30.960272] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-17T17:32:30.961170] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-17T17:32:30.961257] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-17T17:32:30.956191] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T17:32:30.964420] [DEBUG] [LOCAL ] BDX: Trimmed 75557 records to 52951 (keeping 200 days of data) [2025-10-17T17:32:31.165629] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-17T17:32:31.318071] [DEBUG] [LOCAL ] BDX: Primary data saved (52951 records). [2025-10-17T17:32:31.318218] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-17T17:32:31.318329] [INFO ] [MAIN ] Update Progress: 242/2368 symbols completed. BDX took 30.9s. Estimated remaining: 4h 45m 8s. Rate: 7.5 symbols/min [2025-10-17T17:32:31.499350] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:31.534025] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T17:32:31.547563] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-17T17:32:31.595625] [DEBUG] [LOCAL ] BEKE: Loaded 53596 existing records from primary storage. [2025-10-17T17:32:31.596007] [INFO ] [MAIN ] BEKE: Loaded 53596 existing records. [2025-10-17T17:32:31.793008] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:31.793268] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-17T17:32:31.793318] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-17T17:32:31.793812] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-17T17:32:31.793873] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-17T17:32:31.968829] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-17T17:32:32.164614] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:32.383496] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T17:32:32.758024] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-17T17:32:33.558076] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-17T17:32:33.985843] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:32:34.358021] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-17T17:32:34.560335] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T17:32:35.158215] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-17T17:32:35.668201] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:32:35.958033] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-17T17:32:36.243582] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T17:32:36.249961] [INFO ] [REMOTE ] BDN: Full fetch complete (69073 records). [2025-10-17T17:32:36.250175] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-17T17:32:36.251156] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:32:36.251262] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:32:36.251348] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:32:36.251444] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-17T17:32:36.251547] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-17T17:32:36.251635] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-10-17T17:32:36.251868] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-10-17T17:32:36.251988] [INFO ] [MAIN ] Update Progress: 243/2368 symbols completed. BDN took 35.9s. Estimated remaining: 4h 44m 33s. Rate: 7.5 symbols/min [2025-10-17T17:32:36.420330] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:36.468904] [DEBUG] [LOCAL ] BEN: Loaded 53511 existing records from primary storage. [2025-10-17T17:32:36.469255] [INFO ] [MAIN ] BEN: Loaded 53511 existing records. [2025-10-17T17:32:36.641667] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:36.641870] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-17T17:32:36.641940] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-17T17:32:36.642259] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-17T17:32:36.642316] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-17T17:32:36.763179] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-17T17:32:37.002012] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:37.179901] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T17:32:37.558046] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-17T17:32:37.883081] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T17:32:38.173378] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-17T17:32:38.358069] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-17T17:32:38.590681] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-17T17:32:39.158083] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-17T17:32:39.958035] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-17T17:32:40.758062] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-17T17:32:40.940258] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:32:41.065989] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T17:32:41.558032] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-17T17:32:41.738512] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T17:32:41.909818] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-17T17:32:42.358041] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-17T17:32:43.158028] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-17T17:32:43.958023] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-17T17:32:44.343067] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T17:32:44.758046] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-17T17:32:45.558006] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-17T17:32:45.589871] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-17T17:32:45.791816] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T17:32:46.073475] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-17T17:32:46.074335] [INFO ] [REMOTE ] BEDU: Full fetch complete (1326 records). [2025-10-17T17:32:46.074585] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-17T17:32:46.266998] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-17T17:32:46.267245] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:32:46.267314] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:32:46.267392] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-17T17:32:46.267482] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-17T17:32:46.267542] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-17T17:32:46.267627] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-17T17:32:46.267731] [INFO ] [MAIN ] Update Progress: 244/2368 symbols completed. BEDU took 18.6s. Estimated remaining: 4h 44m 42s. Rate: 7.5 symbols/min [2025-10-17T17:32:46.364468] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-17T17:32:46.445256] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:46.445533] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-10-17T17:32:46.445573] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-10-17T17:32:46.445730] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-17T17:32:46.445779] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-17T17:32:46.445823] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-17T17:32:46.445857] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-17T17:32:46.843768] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:46.903601] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T17:32:47.158048] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-17T17:32:47.958098] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-17T17:32:48.123721] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:32:48.683836] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T17:32:48.758069] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-17T17:32:49.558098] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-17T17:32:50.358055] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-17T17:32:50.599179] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T17:32:50.654084] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-17T17:32:51.131478] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:32:51.158014] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-17T17:32:51.958012] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-17T17:32:52.420756] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:32:52.758072] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-17T17:32:53.019813] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:32:53.372471] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:32:53.558017] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-17T17:32:54.358075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-17T17:32:55.158032] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-17T17:32:55.267423] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T17:32:55.508887] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-17T17:32:55.516856] [INFO ] [REMOTE ] BE: Full fetch complete (77813 records). [2025-10-17T17:32:55.517177] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-17T17:32:55.959574] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-17T17:32:55.982439] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:32:55.982775] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-17T17:32:55.993376] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-17T17:32:55.995038] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-17T17:32:55.995166] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-17T17:32:55.997102] [DEBUG] [LOCAL ] BE: Trimmed 77813 records to 54441 (keeping 200 days of data) [2025-10-17T17:32:56.331915] [DEBUG] [LOCAL ] BE: Primary data saved (54441 records). [2025-10-17T17:32:56.332063] [INFO ] [MAIN ] BE: Full history saved. [2025-10-17T17:32:56.332192] [INFO ] [MAIN ] Update Progress: 245/2368 symbols completed. BE took 56.0s. Estimated remaining: 4h 44m 52s. Rate: 7.5 symbols/min [2025-10-17T17:32:56.506633] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:56.553220] [DEBUG] [LOCAL ] BEPC: Loaded 46866 existing records from primary storage. [2025-10-17T17:32:56.553618] [INFO ] [MAIN ] BEPC: Loaded 46866 existing records. [2025-10-17T17:32:56.746566] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:56.746959] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-17T17:32:56.747030] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-17T17:32:56.747395] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-17T17:32:56.747485] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-17T17:32:56.780183] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-17T17:32:57.136432] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:57.183128] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:32:57.239707] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:32:57.558056] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-17T17:32:58.337623] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T17:32:58.358061] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-17T17:32:59.158050] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-17T17:32:59.592157] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T17:32:59.943298] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:32:59.957996] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-17T17:33:00.758062] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-17T17:33:01.116527] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:33:01.558064] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-17T17:33:01.631907] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T17:33:02.358074] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-17T17:33:02.935605] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-17T17:33:03.158062] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-17T17:33:03.226274] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T17:33:03.958075] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-17T17:33:04.191883] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T17:33:04.746587] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:33:04.757978] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-17T17:33:05.268371] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:33:05.558058] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-17T17:33:06.147924] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T17:33:06.358052] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-17T17:33:07.158077] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-17T17:33:07.393251] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T17:33:07.857636] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:33:07.958063] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-17T17:33:08.758076] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-17T17:33:09.056076] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:33:09.465976] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:33:09.473202] [INFO ] [REMOTE ] BEP: Full fetch complete (59310 records). [2025-10-17T17:33:09.473387] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-17T17:33:09.563249] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-17T17:33:09.878863] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-17T17:33:09.878993] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-17T17:33:09.879973] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-17T17:33:09.880052] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-17T17:33:09.881899] [DEBUG] [LOCAL ] BEP: Trimmed 59310 records to 39645 (keeping 200 days of data) [2025-10-17T17:33:10.137008] [DEBUG] [LOCAL ] BEP: Primary data saved (39645 records). [2025-10-17T17:33:10.137216] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-17T17:33:10.137311] [INFO ] [MAIN ] Update Progress: 246/2368 symbols completed. BEP took 23.9s. Estimated remaining: 4h 45m 33s. Rate: 7.4 symbols/min [2025-10-17T17:33:10.321411] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:10.331075] [DEBUG] [LOCAL ] BEPH: Loaded 5205 existing records from primary storage. [2025-10-17T17:33:10.331338] [INFO ] [MAIN ] BEPH: Loaded 5205 existing records. [2025-10-17T17:33:10.363155] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-17T17:33:10.529624] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:10.530281] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-17T17:33:10.530392] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-17T17:33:10.530864] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-17T17:33:10.531134] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-17T17:33:10.641430] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:33:10.683201] [INFO ] [REMOTE ] BEN: Full fetch complete (77085 records). [2025-10-17T17:33:10.713023] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-17T17:33:11.164946] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:11.201777] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-17T17:33:11.386407] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-17T17:33:11.386520] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-17T17:33:11.387430] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-17T17:33:11.387524] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-17T17:33:11.389943] [DEBUG] [LOCAL ] BEN: Trimmed 77085 records to 53896 (keeping 200 days of data) [2025-10-17T17:33:11.658845] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T17:33:11.776409] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T17:33:11.798984] [DEBUG] [LOCAL ] BEN: Primary data saved (53896 records). [2025-10-17T17:33:11.799113] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-17T17:33:11.799788] [INFO ] [MAIN ] Update Progress: 247/2368 symbols completed. BEN took 35.5s. Estimated remaining: 4h 44m 30s. Rate: 7.5 symbols/min [2025-10-17T17:33:11.961266] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-17T17:33:11.983879] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:11.996965] [DEBUG] [LOCAL ] BEPI: Loaded 3629 existing records from primary storage. [2025-10-17T17:33:11.997950] [INFO ] [MAIN ] BEPI: Loaded 3629 existing records. [2025-10-17T17:33:12.259509] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T17:33:12.257191] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:12.270529] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-17T17:33:12.270887] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-17T17:33:12.271573] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-17T17:33:12.271636] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-17T17:33:12.637155] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:12.758063] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-17T17:33:13.482266] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T17:33:13.558041] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-17T17:33:13.780244] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:33:13.878214] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T17:33:14.358025] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-17T17:33:15.158061] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-17T17:33:15.645547] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T17:33:15.920196] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:33:15.957999] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-17T17:33:16.758046] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-17T17:33:17.391527] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:33:17.558058] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-17T17:33:18.358092] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-17T17:33:18.566619] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:33:18.648698] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-17T17:33:19.158045] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-17T17:33:19.257624] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:33:19.667395] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:33:19.958048] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-17T17:33:20.562210] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:33:20.758034] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-17T17:33:21.349845] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T17:33:21.558041] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-17T17:33:22.358054] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-17T17:33:23.158082] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-17T17:33:23.298681] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:33:23.306251] [INFO ] [REMOTE ] BEKE: Full fetch complete (77335 records). [2025-10-17T17:33:23.306386] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-17T17:33:23.803190] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-17T17:33:23.803495] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-17T17:33:23.804799] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-17T17:33:23.805031] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-17T17:33:23.830423] [DEBUG] [LOCAL ] BEKE: Trimmed 77335 records to 53980 (keeping 200 days of data) [2025-10-17T17:33:23.831342] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:33:23.947901] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T17:33:23.958130] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-17T17:33:24.185445] [DEBUG] [LOCAL ] BEKE: Primary data saved (53980 records). [2025-10-17T17:33:24.185595] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-17T17:33:24.186837] [INFO ] [MAIN ] Update Progress: 248/2368 symbols completed. BEKE took 52.9s. Estimated remaining: 4h 44m 59s. Rate: 7.4 symbols/min [2025-10-17T17:33:24.355966] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:24.362200] [DEBUG] [LOCAL ] BEPJ: Loaded 3119 existing records from primary storage. [2025-10-17T17:33:24.362386] [INFO ] [MAIN ] BEPJ: Loaded 3119 existing records. [2025-10-17T17:33:24.538893] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:24.545865] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-17T17:33:24.545944] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-17T17:33:24.546224] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T17:33:24.548704] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-17T17:33:24.549268] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-17T17:33:24.763208] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-17T17:33:24.904044] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:25.395246] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T17:33:25.558023] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-17T17:33:26.026313] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T17:33:26.358087] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-17T17:33:26.978627] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T17:33:27.158053] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-17T17:33:27.705408] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T17:33:27.958050] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-17T17:33:28.544892] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T17:33:28.758049] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-17T17:33:29.350784] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T17:33:29.558015] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-17T17:33:30.101807] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T17:33:30.358032] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-17T17:33:31.037832] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T17:33:31.158056] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-17T17:33:31.958033] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-17T17:33:32.492790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-17T17:33:32.651365] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T17:33:32.758023] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-17T17:33:33.558050] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-17T17:33:34.318551] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T17:33:34.319946] [INFO ] [REMOTE ] BEPH: Full fetch complete (7589 records). [2025-10-17T17:33:34.320087] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-17T17:33:34.363173] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-17T17:33:34.465838] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:33:34.525815] [INFO ] [REMOTE ] BEPC: Full fetch complete (68934 records). [2025-10-17T17:33:34.534732] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-17T17:33:35.039034] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-17T17:33:35.038830] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-17T17:33:35.044404] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-17T17:33:35.069297] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-17T17:33:35.077338] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-17T17:33:35.080744] [DEBUG] [LOCAL ] BEPH: Trimmed 7589 records to 5233 (keeping 200 days of data) [2025-10-17T17:33:35.158088] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-17T17:33:35.255124] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-17T17:33:35.256503] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-17T17:33:35.262109] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-17T17:33:35.264370] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-17T17:33:35.264248] [DEBUG] [LOCAL ] BEPH: Primary data saved (5233 records). [2025-10-17T17:33:35.264598] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-17T17:33:35.265008] [INFO ] [MAIN ] Update Progress: 249/2368 symbols completed. BEPH took 25.1s. Estimated remaining: 4h 45m 17s. Rate: 7.4 symbols/min [2025-10-17T17:33:35.347533] [DEBUG] [LOCAL ] BEPC: Trimmed 68934 records to 47230 (keeping 200 days of data) [2025-10-17T17:33:35.535613] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:35.651251] [DEBUG] [LOCAL ] BFAM: Loaded 34121 existing records from primary storage. [2025-10-17T17:33:35.682909] [INFO ] [MAIN ] BFAM: Loaded 34121 existing records. [2025-10-17T17:33:35.827262] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T17:33:35.952259] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:35.964986] [DEBUG] [LOCAL ] BEPC: Primary data saved (47230 records). [2025-10-17T17:33:35.965806] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-17T17:33:35.965162] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-17T17:33:35.966063] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-17T17:33:35.965929] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-17T17:33:35.966243] [INFO ] [MAIN ] Update Progress: 250/2368 symbols completed. BEPC took 39.6s. Estimated remaining: 4h 44m 6s. Rate: 7.5 symbols/min [2025-10-17T17:33:35.973947] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-17T17:33:35.989081] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-17T17:33:36.270931] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:36.509360] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:36.521638] [DEBUG] [LOCAL ] BFH: Loaded 41891 existing records from primary storage. [2025-10-17T17:33:36.521940] [INFO ] [MAIN ] BFH: Loaded 41891 existing records. [2025-10-17T17:33:36.623923] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T17:33:36.702861] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:36.703064] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-17T17:33:36.703111] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-17T17:33:36.703448] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-17T17:33:36.703504] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-17T17:33:36.763289] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-17T17:33:37.046887] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:37.539797] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:33:37.558050] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-17T17:33:38.094736] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T17:33:38.358066] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-17T17:33:39.158126] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-17T17:33:39.916707] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T17:33:39.958004] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-17T17:33:40.486514] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:33:40.758057] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-17T17:33:41.295264] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:33:41.558008] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-17T17:33:41.716688] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T17:33:42.029375] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T17:33:42.358049] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-17T17:33:42.825123] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T17:33:43.158079] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-17T17:33:43.958051] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-17T17:33:44.409316] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T17:33:44.691269] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T17:33:44.692267] [INFO ] [REMOTE ] BEPI: Full fetch complete (4713 records). [2025-10-17T17:33:44.692335] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-17T17:33:44.763226] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-17T17:33:45.057092] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-17T17:33:45.057190] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-17T17:33:45.057362] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-17T17:33:45.057404] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-17T17:33:45.057834] [DEBUG] [LOCAL ] BEPI: Trimmed 4713 records to 3648 (keeping 200 days of data) [2025-10-17T17:33:45.080303] [DEBUG] [LOCAL ] BEPI: Primary data saved (3648 records). [2025-10-17T17:33:45.080376] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-17T17:33:45.080447] [INFO ] [MAIN ] Update Progress: 251/2368 symbols completed. BEPI took 33.3s. Estimated remaining: 4h 44m 7s. Rate: 7.5 symbols/min [2025-10-17T17:33:45.248995] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:45.263208] [DEBUG] [LOCAL ] BFK: Loaded 13686 existing records from primary storage. [2025-10-17T17:33:45.263444] [INFO ] [MAIN ] BFK: Loaded 13686 existing records. [2025-10-17T17:33:45.441618] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:45.441833] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-17T17:33:45.441882] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-17T17:33:45.442056] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-17T17:33:45.442096] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-17T17:33:45.563212] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-17T17:33:45.808138] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:46.075320] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:33:46.358029] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-17T17:33:47.076510] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T17:33:47.158003] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-17T17:33:47.684176] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T17:33:47.958062] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-17T17:33:48.758073] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-17T17:33:48.808121] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T17:33:48.897565] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T17:33:49.558008] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-17T17:33:49.747591] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T17:33:50.358101] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-17T17:33:51.050202] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:33:51.158014] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-17T17:33:51.333118] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T17:33:51.574216] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T17:33:51.958076] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-17T17:33:52.571495] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:33:52.758037] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-17T17:33:53.192027] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T17:33:53.558057] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-17T17:33:54.358054] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-17T17:33:54.941480] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:33:55.158060] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-17T17:33:55.841915] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:33:55.958064] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-17T17:33:56.334234] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-17T17:33:56.335065] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4384 records). [2025-10-17T17:33:56.335132] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-17T17:33:56.700041] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-17T17:33:56.700150] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-17T17:33:56.700392] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-17T17:33:56.700473] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-17T17:33:56.701101] [DEBUG] [LOCAL ] BEPJ: Trimmed 4384 records to 3122 (keeping 200 days of data) [2025-10-17T17:33:56.730472] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3122 records). [2025-10-17T17:33:56.735758] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-17T17:33:56.735886] [INFO ] [MAIN ] Update Progress: 252/2368 symbols completed. BEPJ took 32.5s. Estimated remaining: 4h 44m 29s. Rate: 7.4 symbols/min [2025-10-17T17:33:56.760300] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-17T17:33:56.832274] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T17:33:56.946060] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:56.999184] [DEBUG] [LOCAL ] BFLY: Loaded 52222 existing records from primary storage. [2025-10-17T17:33:56.999535] [INFO ] [MAIN ] BFLY: Loaded 52222 existing records. [2025-10-17T17:33:57.170078] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:57.170324] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-17T17:33:57.170372] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-17T17:33:57.170834] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-17T17:33:57.170891] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-17T17:33:57.516971] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:57.558156] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-17T17:33:57.609843] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T17:33:58.358067] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-17T17:33:59.024631] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:33:59.158030] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-17T17:33:59.958171] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-17T17:34:00.176472] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T17:34:00.592557] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:34:00.758093] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-17T17:34:00.925880] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T17:34:01.558067] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-17T17:34:02.131063] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:34:02.358085] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-17T17:34:02.469195] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:34:03.158063] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-17T17:34:03.957993] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-17T17:34:04.008597] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:34:04.202189] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:34:04.758028] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-17T17:34:05.540196] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T17:34:05.558030] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-17T17:34:05.735999] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:34:06.358017] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-17T17:34:06.376072] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:34:07.158036] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-17T17:34:07.835919] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T17:34:07.958018] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-17T17:34:08.414897] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T17:34:08.758002] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-17T17:34:09.501449] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:34:09.557994] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-17T17:34:10.265459] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:34:10.270564] [INFO ] [REMOTE ] BFAM: Full fetch complete (47097 records). [2025-10-17T17:34:10.270698] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-17T17:34:10.271284] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:34:10.271372] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:34:10.271414] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:34:10.271454] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-17T17:34:10.271509] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-17T17:34:10.271544] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-10-17T17:34:10.271736] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-10-17T17:34:10.271827] [INFO ] [MAIN ] Update Progress: 253/2368 symbols completed. BFAM took 35.0s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-17T17:34:10.365857] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-17T17:34:10.441274] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:10.441439] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-17T17:34:10.441482] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-17T17:34:10.441592] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-17T17:34:10.441632] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-17T17:34:10.441713] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-17T17:34:10.441756] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-17T17:34:10.785678] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:11.033624] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:34:11.039919] [INFO ] [REMOTE ] BFH: Full fetch complete (60189 records). [2025-10-17T17:34:11.040073] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-17T17:34:11.163109] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-17T17:34:11.361503] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T17:34:11.444510] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-17T17:34:11.444622] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-17T17:34:11.445369] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-17T17:34:11.445422] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-17T17:34:11.446724] [DEBUG] [LOCAL ] BFH: Trimmed 60189 records to 42165 (keeping 200 days of data) [2025-10-17T17:34:11.700964] [DEBUG] [LOCAL ] BFH: Primary data saved (42165 records). [2025-10-17T17:34:11.701093] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-17T17:34:11.701179] [INFO ] [MAIN ] Update Progress: 254/2368 symbols completed. BFH took 35.7s. Estimated remaining: 4h 44m 3s. Rate: 7.4 symbols/min [2025-10-17T17:34:11.890427] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:11.905941] [DEBUG] [LOCAL ] BFZ: Loaded 12108 existing records from primary storage. [2025-10-17T17:34:11.906183] [INFO ] [MAIN ] BFZ: Loaded 12108 existing records. [2025-10-17T17:34:11.969291] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-17T17:34:12.088865] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:12.089093] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-17T17:34:12.089143] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-17T17:34:12.089323] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-17T17:34:12.089403] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-17T17:34:12.461968] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:12.758032] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-17T17:34:12.894958] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T17:34:13.103963] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:34:13.560098] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-17T17:34:13.562231] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T17:34:14.358038] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-17T17:34:15.158014] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-17T17:34:15.388766] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T17:34:15.405472] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T17:34:15.958067] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-17T17:34:16.397608] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T17:34:16.758014] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-17T17:34:16.861403] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T17:34:17.558032] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-17T17:34:18.358012] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-17T17:34:18.480377] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:34:18.497342] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:34:18.501486] [INFO ] [REMOTE ] BFK: Full fetch complete (19103 records). [2025-10-17T17:34:18.501575] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-17T17:34:18.873917] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-17T17:34:18.873999] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-17T17:34:18.874427] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-17T17:34:18.874467] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-17T17:34:18.875117] [DEBUG] [LOCAL ] BFK: Trimmed 19103 records to 13862 (keeping 200 days of data) [2025-10-17T17:34:18.961931] [DEBUG] [LOCAL ] BFK: Primary data saved (13862 records). [2025-10-17T17:34:18.962078] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-17T17:34:18.962166] [INFO ] [MAIN ] Update Progress: 255/2368 symbols completed. BFK took 33.9s. Estimated remaining: 4h 43m 49s. Rate: 7.4 symbols/min [2025-10-17T17:34:19.138912] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:19.158064] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-17T17:34:19.194220] [DEBUG] [LOCAL ] BG: Loaded 50912 existing records from primary storage. [2025-10-17T17:34:19.194541] [INFO ] [MAIN ] BG: Loaded 50912 existing records. [2025-10-17T17:34:19.309451] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T17:34:19.391295] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:19.391543] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-17T17:34:19.391594] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-17T17:34:19.391948] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-17T17:34:19.392007] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-17T17:34:19.759861] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:19.958058] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-17T17:34:20.761310] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-17T17:34:20.783066] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:34:20.915012] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T17:34:21.558049] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-17T17:34:22.198738] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T17:34:22.358065] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-17T17:34:22.504566] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:34:23.158012] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-17T17:34:23.208976] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T17:34:23.958026] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-17T17:34:24.758021] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-17T17:34:24.850614] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:34:24.903246] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T17:34:25.298352] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T17:34:25.558041] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-17T17:34:26.358041] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-17T17:34:27.148814] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T17:34:27.157983] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-17T17:34:27.210072] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:34:27.914971] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T17:34:27.958050] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-17T17:34:28.760389] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-17T17:34:28.764382] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:34:29.558035] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-17T17:34:30.358015] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-17T17:34:30.513102] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T17:34:30.719944] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T17:34:31.158043] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-17T17:34:31.195466] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T17:34:31.958025] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-17T17:34:32.758072] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-17T17:34:33.558044] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-17T17:34:33.847727] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-17T17:34:34.358096] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-17T17:34:34.409180] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-17T17:34:34.445363] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T17:34:34.896468] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T17:34:35.129528] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T17:34:35.158029] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-17T17:34:35.958020] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-17T17:34:36.138217] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T17:34:36.758085] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-17T17:34:37.558034] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-17T17:34:37.772758] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T17:34:37.852446] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T17:34:38.358027] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-17T17:34:38.412442] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T17:34:39.158050] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-17T17:34:39.958000] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-17T17:34:40.109730] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T17:34:40.134621] [INFO ] [REMOTE ] BFS: Full fetch complete (12996 records). [2025-10-17T17:34:40.137413] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-17T17:34:40.138965] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T17:34:40.149295] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:34:40.149806] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:34:40.149987] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:34:40.150069] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-17T17:34:40.150497] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-17T17:34:40.150561] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-17T17:34:40.150604] [DEBUG] [LOCAL ] BFS: No derivative data file found to delete. [2025-10-17T17:34:40.150681] [INFO ] [MAIN ] Update Progress: 256/2368 symbols completed. BFS took 29.9s. Estimated remaining: 4h 45m 29s. Rate: 7.4 symbols/min [2025-10-17T17:34:40.320287] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:40.320453] [DEBUG] [LOCAL ] BGB: No existing data file found in primary storage. [2025-10-17T17:34:40.320492] [WARN ] [MAIN ] BGB: No existing data found, performing full refresh instead. [2025-10-17T17:34:40.320639] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-17T17:34:40.320758] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-17T17:34:40.320808] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-17T17:34:40.320843] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-17T17:34:40.672436] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:40.757995] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-17T17:34:40.967578] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T17:34:40.970612] [INFO ] [REMOTE ] BFZ: Full fetch complete (17502 records). [2025-10-17T17:34:40.970733] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-17T17:34:41.356925] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-17T17:34:41.357017] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-17T17:34:41.357376] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-17T17:34:41.357416] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-17T17:34:41.358006] [DEBUG] [LOCAL ] BFZ: Trimmed 17502 records to 12201 (keeping 200 days of data) [2025-10-17T17:34:41.433992] [DEBUG] [LOCAL ] BFZ: Primary data saved (12201 records). [2025-10-17T17:34:41.434132] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-17T17:34:41.434241] [INFO ] [MAIN ] Update Progress: 257/2368 symbols completed. BFZ took 29.7s. Estimated remaining: 4h 44m 25s. Rate: 7.4 symbols/min [2025-10-17T17:34:41.563183] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-17T17:34:41.613613] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:41.633083] [DEBUG] [LOCAL ] BGH: Loaded 17362 existing records from primary storage. [2025-10-17T17:34:41.633320] [INFO ] [MAIN ] BGH: Loaded 17362 existing records. [2025-10-17T17:34:41.848286] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:41.848508] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-17T17:34:41.848558] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-17T17:34:41.848795] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-17T17:34:41.848866] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-17T17:34:42.211026] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:42.358059] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-17T17:34:42.437499] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:34:43.158060] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-17T17:34:43.545614] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T17:34:43.894037] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T17:34:43.902586] [INFO ] [REMOTE ] BFLY: Full fetch complete (75511 records). [2025-10-17T17:34:43.902841] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-17T17:34:43.969402] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-17T17:34:44.324061] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-17T17:34:44.324201] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-17T17:34:44.325270] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-17T17:34:44.325346] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-17T17:34:44.327171] [DEBUG] [LOCAL ] BFLY: Trimmed 75511 records to 52605 (keeping 200 days of data) [2025-10-17T17:34:44.623869] [DEBUG] [LOCAL ] BFLY: Primary data saved (52605 records). [2025-10-17T17:34:44.623995] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-17T17:34:44.624125] [INFO ] [MAIN ] Update Progress: 258/2368 symbols completed. BFLY took 47.9s. Estimated remaining: 4h 43m 37s. Rate: 7.4 symbols/min [2025-10-17T17:34:44.777980] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-17T17:34:44.795232] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:44.832334] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T17:34:44.847448] [DEBUG] [LOCAL ] BGR: Loaded 13687 existing records from primary storage. [2025-10-17T17:34:44.847997] [INFO ] [MAIN ] BGR: Loaded 13687 existing records. [2025-10-17T17:34:44.984350] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T17:34:45.055529] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:45.055784] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-17T17:34:45.055844] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-17T17:34:45.056022] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-17T17:34:45.056073] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-17T17:34:45.434418] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:45.558010] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-17T17:34:45.872835] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:34:46.358037] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-17T17:34:47.158039] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-17T17:34:47.443969] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T17:34:47.479044] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T17:34:47.614011] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T17:34:47.958124] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-17T17:34:48.758080] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-17T17:34:49.558049] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-17T17:34:49.775791] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T17:34:49.803187] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T17:34:50.358070] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-17T17:34:50.475377] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T17:34:51.158044] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-17T17:34:51.410285] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:34:51.958041] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-17T17:34:52.052938] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:34:52.758034] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-17T17:34:53.294900] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T17:34:53.558038] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-17T17:34:54.358012] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-17T17:34:54.536290] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T17:34:54.672087] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:34:55.158013] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-17T17:34:55.284700] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:34:55.958030] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-17T17:34:56.758056] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-17T17:34:57.402770] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T17:34:57.449051] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-17T17:34:57.456459] [INFO ] [REMOTE ] BG: Full fetch complete (73023 records). [2025-10-17T17:34:57.456597] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-17T17:34:57.563185] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-17T17:34:57.844361] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-17T17:34:57.844439] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-17T17:34:57.845389] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-17T17:34:57.845453] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-17T17:34:57.846812] [DEBUG] [LOCAL ] BG: Trimmed 73023 records to 51286 (keeping 200 days of data) [2025-10-17T17:34:58.157284] [DEBUG] [LOCAL ] BG: Primary data saved (51286 records). [2025-10-17T17:34:58.157452] [INFO ] [MAIN ] BG: Full history saved. [2025-10-17T17:34:58.157615] [INFO ] [MAIN ] Update Progress: 259/2368 symbols completed. BG took 39.2s. Estimated remaining: 4h 44m 13s. Rate: 7.4 symbols/min [2025-10-17T17:34:58.329732] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:58.358058] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-17T17:34:58.378722] [DEBUG] [LOCAL ] BGS: Loaded 50921 existing records from primary storage. [2025-10-17T17:34:58.379078] [INFO ] [MAIN ] BGS: Loaded 50921 existing records. [2025-10-17T17:34:58.567286] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:58.567674] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-17T17:34:58.567803] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-17T17:34:58.568233] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-17T17:34:58.568313] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-17T17:34:58.946293] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:59.039528] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:34:59.052706] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T17:34:59.157993] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-17T17:34:59.323430] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:34:59.958057] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-17T17:35:00.110962] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T17:35:00.758079] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-17T17:35:01.222473] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T17:35:01.558072] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-17T17:35:02.358042] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-17T17:35:02.530043] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T17:35:02.938837] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T17:35:03.158024] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-17T17:35:03.715510] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T17:35:03.958092] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-17T17:35:04.201900] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:35:04.205270] [INFO ] [REMOTE ] BGB: Full fetch complete (26851 records). [2025-10-17T17:35:04.205530] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-17T17:35:04.623462] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-17T17:35:04.623577] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-17T17:35:04.624371] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-17T17:35:04.624440] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-17T17:35:04.625423] [DEBUG] [LOCAL ] BGB: Trimmed 26851 records to 18257 (keeping 200 days of data) [2025-10-17T17:35:04.744394] [DEBUG] [LOCAL ] BGB: Primary data saved (18257 records). [2025-10-17T17:35:04.744591] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-17T17:35:04.744699] [INFO ] [MAIN ] Update Progress: 260/2368 symbols completed. BGB took 24.6s. Estimated remaining: 4h 43m 53s. Rate: 7.4 symbols/min [2025-10-17T17:35:04.763315] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-17T17:35:04.945066] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:04.957965] [DEBUG] [LOCAL ] BGSF: Loaded 8063 existing records from primary storage. [2025-10-17T17:35:04.958288] [INFO ] [MAIN ] BGSF: Loaded 8063 existing records. [2025-10-17T17:35:05.158570] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:05.158904] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-17T17:35:05.158956] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-17T17:35:05.159265] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-17T17:35:05.159323] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-17T17:35:05.538718] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:05.563137] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-17T17:35:05.581855] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:35:05.730143] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T17:35:06.358045] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-17T17:35:06.629844] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T17:35:07.158077] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-17T17:35:07.958041] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-17T17:35:08.060714] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T17:35:08.090929] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T17:35:08.758036] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-17T17:35:09.558119] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-17T17:35:10.358062] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-17T17:35:10.475749] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-17T17:35:10.577407] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T17:35:11.158000] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-17T17:35:11.380562] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T17:35:11.451702] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-17T17:35:11.713172] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T17:35:11.958021] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-17T17:35:12.638664] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T17:35:12.758067] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-17T17:35:13.558036] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-17T17:35:14.358047] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-17T17:35:14.480025] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:35:14.886590] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:35:15.158034] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-17T17:35:15.958017] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-17T17:35:16.218918] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:35:16.219229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T17:35:16.758098] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-17T17:35:17.119110] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T17:35:17.122125] [INFO ] [REMOTE ] BGH: Full fetch complete (22817 records). [2025-10-17T17:35:17.122200] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-17T17:35:17.123533] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:35:17.123630] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:35:17.123710] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:35:17.123757] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-17T17:35:17.123814] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-17T17:35:17.123851] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-17T17:35:17.123968] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-17T17:35:17.124035] [INFO ] [MAIN ] Update Progress: 261/2368 symbols completed. BGH took 35.7s. Estimated remaining: 4h 44m 19s. Rate: 7.4 symbols/min [2025-10-17T17:35:17.294020] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:17.311853] [DEBUG] [LOCAL ] BGT: Loaded 16514 existing records from primary storage. [2025-10-17T17:35:17.312126] [INFO ] [MAIN ] BGT: Loaded 16514 existing records. [2025-10-17T17:35:17.492686] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:17.492904] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-17T17:35:17.492950] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-17T17:35:17.493152] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-17T17:35:17.493190] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-17T17:35:17.561485] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-17T17:35:17.690587] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T17:35:17.872753] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:18.358042] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-17T17:35:19.158015] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-17T17:35:19.404129] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T17:35:19.425119] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:35:19.754757] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T17:35:19.958020] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-17T17:35:20.758006] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-17T17:35:20.937066] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T17:35:21.558004] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-17T17:35:21.874120] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T17:35:22.194063] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T17:35:22.358066] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-17T17:35:22.967988] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T17:35:23.158033] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-17T17:35:23.958028] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-17T17:35:24.136112] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T17:35:24.138584] [INFO ] [REMOTE ] BGR: Full fetch complete (19967 records). [2025-10-17T17:35:24.138724] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-17T17:35:24.520910] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-17T17:35:24.521000] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-17T17:35:24.521380] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-17T17:35:24.521423] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-17T17:35:24.522044] [DEBUG] [LOCAL ] BGR: Trimmed 19967 records to 13773 (keeping 200 days of data) [2025-10-17T17:35:24.569744] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T17:35:24.615939] [DEBUG] [LOCAL ] BGR: Primary data saved (13773 records). [2025-10-17T17:35:24.616086] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-17T17:35:24.616175] [INFO ] [MAIN ] Update Progress: 262/2368 symbols completed. BGR took 40.0s. Estimated remaining: 4h 44m 7s. Rate: 7.4 symbols/min [2025-10-17T17:35:24.765297] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-17T17:35:24.793795] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:24.809434] [DEBUG] [LOCAL ] BGX: Loaded 11261 existing records from primary storage. [2025-10-17T17:35:24.809719] [INFO ] [MAIN ] BGX: Loaded 11261 existing records. [2025-10-17T17:35:24.986022] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:24.986268] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-17T17:35:24.986327] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-17T17:35:24.986504] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-17T17:35:24.986563] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-17T17:35:25.343198] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:25.558028] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-17T17:35:26.358044] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-17T17:35:26.424572] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T17:35:26.569485] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T17:35:26.874918] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T17:35:27.158052] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-17T17:35:27.958040] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-17T17:35:28.212476] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:35:28.758046] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-17T17:35:29.558028] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-17T17:35:29.580191] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:35:29.652102] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T17:35:30.358002] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-17T17:35:30.855824] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:35:31.158074] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-17T17:35:31.958071] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-17T17:35:32.025380] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:35:32.069002] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:35:32.758004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-17T17:35:32.894098] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T17:35:33.545454] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T17:35:33.557986] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-17T17:35:34.358066] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-17T17:35:34.374003] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T17:35:35.158074] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-17T17:35:35.362915] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:35:35.958116] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-17T17:35:36.681908] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T17:35:36.758011] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-17T17:35:36.860840] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T17:35:37.558058] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-17T17:35:38.339838] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T17:35:38.357976] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-17T17:35:38.568546] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:35:38.575598] [INFO ] [REMOTE ] BGS: Full fetch complete (72683 records). [2025-10-17T17:35:38.575743] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-17T17:35:38.958067] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-17T17:35:38.958197] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-17T17:35:38.959081] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-17T17:35:38.959219] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-17T17:35:38.960734] [DEBUG] [LOCAL ] BGS: Trimmed 72683 records to 51299 (keeping 200 days of data) [2025-10-17T17:35:39.183576] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T17:35:39.158748] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-17T17:35:39.269763] [DEBUG] [LOCAL ] BGS: Primary data saved (51299 records). [2025-10-17T17:35:39.269900] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-17T17:35:39.270493] [INFO ] [MAIN ] Update Progress: 263/2368 symbols completed. BGS took 41.1s. Estimated remaining: 4h 44m 51s. Rate: 7.4 symbols/min [2025-10-17T17:35:39.440606] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:39.462884] [DEBUG] [LOCAL ] BGY: Loaded 22120 existing records from primary storage. [2025-10-17T17:35:39.463151] [INFO ] [MAIN ] BGY: Loaded 22120 existing records. [2025-10-17T17:35:39.634601] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:39.634847] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-17T17:35:39.634895] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-17T17:35:39.635096] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-17T17:35:39.635155] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-17T17:35:39.961726] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-17T17:35:40.003121] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:40.243505] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T17:35:40.568268] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:35:40.758021] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-17T17:35:41.558023] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-17T17:35:41.930951] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T17:35:42.357991] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-17T17:35:42.443220] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T17:35:43.158074] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-17T17:35:43.488007] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T17:35:43.958006] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-17T17:35:44.284984] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:35:44.758083] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-17T17:35:45.167506] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T17:35:45.170007] [INFO ] [REMOTE ] BGSF: Full fetch complete (9604 records). [2025-10-17T17:35:45.170181] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-17T17:35:45.525181] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-17T17:35:45.525326] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-17T17:35:45.525573] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-17T17:35:45.525614] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-17T17:35:45.526126] [DEBUG] [LOCAL ] BGSF: Trimmed 9604 records to 8117 (keeping 200 days of data) [2025-10-17T17:35:45.560224] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-17T17:35:45.575911] [DEBUG] [LOCAL ] BGSF: Primary data saved (8117 records). [2025-10-17T17:35:45.576028] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-17T17:35:45.576111] [INFO ] [MAIN ] Update Progress: 264/2368 symbols completed. BGSF took 40.8s. Estimated remaining: 4h 44m 28s. Rate: 7.4 symbols/min [2025-10-17T17:35:45.747785] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:45.807892] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T17:35:45.824869] [DEBUG] [LOCAL ] BH: Loaded 16356 existing records from primary storage. [2025-10-17T17:35:45.825120] [INFO ] [MAIN ] BH: Loaded 16356 existing records. [2025-10-17T17:35:46.011426] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:46.011690] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-17T17:35:46.011754] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-17T17:35:46.011946] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-17T17:35:46.011987] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-17T17:35:46.358934] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-17T17:35:46.373042] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:46.381240] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T17:35:47.158037] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-17T17:35:47.589083] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T17:35:47.958004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-17T17:35:48.076359] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T17:35:48.758076] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-17T17:35:48.824728] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T17:35:49.558038] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-17T17:35:49.789854] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T17:35:49.792239] [INFO ] [REMOTE ] BGT: Full fetch complete (24206 records). [2025-10-17T17:35:49.792330] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-17T17:35:50.160934] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-17T17:35:50.161014] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-17T17:35:50.161397] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-17T17:35:50.161438] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-17T17:35:50.162084] [DEBUG] [LOCAL ] BGT: Trimmed 24206 records to 16635 (keeping 200 days of data) [2025-10-17T17:35:50.259095] [DEBUG] [LOCAL ] BGT: Primary data saved (16635 records). [2025-10-17T17:35:50.259234] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-17T17:35:50.259314] [INFO ] [MAIN ] Update Progress: 265/2368 symbols completed. BGT took 33.1s. Estimated remaining: 4h 43m 53s. Rate: 7.4 symbols/min [2025-10-17T17:35:50.364847] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-17T17:35:50.448699] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:50.493906] [DEBUG] [LOCAL ] BHC: Loaded 47069 existing records from primary storage. [2025-10-17T17:35:50.494235] [INFO ] [MAIN ] BHC: Loaded 47069 existing records. [2025-10-17T17:35:50.689329] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:50.689777] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-17T17:35:50.689933] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-17T17:35:50.690441] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-17T17:35:50.690503] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-17T17:35:50.826983] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T17:35:51.091134] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:51.158050] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-17T17:35:51.442377] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:35:51.958094] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-17T17:35:52.283144] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T17:35:52.679303] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T17:35:52.758075] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-17T17:35:53.558032] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-17T17:35:53.643632] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T17:35:54.148810] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T17:35:54.358092] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-17T17:35:55.158027] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-17T17:35:55.779238] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T17:35:55.915681] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T17:35:55.958007] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-17T17:35:56.688158] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T17:35:56.758032] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-17T17:35:57.557999] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-17T17:35:57.702737] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T17:35:58.358040] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-17T17:35:58.590973] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T17:35:58.593754] [INFO ] [REMOTE ] BGX: Full fetch complete (16660 records). [2025-10-17T17:35:58.593863] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-17T17:35:58.964223] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-17T17:35:58.964363] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-17T17:35:58.965021] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-17T17:35:58.965090] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-17T17:35:58.965972] [DEBUG] [LOCAL ] BGX: Trimmed 16660 records to 11350 (keeping 200 days of data) [2025-10-17T17:35:59.033019] [DEBUG] [LOCAL ] BGX: Primary data saved (11350 records). [2025-10-17T17:35:59.033173] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-17T17:35:59.033264] [INFO ] [MAIN ] Update Progress: 266/2368 symbols completed. BGX took 34.4s. Estimated remaining: 4h 43m 50s. Rate: 7.4 symbols/min [2025-10-17T17:35:59.168053] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-17T17:35:59.199967] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:59.223409] [DEBUG] [LOCAL ] BHE: Loaded 24043 existing records from primary storage. [2025-10-17T17:35:59.223699] [INFO ] [MAIN ] BHE: Loaded 24043 existing records. [2025-10-17T17:35:59.394469] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:59.394716] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-17T17:35:59.394774] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-17T17:35:59.394999] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-17T17:35:59.395039] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-17T17:35:59.744168] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:59.886213] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T17:35:59.958006] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-17T17:36:00.758046] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-17T17:36:00.864084] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:36:01.558005] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-17T17:36:01.807194] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T17:36:01.852034] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T17:36:02.358106] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-17T17:36:02.980481] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T17:36:03.158060] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-17T17:36:03.495437] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:36:03.926467] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T17:36:03.958015] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-17T17:36:04.758019] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-17T17:36:04.892940] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:36:05.558028] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-17T17:36:05.832419] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:36:06.358059] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-17T17:36:07.145479] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:36:07.157986] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-17T17:36:07.431521] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T17:36:07.434793] [INFO ] [REMOTE ] BGY: Full fetch complete (33018 records). [2025-10-17T17:36:07.434873] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-17T17:36:07.435395] [FATAL] [VALIDATOR ] BGY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:36:07.435479] [FATAL] [MAIN ] BGY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:36:07.435521] [WARN ] [MAIN ] BGY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:36:07.435561] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-17T17:36:07.435617] [DEBUG] [LOCAL ] BGY: No primary data file found to delete. [2025-10-17T17:36:07.435681] [INFO ] [LOCAL ] BGY: Starting deletion of derivative data. [2025-10-17T17:36:07.435867] [DEBUG] [LOCAL ] BGY: Deleted derivative data file. [2025-10-17T17:36:07.436057] [INFO ] [MAIN ] Update Progress: 267/2368 symbols completed. BGY took 28.2s. Estimated remaining: 4h 43m 45s. Rate: 7.4 symbols/min [2025-10-17T17:36:07.601803] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:07.601993] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-17T17:36:07.602031] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-17T17:36:07.602172] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-17T17:36:07.602247] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-17T17:36:07.602307] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-17T17:36:07.602342] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-17T17:36:07.950127] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:07.957980] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-17T17:36:08.710811] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:36:08.758009] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-17T17:36:09.142161] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:36:09.558028] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-17T17:36:09.784560] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T17:36:10.358102] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-17T17:36:11.150258] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:36:11.160276] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-17T17:36:11.212388] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T17:36:11.958001] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-17T17:36:12.113789] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T17:36:12.758014] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-17T17:36:13.439327] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:36:13.558007] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-17T17:36:13.663002] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:36:14.358039] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-17T17:36:15.028223] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:36:15.158019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-17T17:36:15.636438] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:36:15.958029] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-17T17:36:16.101197] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T17:36:16.758089] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-17T17:36:17.558090] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-17T17:36:17.726392] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T17:36:17.768409] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T17:36:18.358068] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-17T17:36:18.757092] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T17:36:19.158095] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-17T17:36:19.753685] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:36:19.966462] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-17T17:36:19.969013] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:36:20.758027] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-17T17:36:21.558022] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-17T17:36:21.786885] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T17:36:21.812270] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:36:22.358022] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-17T17:36:22.613395] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T17:36:23.158081] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-17T17:36:23.543264] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:36:23.958055] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-17T17:36:24.746463] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:36:24.758119] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-17T17:36:25.268510] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:36:25.445552] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-17T17:36:25.558041] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-17T17:36:26.358084] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-17T17:36:26.745357] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T17:36:27.158049] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-17T17:36:27.958027] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-17T17:36:28.224577] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T17:36:28.253496] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:36:28.260350] [INFO ] [REMOTE ] BHC: Full fetch complete (67489 records). [2025-10-17T17:36:28.260504] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-17T17:36:28.644438] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-17T17:36:28.644520] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-17T17:36:28.645267] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-17T17:36:28.645330] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-17T17:36:28.646582] [DEBUG] [LOCAL ] BHC: Trimmed 67489 records to 47402 (keeping 200 days of data) [2025-10-17T17:36:28.758087] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-17T17:36:28.908664] [DEBUG] [LOCAL ] BHC: Primary data saved (47402 records). [2025-10-17T17:36:28.908813] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-17T17:36:28.908898] [INFO ] [MAIN ] Update Progress: 268/2368 symbols completed. BHC took 38.6s. Estimated remaining: 4h 45m 21s. Rate: 7.4 symbols/min [2025-10-17T17:36:29.033760] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T17:36:29.088388] [INFO ] [REMOTE ] BH: Full fetch complete (19539 records). [2025-10-17T17:36:29.090920] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:29.091232] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-17T17:36:29.465780] [DEBUG] [LOCAL ] BHP: Loaded 53762 existing records from primary storage. [2025-10-17T17:36:29.491094] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-17T17:36:29.491286] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-17T17:36:29.491695] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-17T17:36:29.491223] [INFO ] [MAIN ] BHP: Loaded 53762 existing records. [2025-10-17T17:36:29.491795] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-17T17:36:29.559757] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-17T17:36:29.560595] [DEBUG] [LOCAL ] BH: Trimmed 19539 records to 16442 (keeping 200 days of data) [2025-10-17T17:36:29.741105] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:29.742275] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-17T17:36:29.744748] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-17T17:36:29.745774] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-17T17:36:29.746169] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-17T17:36:29.838979] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:36:30.135286] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:30.143894] [DEBUG] [LOCAL ] BH: Primary data saved (16442 records). [2025-10-17T17:36:30.143978] [INFO ] [MAIN ] BH: Full history saved. [2025-10-17T17:36:30.144050] [INFO ] [MAIN ] Update Progress: 269/2368 symbols completed. BH took 44.6s. Estimated remaining: 4h 44m 19s. Rate: 7.4 symbols/min [2025-10-17T17:36:30.309045] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:30.330728] [DEBUG] [LOCAL ] BHR: Loaded 22248 existing records from primary storage. [2025-10-17T17:36:30.330997] [INFO ] [MAIN ] BHR: Loaded 22248 existing records. [2025-10-17T17:36:30.363103] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-17T17:36:30.504695] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:30.504880] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-17T17:36:30.504926] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-17T17:36:30.505173] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-17T17:36:30.505228] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-17T17:36:30.851538] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:31.096094] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:36:31.157985] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-17T17:36:31.957995] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-17T17:36:32.266578] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:36:32.299596] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T17:36:32.303084] [INFO ] [REMOTE ] BHK: Full fetch complete (30460 records). [2025-10-17T17:36:32.303160] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-17T17:36:32.664132] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-17T17:36:32.664207] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-17T17:36:32.664674] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-17T17:36:32.664734] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-17T17:36:32.665423] [DEBUG] [LOCAL ] BHK: Trimmed 30460 records to 23994 (keeping 200 days of data) [2025-10-17T17:36:32.763720] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-17T17:36:32.806693] [DEBUG] [LOCAL ] BHK: Primary data saved (23994 records). [2025-10-17T17:36:32.806815] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-17T17:36:32.806884] [INFO ] [MAIN ] Update Progress: 270/2368 symbols completed. BHK took 25.4s. Estimated remaining: 4h 43m 28s. Rate: 7.4 symbols/min [2025-10-17T17:36:32.981666] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:32.981943] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-17T17:36:32.982053] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-17T17:36:32.982278] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-17T17:36:32.982333] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-17T17:36:32.982377] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-17T17:36:32.982410] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-17T17:36:33.138630] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:36:33.349716] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:33.557992] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-17T17:36:33.703223] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:36:33.706559] [INFO ] [REMOTE ] BHE: Full fetch complete (36366 records). [2025-10-17T17:36:33.706669] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-17T17:36:33.973879] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T17:36:34.079286] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-17T17:36:34.079366] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-17T17:36:34.079899] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-17T17:36:34.079961] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-17T17:36:34.080738] [DEBUG] [LOCAL ] BHE: Trimmed 36366 records to 24249 (keeping 200 days of data) [2025-10-17T17:36:34.225028] [DEBUG] [LOCAL ] BHE: Primary data saved (24249 records). [2025-10-17T17:36:34.225158] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-17T17:36:34.225239] [INFO ] [MAIN ] Update Progress: 271/2368 symbols completed. BHE took 35.2s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-10-17T17:36:34.373362] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-17T17:36:34.407282] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:34.458102] [DEBUG] [LOCAL ] BHVN: Loaded 50989 existing records from primary storage. [2025-10-17T17:36:34.458459] [INFO ] [MAIN ] BHVN: Loaded 50989 existing records. [2025-10-17T17:36:34.643561] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:34.643813] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-17T17:36:34.643863] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-17T17:36:34.644095] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-17T17:36:34.644152] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-17T17:36:34.989926] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:35.158073] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-17T17:36:35.958036] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-17T17:36:36.507622] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T17:36:36.585316] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T17:36:36.758053] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-17T17:36:37.087916] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:36:37.558065] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-17T17:36:38.305600] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:36:38.358042] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-17T17:36:38.751462] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T17:36:39.158101] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-17T17:36:39.320038] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:36:39.459369] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-17T17:36:39.958085] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-17T17:36:40.758072] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-17T17:36:41.558060] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-17T17:36:41.741854] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T17:36:41.890917] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-17T17:36:41.987795] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T17:36:42.358001] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-17T17:36:42.689831] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-17T17:36:43.158104] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-17T17:36:43.958112] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-17T17:36:44.434927] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T17:36:44.758047] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-17T17:36:45.110688] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T17:36:45.558035] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-17T17:36:45.971977] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:36:46.358032] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-17T17:36:46.757342] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-17T17:36:47.158033] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-17T17:36:47.250389] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:36:47.958006] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-17T17:36:48.625199] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T17:36:48.757993] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-17T17:36:49.108017] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T17:36:49.126172] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:36:49.558029] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-17T17:36:50.358033] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-17T17:36:51.168596] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-17T17:36:51.170894] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:36:51.539249] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T17:36:51.958023] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-17T17:36:52.329551] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:36:52.758015] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-17T17:36:52.979922] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T17:36:53.558041] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-17T17:36:54.358029] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-17T17:36:54.571720] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T17:36:54.858393] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T17:36:54.925867] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:36:55.158049] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-17T17:36:55.958088] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-17T17:36:56.444918] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T17:36:56.445731] [INFO ] [REMOTE ] BHV: Full fetch complete (1398 records). [2025-10-17T17:36:56.445801] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-17T17:36:56.623841] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-17T17:36:56.624184] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:36:56.624256] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:36:56.624330] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-17T17:36:56.624394] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-17T17:36:56.624431] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-17T17:36:56.624470] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-17T17:36:56.624529] [INFO ] [MAIN ] Update Progress: 272/2368 symbols completed. BHV took 23.8s. Estimated remaining: 4h 44m 11s. Rate: 7.4 symbols/min [2025-10-17T17:36:56.766949] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-17T17:36:56.793716] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:56.852792] [DEBUG] [LOCAL ] BILL: Loaded 52887 existing records from primary storage. [2025-10-17T17:36:56.853272] [INFO ] [MAIN ] BILL: Loaded 52887 existing records. [2025-10-17T17:36:57.057840] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:57.058560] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-17T17:36:57.058764] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-17T17:36:57.059326] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-17T17:36:57.059411] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-17T17:36:57.389268] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-17T17:36:57.496730] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:57.558004] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-17T17:36:58.358032] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-17T17:36:58.528664] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:36:59.158116] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-17T17:36:59.495083] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T17:36:59.918218] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:36:59.957993] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-17T17:37:00.308252] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T17:37:00.758030] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-17T17:37:01.267037] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T17:37:01.558034] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-17T17:37:02.368856] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-17T17:37:02.371528] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:37:03.158093] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-17T17:37:03.503470] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:37:03.654950] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T17:37:03.662470] [INFO ] [REMOTE ] BHP: Full fetch complete (77442 records). [2025-10-17T17:37:03.662622] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-17T17:37:03.958700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-17T17:37:04.057508] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-17T17:37:04.057600] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-17T17:37:04.058579] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-17T17:37:04.058669] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-17T17:37:04.060231] [DEBUG] [LOCAL ] BHP: Trimmed 77442 records to 54152 (keeping 200 days of data) [2025-10-17T17:37:04.395216] [DEBUG] [LOCAL ] BHP: Primary data saved (54152 records). [2025-10-17T17:37:04.395406] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-17T17:37:04.395568] [INFO ] [MAIN ] Update Progress: 273/2368 symbols completed. BHP took 35.5s. Estimated remaining: 4h 43m 60s. Rate: 7.4 symbols/min [2025-10-17T17:37:04.575556] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:04.599507] [DEBUG] [LOCAL ] BIO: Loaded 24218 existing records from primary storage. [2025-10-17T17:37:04.599780] [INFO ] [MAIN ] BIO: Loaded 24218 existing records. [2025-10-17T17:37:04.775057] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-17T17:37:04.779141] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:04.781071] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-17T17:37:04.781271] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-17T17:37:04.781921] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-17T17:37:04.782018] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-17T17:37:04.921796] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:37:05.096893] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T17:37:05.139499] [INFO ] [REMOTE ] BHR: Full fetch complete (31440 records). [2025-10-17T17:37:05.149953] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-17T17:37:05.267044] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:05.563202] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-17T17:37:05.629732] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-17T17:37:05.630021] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-17T17:37:05.630796] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-17T17:37:05.630864] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-17T17:37:05.632074] [DEBUG] [LOCAL ] BHR: Trimmed 31440 records to 22426 (keeping 200 days of data) [2025-10-17T17:37:05.763269] [DEBUG] [LOCAL ] BHR: Primary data saved (22426 records). [2025-10-17T17:37:05.763417] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-17T17:37:05.763554] [INFO ] [MAIN ] Update Progress: 274/2368 symbols completed. BHR took 35.6s. Estimated remaining: 4h 43m 0s. Rate: 7.4 symbols/min [2025-10-17T17:37:05.948066] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:05.987226] [DEBUG] [LOCAL ] BIP: Loaded 39510 existing records from primary storage. [2025-10-17T17:37:05.987605] [INFO ] [MAIN ] BIP: Loaded 39510 existing records. [2025-10-17T17:37:06.164120] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:06.164362] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-17T17:37:06.164409] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-17T17:37:06.164789] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-17T17:37:06.164849] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-17T17:37:06.370232] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-17T17:37:06.577058] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:06.608379] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:37:07.044444] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:37:07.158015] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-17T17:37:07.451967] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:37:07.958036] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-17T17:37:08.758038] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-17T17:37:08.963694] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T17:37:09.558044] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-17T17:37:09.718554] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:37:10.111779] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T17:37:10.358045] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-17T17:37:10.613968] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T17:37:11.158059] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-17T17:37:11.958036] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-17T17:37:12.114212] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T17:37:12.147855] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:37:12.758032] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-17T17:37:13.526859] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:37:13.557985] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-17T17:37:14.024395] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T17:37:14.358064] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-17T17:37:14.833631] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:37:15.158069] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-17T17:37:15.918622] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T17:37:15.958007] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-17T17:37:16.359552] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T17:37:16.758023] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-17T17:37:17.504136] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:37:17.558008] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-17T17:37:18.357994] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-17T17:37:18.411708] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:37:19.025576] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:37:19.158060] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-17T17:37:19.848514] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:37:19.958043] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-17T17:37:20.758019] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-17T17:37:21.062532] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T17:37:21.270576] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:37:21.558042] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-17T17:37:22.358007] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-17T17:37:22.620470] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T17:37:22.670134] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:37:23.158084] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-17T17:37:23.411664] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T17:37:23.958044] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-17T17:37:24.758065] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-17T17:37:25.066499] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T17:37:25.074382] [INFO ] [REMOTE ] BHVN: Full fetch complete (70536 records). [2025-10-17T17:37:25.074603] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-17T17:37:25.466463] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-17T17:37:25.466584] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-17T17:37:25.467814] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-17T17:37:25.467884] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-17T17:37:25.469962] [DEBUG] [LOCAL ] BHVN: Trimmed 70536 records to 51375 (keeping 200 days of data) [2025-10-17T17:37:25.559177] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-17T17:37:25.801973] [DEBUG] [LOCAL ] BHVN: Primary data saved (51375 records). [2025-10-17T17:37:25.802217] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-17T17:37:25.803376] [INFO ] [MAIN ] Update Progress: 275/2368 symbols completed. BHVN took 51.6s. Estimated remaining: 4h 44m 23s. Rate: 7.4 symbols/min [2025-10-17T17:37:25.988482] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:26.031011] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T17:37:26.083777] [DEBUG] [LOCAL ] BIPC: Loaded 41583 existing records from primary storage. [2025-10-17T17:37:26.084172] [INFO ] [MAIN ] BIPC: Loaded 41583 existing records. [2025-10-17T17:37:26.264613] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:37:26.311479] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:26.312455] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-17T17:37:26.312542] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-17T17:37:26.313068] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-17T17:37:26.313144] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-17T17:37:26.363304] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-17T17:37:26.703272] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:26.850964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:37:27.158073] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-17T17:37:27.958080] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-17T17:37:28.346325] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T17:37:28.355007] [INFO ] [REMOTE ] BILL: Full fetch complete (76104 records). [2025-10-17T17:37:28.355218] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-17T17:37:28.771756] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-17T17:37:28.765492] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:37:28.792069] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-17T17:37:28.800529] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-17T17:37:28.801810] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-17T17:37:28.801911] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-17T17:37:28.804147] [DEBUG] [LOCAL ] BILL: Trimmed 76104 records to 53277 (keeping 200 days of data) [2025-10-17T17:37:29.136767] [DEBUG] [LOCAL ] BILL: Primary data saved (53277 records). [2025-10-17T17:37:29.136987] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-17T17:37:29.137091] [INFO ] [MAIN ] Update Progress: 276/2368 symbols completed. BILL took 32.5s. Estimated remaining: 4h 43m 38s. Rate: 7.4 symbols/min [2025-10-17T17:37:29.316419] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:29.322563] [DEBUG] [LOCAL ] BIPH: Loaded 2526 existing records from primary storage. [2025-10-17T17:37:29.322911] [INFO ] [MAIN ] BIPH: Loaded 2526 existing records. [2025-10-17T17:37:29.514399] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:29.515075] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-17T17:37:29.515137] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-17T17:37:29.515358] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-17T17:37:29.515442] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-17T17:37:29.563167] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-17T17:37:29.614542] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T17:37:29.950199] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:30.007567] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:37:30.358036] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-17T17:37:31.071122] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T17:37:31.158063] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-17T17:37:31.438989] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T17:37:31.958093] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-17T17:37:32.247185] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T17:37:32.659042] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T17:37:32.758038] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-17T17:37:33.558045] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-17T17:37:34.359859] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-17T17:37:34.364330] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:37:34.829735] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T17:37:34.945821] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:37:35.158066] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-17T17:37:35.958130] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-17T17:37:36.387840] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T17:37:36.717904] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:37:36.758092] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-17T17:37:37.438384] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T17:37:37.558045] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-17T17:37:38.358085] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-17T17:37:39.079209] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:37:39.086284] [INFO ] [REMOTE ] BIP: Full fetch complete (57566 records). [2025-10-17T17:37:39.086509] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-17T17:37:39.163289] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-17T17:37:39.469293] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-17T17:37:39.469383] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-17T17:37:39.470135] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-17T17:37:39.470198] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-17T17:37:39.471490] [DEBUG] [LOCAL ] BIP: Trimmed 57566 records to 39830 (keeping 200 days of data) [2025-10-17T17:37:39.708903] [DEBUG] [LOCAL ] BIP: Primary data saved (39830 records). [2025-10-17T17:37:39.709306] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-17T17:37:39.709425] [INFO ] [MAIN ] Update Progress: 277/2368 symbols completed. BIP took 33.9s. Estimated remaining: 4h 43m 48s. Rate: 7.4 symbols/min [2025-10-17T17:37:39.793386] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T17:37:39.958022] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-17T17:37:40.189211] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T17:37:40.758067] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-17T17:37:41.060682] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:37:41.558119] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-17T17:37:41.997578] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T17:37:42.358087] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-17T17:37:42.411313] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T17:37:42.879772] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T17:37:43.158052] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-17T17:37:43.958055] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-17T17:37:44.177595] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T17:37:44.181054] [INFO ] [REMOTE ] BIO: Full fetch complete (34302 records). [2025-10-17T17:37:44.181188] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-17T17:37:44.577508] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-17T17:37:44.577630] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-17T17:37:44.578305] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-17T17:37:44.578372] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-17T17:37:44.579369] [DEBUG] [LOCAL ] BIO: Trimmed 34302 records to 24345 (keeping 200 days of data) [2025-10-17T17:37:44.730628] [DEBUG] [LOCAL ] BIO: Primary data saved (24345 records). [2025-10-17T17:37:44.730858] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-17T17:37:44.730966] [INFO ] [MAIN ] Update Progress: 278/2368 symbols completed. BIO took 40.3s. Estimated remaining: 4h 43m 17s. Rate: 7.4 symbols/min [2025-10-17T17:37:44.758133] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-17T17:37:45.195723] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:37:45.373373] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T17:37:45.558042] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-17T17:37:46.358037] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-17T17:37:46.972978] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:37:47.104072] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T17:37:47.158089] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-17T17:37:47.597176] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T17:37:47.958055] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-17T17:37:48.758084] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-17T17:37:49.222312] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T17:37:49.223458] [INFO ] [REMOTE ] BIPH: Full fetch complete (3967 records). [2025-10-17T17:37:49.223531] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-17T17:37:49.648987] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:37:49.649201] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-17T17:37:49.658844] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-17T17:37:49.659535] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-17T17:37:49.659629] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-17T17:37:49.660586] [DEBUG] [LOCAL ] BIPH: Trimmed 3967 records to 2538 (keeping 200 days of data) [2025-10-17T17:37:49.661557] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-17T17:37:49.680343] [DEBUG] [LOCAL ] BIPH: Primary data saved (2538 records). [2025-10-17T17:37:49.680437] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-17T17:37:49.680524] [INFO ] [MAIN ] Update Progress: 279/2368 symbols completed. BIPH took 20.5s. Estimated remaining: 4h 42m 45s. Rate: 7.4 symbols/min [2025-10-17T17:37:51.211530] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T17:37:51.220459] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-17T17:37:53.123364] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:37:53.130138] [INFO ] [REMOTE ] BIPC: Full fetch complete (60309 records). [2025-10-17T17:37:53.130299] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-17T17:37:53.534319] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-17T17:37:53.534485] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-17T17:37:53.535450] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-17T17:37:53.535517] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-17T17:37:53.537402] [DEBUG] [LOCAL ] BIPC: Trimmed 60309 records to 41904 (keeping 200 days of data) [2025-10-17T17:37:53.805326] [DEBUG] [LOCAL ] BIPC: Primary data saved (41904 records). [2025-10-17T17:37:53.805502] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-17T17:37:53.806223] [INFO ] [MAIN ] Update Progress: 280/2368 symbols completed. BIPC took 28.0s. Estimated remaining: 4h 42m 7s. Rate: 7.4 symbols/min [2025-10-17T17:37:54.486746] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.544628] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.543098] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.578455] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.588354] [DEBUG] [LOCAL ] BIPI: Loaded 3012 existing records from primary storage. [2025-10-17T17:37:54.588899] [INFO ] [MAIN ] BIPI: Loaded 3012 existing records. [2025-10-17T17:37:54.604984] [DEBUG] [LOCAL ] BIPJ: Loaded 3180 existing records from primary storage. [2025-10-17T17:37:54.614866] [INFO ] [MAIN ] BIPJ: Loaded 3180 existing records. [2025-10-17T17:37:54.908780] [DEBUG] [LOCAL ] BIT: Loaded 23884 existing records from primary storage. [2025-10-17T17:37:54.944808] [INFO ] [MAIN ] BIT: Loaded 23884 existing records. [2025-10-17T17:37:54.949062] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:55.015547] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-17T17:37:55.033605] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-17T17:37:55.033211] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:55.049893] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-17T17:37:55.070374] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-17T17:37:55.105262] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-17T17:37:55.070443] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-17T17:37:55.131487] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-17T17:37:55.121034] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-17T17:37:55.136686] [DEBUG] [LOCAL ] BIRK: Loaded 51493 existing records from primary storage. [2025-10-17T17:37:55.160986] [INFO ] [MAIN ] BIRK: Loaded 51493 existing records. [2025-10-17T17:37:55.649706] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:55.710971] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-17T17:37:55.760566] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-17T17:37:55.819525] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-17T17:37:55.830253] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-17T17:37:55.986934] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:56.187244] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-17T17:37:56.197608] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-17T17:37:56.265838] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.293462] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-17T17:37:56.282262] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-17T17:37:56.360002] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-17T17:37:56.444682] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.472433] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-17T17:37:56.747480] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.764143] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-17T17:37:56.969218] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.969570] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-17T17:37:57.085089] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T17:37:57.086716] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-17T17:37:57.164371] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T17:37:57.167949] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-17T17:37:57.568582] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T17:37:57.570041] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-17T17:37:57.736767] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T17:37:57.738237] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-17T17:37:57.883433] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T17:37:57.889266] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-17T17:37:58.038002] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-17T17:37:58.080922] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T17:37:58.358042] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-17T17:37:58.876169] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T17:37:58.895928] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T17:37:58.947942] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T17:37:59.158066] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-17T17:37:59.714964] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:37:59.958054] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-17T17:38:00.758049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-17T17:38:01.212691] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T17:38:01.558075] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-17T17:38:01.925659] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T17:38:02.358041] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-17T17:38:02.521943] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T17:38:02.804157] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:38:03.158072] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-17T17:38:03.617032] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T17:38:03.958047] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-17T17:38:04.758016] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-17T17:38:04.992514] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T17:38:05.558077] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-17T17:38:06.301191] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:38:06.358078] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-17T17:38:06.599154] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:38:07.158079] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-17T17:38:07.569715] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:38:07.826276] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:38:07.958036] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-17T17:38:08.426797] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-17T17:38:08.758033] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-17T17:38:09.409959] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:38:09.558034] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-17T17:38:10.358032] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-17T17:38:10.922347] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:38:11.158076] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-17T17:38:11.315442] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:38:11.958050] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-17T17:38:12.532102] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:38:12.758030] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-17T17:38:13.558004] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-17T17:38:13.681925] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:38:13.816101] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:38:13.881711] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-17T17:38:14.358069] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-17T17:38:15.158053] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-17T17:38:15.759379] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T17:38:15.958007] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-17T17:38:16.076531] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T17:38:16.386714] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T17:38:16.758023] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-17T17:38:17.325107] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T17:38:17.326065] [INFO ] [REMOTE ] BIPI: Full fetch complete (4733 records). [2025-10-17T17:38:17.326133] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-17T17:38:17.566744] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-17T17:38:17.704024] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-17T17:38:17.704120] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-17T17:38:17.704351] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-17T17:38:17.704412] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-17T17:38:17.704848] [DEBUG] [LOCAL ] BIPI: Trimmed 4733 records to 3038 (keeping 200 days of data) [2025-10-17T17:38:17.723542] [DEBUG] [LOCAL ] BIPI: Primary data saved (3038 records). [2025-10-17T17:38:17.723694] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-17T17:38:17.723802] [INFO ] [MAIN ] Update Progress: 281/2368 symbols completed. BIPI took 23.9s. Estimated remaining: 4h 43m 56s. Rate: 7.4 symbols/min [2025-10-17T17:38:17.888943] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:17.938959] [DEBUG] [LOCAL ] BJ: Loaded 51977 existing records from primary storage. [2025-10-17T17:38:17.939294] [INFO ] [MAIN ] BJ: Loaded 51977 existing records. [2025-10-17T17:38:18.110247] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:18.110485] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-17T17:38:18.110532] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-17T17:38:18.111030] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-17T17:38:18.111086] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-17T17:38:18.361444] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-17T17:38:18.461983] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:18.595447] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:38:18.747163] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-17T17:38:19.158090] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-17T17:38:19.751249] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T17:38:19.752253] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4283 records). [2025-10-17T17:38:19.752325] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-17T17:38:19.963258] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-17T17:38:20.136051] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-17T17:38:20.136127] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-17T17:38:20.136259] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-17T17:38:20.136298] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-17T17:38:20.136661] [DEBUG] [LOCAL ] BIPJ: Trimmed 4283 records to 3197 (keeping 200 days of data) [2025-10-17T17:38:20.155248] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3197 records). [2025-10-17T17:38:20.155319] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-17T17:38:20.155389] [INFO ] [MAIN ] Update Progress: 282/2368 symbols completed. BIPJ took 26.3s. Estimated remaining: 4h 43m 6s. Rate: 7.4 symbols/min [2025-10-17T17:38:20.317771] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:20.370769] [DEBUG] [LOCAL ] BK: Loaded 53933 existing records from primary storage. [2025-10-17T17:38:20.371123] [INFO ] [MAIN ] BK: Loaded 53933 existing records. [2025-10-17T17:38:20.550494] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:20.550729] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-17T17:38:20.550784] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-17T17:38:20.551231] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-17T17:38:20.551289] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-17T17:38:20.764091] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-17T17:38:20.900099] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:21.202321] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:38:21.558055] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-17T17:38:22.358014] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-17T17:38:22.628770] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T17:38:23.158086] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-17T17:38:23.351926] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:38:23.690135] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:38:23.958043] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-17T17:38:24.758017] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-17T17:38:24.861507] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:38:25.558046] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-17T17:38:25.643386] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:38:26.234820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:38:26.358039] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-17T17:38:27.158184] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-17T17:38:27.409278] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T17:38:27.640122] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T17:38:27.644684] [INFO ] [REMOTE ] BIT: Full fetch complete (32177 records). [2025-10-17T17:38:27.644784] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-17T17:38:27.963326] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-17T17:38:28.058277] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-17T17:38:28.058360] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-17T17:38:28.058889] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-17T17:38:28.058952] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-17T17:38:28.059627] [DEBUG] [LOCAL ] BIT: Trimmed 32177 records to 24078 (keeping 200 days of data) [2025-10-17T17:38:28.201711] [DEBUG] [LOCAL ] BIT: Primary data saved (24078 records). [2025-10-17T17:38:28.201849] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-17T17:38:28.201934] [INFO ] [MAIN ] Update Progress: 283/2368 symbols completed. BIT took 34.4s. Estimated remaining: 4h 42m 57s. Rate: 7.4 symbols/min [2025-10-17T17:38:28.371613] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:28.433792] [DEBUG] [LOCAL ] BKD: Loaded 50839 existing records from primary storage. [2025-10-17T17:38:28.434190] [INFO ] [MAIN ] BKD: Loaded 50839 existing records. [2025-10-17T17:38:28.637580] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:28.637880] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-17T17:38:28.637937] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-17T17:38:28.638364] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-17T17:38:28.638430] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-17T17:38:28.758206] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-17T17:38:29.251876] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:29.256907] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-17T17:38:29.558258] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-17T17:38:29.712795] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:38:30.358044] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-17T17:38:30.455077] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:38:31.158074] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-17T17:38:31.439295] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:38:31.447226] [INFO ] [REMOTE ] BIRK: Full fetch complete (73369 records). [2025-10-17T17:38:31.447403] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-17T17:38:31.876476] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-17T17:38:31.876715] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-17T17:38:31.877539] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-17T17:38:31.877603] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-17T17:38:31.879006] [DEBUG] [LOCAL ] BIRK: Trimmed 73369 records to 51882 (keeping 200 days of data) [2025-10-17T17:38:31.961208] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-17T17:38:32.207096] [DEBUG] [LOCAL ] BIRK: Primary data saved (51882 records). [2025-10-17T17:38:32.210493] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-17T17:38:32.210717] [INFO ] [MAIN ] Update Progress: 284/2368 symbols completed. BIRK took 38.4s. Estimated remaining: 4h 42m 18s. Rate: 7.4 symbols/min [2025-10-17T17:38:32.212391] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T17:38:32.390533] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:32.426021] [DEBUG] [LOCAL ] BKE: Loaded 34197 existing records from primary storage. [2025-10-17T17:38:32.426477] [INFO ] [MAIN ] BKE: Loaded 34197 existing records. [2025-10-17T17:38:32.610561] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:32.611115] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-17T17:38:32.611223] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-17T17:38:32.621168] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-17T17:38:32.638017] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-17T17:38:32.706964] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:38:32.763169] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-17T17:38:33.078922] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:33.558040] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-17T17:38:33.808296] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T17:38:34.358051] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-17T17:38:34.609303] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T17:38:35.158041] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-17T17:38:35.249265] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:38:35.957992] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-17T17:38:36.317522] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T17:38:36.758002] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-17T17:38:37.055716] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T17:38:37.498910] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:38:37.558053] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-17T17:38:38.358078] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-17T17:38:38.547416] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:38:39.158006] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-17T17:38:39.321818] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T17:38:39.481708] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:38:39.958034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-17T17:38:40.758011] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-17T17:38:40.898466] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:38:41.391006] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T17:38:41.558042] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-17T17:38:42.302353] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:38:42.358015] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-17T17:38:42.874588] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T17:38:43.158071] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-17T17:38:43.810532] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:38:43.958029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-17T17:38:44.724068] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T17:38:44.757989] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-17T17:38:45.333250] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:38:45.558023] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-17T17:38:46.247181] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:38:46.358032] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-17T17:38:47.158046] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-17T17:38:47.390855] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T17:38:47.958070] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-17T17:38:48.339683] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T17:38:48.758091] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-17T17:38:49.093526] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T17:38:49.558013] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-17T17:38:49.928932] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T17:38:49.936328] [INFO ] [REMOTE ] BK: Full fetch complete (77678 records). [2025-10-17T17:38:49.936454] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-17T17:38:50.351361] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-17T17:38:50.352899] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:38:50.360257] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-17T17:38:50.360443] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-17T17:38:50.362546] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-17T17:38:50.362988] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-17T17:38:50.364468] [DEBUG] [LOCAL ] BK: Trimmed 77678 records to 54323 (keeping 200 days of data) [2025-10-17T17:38:50.695699] [DEBUG] [LOCAL ] BK: Primary data saved (54323 records). [2025-10-17T17:38:50.695841] [INFO ] [MAIN ] BK: Full history saved. [2025-10-17T17:38:50.695925] [INFO ] [MAIN ] Update Progress: 285/2368 symbols completed. BK took 30.5s. Estimated remaining: 4h 43m 26s. Rate: 7.3 symbols/min [2025-10-17T17:38:50.865067] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:50.898884] [DEBUG] [LOCAL ] BKH: Loaded 37416 existing records from primary storage. [2025-10-17T17:38:50.899164] [INFO ] [MAIN ] BKH: Loaded 37416 existing records. [2025-10-17T17:38:51.087175] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:51.087412] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-17T17:38:51.087495] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-17T17:38:51.088547] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-17T17:38:51.088731] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-17T17:38:51.163100] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-17T17:38:51.455813] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:51.485165] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T17:38:51.958000] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-17T17:38:52.046519] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:38:52.518343] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:38:52.758070] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-17T17:38:53.056068] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:38:53.558073] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-17T17:38:54.262999] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:38:54.358029] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-17T17:38:55.026307] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T17:38:55.157994] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-17T17:38:55.958008] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-17T17:38:56.038724] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T17:38:56.477695] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T17:38:56.758038] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-17T17:38:57.072091] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:38:57.558029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-17T17:38:58.358083] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-17T17:38:58.571384] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T17:38:59.073847] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T17:38:59.158117] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-17T17:38:59.789246] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:38:59.958078] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-17T17:39:00.758116] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-17T17:39:01.357755] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T17:39:01.366848] [INFO ] [REMOTE ] BJ: Full fetch complete (74432 records). [2025-10-17T17:39:01.367126] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-17T17:39:01.558502] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-17T17:39:01.816547] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:39:01.883697] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-17T17:39:01.884269] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-17T17:39:01.885424] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-17T17:39:01.885545] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-17T17:39:01.888428] [DEBUG] [LOCAL ] BJ: Trimmed 74432 records to 52353 (keeping 200 days of data) [2025-10-17T17:39:01.999786] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T17:39:02.276008] [DEBUG] [LOCAL ] BJ: Primary data saved (52353 records). [2025-10-17T17:39:02.276249] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-17T17:39:02.276363] [INFO ] [MAIN ] Update Progress: 286/2368 symbols completed. BJ took 44.6s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-17T17:39:02.363243] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-17T17:39:02.469496] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:02.513458] [DEBUG] [LOCAL ] BKKT: Loaded 36968 existing records from primary storage. [2025-10-17T17:39:02.513911] [INFO ] [MAIN ] BKKT: Loaded 36968 existing records. [2025-10-17T17:39:02.700279] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:02.700616] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-17T17:39:02.700708] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-17T17:39:02.701437] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-17T17:39:02.701506] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-17T17:39:03.085235] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:03.158009] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-17T17:39:03.451966] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T17:39:03.482933] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:39:03.487993] [INFO ] [REMOTE ] BKE: Full fetch complete (50185 records). [2025-10-17T17:39:03.488078] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-17T17:39:03.488806] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:39:03.488896] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:39:03.488939] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:39:03.488997] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-17T17:39:03.489055] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-17T17:39:03.489090] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-10-17T17:39:03.489230] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-10-17T17:39:03.489314] [INFO ] [MAIN ] Update Progress: 287/2368 symbols completed. BKE took 31.3s. Estimated remaining: 4h 42m 44s. Rate: 7.4 symbols/min [2025-10-17T17:39:03.659872] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:03.669381] [DEBUG] [LOCAL ] BKN: Loaded 7345 existing records from primary storage. [2025-10-17T17:39:03.669548] [INFO ] [MAIN ] BKN: Loaded 7345 existing records. [2025-10-17T17:39:03.843696] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:03.843878] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-17T17:39:03.843924] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-17T17:39:03.844102] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-17T17:39:03.844158] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-17T17:39:03.963162] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-17T17:39:04.196962] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:04.758038] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-17T17:39:05.175052] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T17:39:05.268805] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T17:39:05.558061] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-17T17:39:06.358007] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-17T17:39:06.412585] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:39:07.158038] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-17T17:39:07.220162] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T17:39:07.291756] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T17:39:07.958069] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-17T17:39:08.626297] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T17:39:08.758021] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-17T17:39:09.558006] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-17T17:39:09.758112] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:39:09.766054] [INFO ] [REMOTE ] BKD: Full fetch complete (72109 records). [2025-10-17T17:39:09.766395] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-17T17:39:10.158390] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-17T17:39:10.158608] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-17T17:39:10.159511] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-17T17:39:10.159592] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-17T17:39:10.180238] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T17:39:10.187638] [DEBUG] [LOCAL ] BKD: Trimmed 72109 records to 51205 (keeping 200 days of data) [2025-10-17T17:39:10.382147] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-17T17:39:10.485136] [DEBUG] [LOCAL ] BKD: Primary data saved (51205 records). [2025-10-17T17:39:10.485310] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-17T17:39:10.486735] [INFO ] [MAIN ] Update Progress: 288/2368 symbols completed. BKD took 42.3s. Estimated remaining: 4h 42m 27s. Rate: 7.4 symbols/min [2025-10-17T17:39:10.661409] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:10.717264] [DEBUG] [LOCAL ] BKSY: Loaded 49090 existing records from primary storage. [2025-10-17T17:39:10.717626] [INFO ] [MAIN ] BKSY: Loaded 49090 existing records. [2025-10-17T17:39:10.927163] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:10.927669] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-17T17:39:10.927748] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-17T17:39:10.928056] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-17T17:39:10.943417] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-17T17:39:10.988538] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:39:11.163380] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-17T17:39:11.341287] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:11.958000] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-17T17:39:12.061426] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:39:12.104687] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T17:39:12.757999] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-17T17:39:13.389262] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T17:39:13.558033] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-17T17:39:13.783515] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:39:14.358011] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-17T17:39:15.115164] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T17:39:15.158424] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-17T17:39:15.163048] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T17:39:15.933236] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T17:39:15.957991] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-17T17:39:16.689453] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T17:39:16.758035] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-17T17:39:17.558032] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-17T17:39:17.565838] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:39:18.358058] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-17T17:39:19.085013] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T17:39:19.158007] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-17T17:39:19.226058] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:39:19.766870] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:39:19.958054] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-17T17:39:20.758090] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-17T17:39:21.101940] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:39:21.558071] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-17T17:39:22.313831] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:39:22.357986] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-17T17:39:22.887481] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T17:39:23.158023] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-17T17:39:23.958061] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-17T17:39:24.081912] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T17:39:24.088919] [INFO ] [REMOTE ] BKH: Full fetch complete (52915 records). [2025-10-17T17:39:24.089138] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-17T17:39:24.503633] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-17T17:39:24.503770] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-17T17:39:24.504677] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-17T17:39:24.504750] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-17T17:39:24.506386] [DEBUG] [LOCAL ] BKH: Trimmed 52915 records to 37744 (keeping 200 days of data) [2025-10-17T17:39:24.732517] [DEBUG] [LOCAL ] BKH: Primary data saved (37744 records). [2025-10-17T17:39:24.732761] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-17T17:39:24.732889] [INFO ] [MAIN ] Update Progress: 289/2368 symbols completed. BKH took 34.0s. Estimated remaining: 4h 43m 3s. Rate: 7.3 symbols/min [2025-10-17T17:39:24.764074] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-17T17:39:24.909932] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:24.925823] [DEBUG] [LOCAL ] BKT: Loaded 12606 existing records from primary storage. [2025-10-17T17:39:24.926231] [INFO ] [MAIN ] BKT: Loaded 12606 existing records. [2025-10-17T17:39:25.110186] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:25.110612] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-17T17:39:25.110841] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-17T17:39:25.111102] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-17T17:39:25.111247] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-17T17:39:25.322067] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T17:39:25.464219] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-17T17:39:25.555130] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:25.555914] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:39:25.557877] [INFO ] [REMOTE ] BKN: Full fetch complete (11216 records). [2025-10-17T17:39:25.557995] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-17T17:39:25.557963] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-17T17:39:25.908932] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-17T17:39:25.909020] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-17T17:39:25.909306] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-17T17:39:25.909345] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-17T17:39:25.909822] [DEBUG] [LOCAL ] BKN: Trimmed 11216 records to 7394 (keeping 200 days of data) [2025-10-17T17:39:25.953386] [DEBUG] [LOCAL ] BKN: Primary data saved (7394 records). [2025-10-17T17:39:25.953507] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-17T17:39:25.953590] [INFO ] [MAIN ] Update Progress: 290/2368 symbols completed. BKN took 22.5s. Estimated remaining: 4h 42m 5s. Rate: 7.4 symbols/min [2025-10-17T17:39:26.117744] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:26.157189] [DEBUG] [LOCAL ] BKU: Loaded 42528 existing records from primary storage. [2025-10-17T17:39:26.157562] [INFO ] [MAIN ] BKU: Loaded 42528 existing records. [2025-10-17T17:39:26.350695] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:26.350938] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-17T17:39:26.350992] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-17T17:39:26.351234] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-17T17:39:26.351289] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-17T17:39:26.363891] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-17T17:39:26.699770] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:27.158038] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-17T17:39:27.526270] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:39:27.857328] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T17:39:27.957999] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-17T17:39:28.012823] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:39:28.758067] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-17T17:39:29.419076] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T17:39:29.558032] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-17T17:39:30.358017] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-17T17:39:30.430878] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:39:31.066606] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T17:39:31.157996] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-17T17:39:31.602310] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:39:31.958039] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-17T17:39:32.758092] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-17T17:39:32.843926] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:39:33.558066] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-17T17:39:33.922840] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T17:39:34.358894] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-17T17:39:34.368814] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:39:34.380049] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T17:39:35.157998] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-17T17:39:35.958171] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-17T17:39:35.969671] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T17:39:36.619398] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-17T17:39:36.758052] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-17T17:39:37.558032] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-17T17:39:37.855162] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T17:39:38.358057] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-17T17:39:38.496771] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T17:39:38.650270] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T17:39:39.158159] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-17T17:39:39.780035] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:39:39.958056] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-17T17:39:39.966259] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:39:40.758083] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-17T17:39:41.558041] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-17T17:39:42.010050] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T17:39:42.162066] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:39:42.358073] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-17T17:39:42.407902] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:39:43.158092] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-17T17:39:43.820302] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T17:39:43.958075] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-17T17:39:44.758072] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-17T17:39:45.187007] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T17:39:45.423455] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T17:39:45.558060] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-17T17:39:46.358019] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-17T17:39:47.050310] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T17:39:47.158046] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-17T17:39:47.184233] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-17T17:39:47.191550] [INFO ] [REMOTE ] BKKT: Full fetch complete (51581 records). [2025-10-17T17:39:47.191714] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-17T17:39:47.593324] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-17T17:39:47.593429] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-17T17:39:47.594124] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-17T17:39:47.594189] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-17T17:39:47.595344] [DEBUG] [LOCAL ] BKKT: Trimmed 51581 records to 37334 (keeping 200 days of data) [2025-10-17T17:39:47.814054] [DEBUG] [LOCAL ] BKKT: Primary data saved (37334 records). [2025-10-17T17:39:47.814214] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-17T17:39:47.814303] [INFO ] [MAIN ] Update Progress: 291/2368 symbols completed. BKKT took 45.5s. Estimated remaining: 4h 43m 35s. Rate: 7.3 symbols/min [2025-10-17T17:39:47.927798] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T17:39:47.968998] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-17T17:39:48.002872] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:48.032508] [DEBUG] [LOCAL ] BKV: Loaded 29852 existing records from primary storage. [2025-10-17T17:39:48.032815] [INFO ] [MAIN ] BKV: Loaded 29852 existing records. [2025-10-17T17:39:48.211612] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:48.211986] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-17T17:39:48.212082] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-17T17:39:48.212304] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-17T17:39:48.212385] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-17T17:39:48.404350] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T17:39:48.487502] [INFO ] [REMOTE ] BKSY: Full fetch complete (70445 records). [2025-10-17T17:39:48.503088] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-17T17:39:48.703967] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:48.764458] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-17T17:39:49.000353] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:39:48.999792] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-17T17:39:49.000509] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-17T17:39:49.004091] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-17T17:39:49.004568] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-17T17:39:49.006212] [DEBUG] [LOCAL ] BKSY: Trimmed 70445 records to 49470 (keeping 200 days of data) [2025-10-17T17:39:49.291158] [DEBUG] [LOCAL ] BKSY: Primary data saved (49470 records). [2025-10-17T17:39:49.291290] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-17T17:39:49.292493] [INFO ] [MAIN ] Update Progress: 292/2368 symbols completed. BKSY took 38.8s. Estimated remaining: 4h 42m 39s. Rate: 7.3 symbols/min [2025-10-17T17:39:49.462124] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:49.504897] [DEBUG] [LOCAL ] BLCO: Loaded 35460 existing records from primary storage. [2025-10-17T17:39:49.505239] [INFO ] [MAIN ] BLCO: Loaded 35460 existing records. [2025-10-17T17:39:49.565797] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-17T17:39:49.683576] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:49.683855] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-17T17:39:49.683907] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-17T17:39:49.684155] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-17T17:39:49.684211] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-17T17:39:50.040147] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:50.197928] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T17:39:50.358036] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-17T17:39:51.158195] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-17T17:39:51.159459] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:39:51.497719] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:39:51.958070] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-17T17:39:52.589529] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T17:39:52.758074] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-17T17:39:53.558016] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-17T17:39:53.668156] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T17:39:53.672142] [INFO ] [REMOTE ] BKT: Full fetch complete (16450 records). [2025-10-17T17:39:53.672427] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-17T17:39:53.790629] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T17:39:54.066116] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-17T17:39:54.066193] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-17T17:39:54.066560] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-17T17:39:54.066600] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-17T17:39:54.067131] [DEBUG] [LOCAL ] BKT: Trimmed 16450 records to 12781 (keeping 200 days of data) [2025-10-17T17:39:54.148370] [DEBUG] [LOCAL ] BKT: Primary data saved (12781 records). [2025-10-17T17:39:54.148551] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-17T17:39:54.148693] [INFO ] [MAIN ] Update Progress: 293/2368 symbols completed. BKT took 29.4s. Estimated remaining: 4h 42m 7s. Rate: 7.4 symbols/min [2025-10-17T17:39:54.316853] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:54.344409] [DEBUG] [LOCAL ] BLD: Loaded 27593 existing records from primary storage. [2025-10-17T17:39:54.344689] [INFO ] [MAIN ] BLD: Loaded 27593 existing records. [2025-10-17T17:39:54.364590] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-17T17:39:54.520900] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:54.521149] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-17T17:39:54.521219] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-17T17:39:54.521565] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-17T17:39:54.521637] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-17T17:39:54.901606] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:54.922716] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T17:39:55.158028] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-17T17:39:55.958062] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-17T17:39:56.015353] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:39:56.471456] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:39:56.758081] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-17T17:39:57.243712] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:39:57.558027] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-17T17:39:58.207076] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T17:39:58.358007] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-17T17:39:58.817006] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T17:39:59.158036] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-17T17:39:59.958015] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-17T17:40:00.258580] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:40:00.265190] [INFO ] [REMOTE ] BKU: Full fetch complete (60837 records). [2025-10-17T17:40:00.265304] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-17T17:40:00.687982] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-17T17:40:00.688153] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-17T17:40:00.689404] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-17T17:40:00.689504] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-17T17:40:00.691476] [DEBUG] [LOCAL ] BKU: Trimmed 60837 records to 42897 (keeping 200 days of data) [2025-10-17T17:40:00.759753] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-17T17:40:00.985726] [DEBUG] [LOCAL ] BKU: Primary data saved (42897 records). [2025-10-17T17:40:00.986033] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-17T17:40:00.986241] [INFO ] [MAIN ] Update Progress: 294/2368 symbols completed. BKU took 35.0s. Estimated remaining: 4h 41m 50s. Rate: 7.4 symbols/min [2025-10-17T17:40:01.181817] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:40:01.212724] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:01.276473] [DEBUG] [LOCAL ] BLDR: Loaded 52281 existing records from primary storage. [2025-10-17T17:40:01.276957] [INFO ] [MAIN ] BLDR: Loaded 52281 existing records. [2025-10-17T17:40:01.487932] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:01.488471] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-17T17:40:01.488533] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-17T17:40:01.489638] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-17T17:40:01.489735] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-17T17:40:01.567168] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-17T17:40:01.831456] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:40:01.916587] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:02.358063] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-17T17:40:02.516030] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:40:03.030200] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T17:40:03.158075] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-17T17:40:03.626466] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:40:03.958090] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-17T17:40:04.595953] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:40:04.758052] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-17T17:40:05.106465] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T17:40:05.558066] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-17T17:40:06.363532] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-17T17:40:06.367764] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T17:40:07.158067] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-17T17:40:07.378072] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T17:40:07.409034] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:40:07.958070] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-17T17:40:08.600544] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:40:08.758033] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-17T17:40:09.558050] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-17T17:40:09.671127] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:40:10.025387] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T17:40:10.358036] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-17T17:40:10.928191] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:40:11.158042] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-17T17:40:11.361989] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T17:40:11.958016] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-17T17:40:12.459332] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T17:40:12.758104] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-17T17:40:13.281307] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:40:13.558025] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-17T17:40:13.873338] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T17:40:14.358044] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-17T17:40:14.912334] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T17:40:15.157996] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-17T17:40:15.532114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T17:40:15.958041] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-17T17:40:16.758044] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-17T17:40:16.796210] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:40:17.558023] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-17T17:40:17.892939] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T17:40:18.133822] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:40:18.138725] [INFO ] [REMOTE ] BKV: Full fetch complete (44905 records). [2025-10-17T17:40:18.138818] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-17T17:40:18.363106] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-17T17:40:18.530112] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-17T17:40:18.530232] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-17T17:40:18.530913] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-17T17:40:18.531116] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-17T17:40:18.551444] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T17:40:18.550445] [DEBUG] [LOCAL ] BKV: Trimmed 44905 records to 30117 (keeping 200 days of data) [2025-10-17T17:40:18.730182] [DEBUG] [LOCAL ] BKV: Primary data saved (30117 records). [2025-10-17T17:40:18.730335] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-17T17:40:18.730420] [INFO ] [MAIN ] Update Progress: 295/2368 symbols completed. BKV took 30.9s. Estimated remaining: 4h 42m 49s. Rate: 7.3 symbols/min [2025-10-17T17:40:18.895205] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:18.909355] [DEBUG] [LOCAL ] BLE: Loaded 13880 existing records from primary storage. [2025-10-17T17:40:18.909556] [INFO ] [MAIN ] BLE: Loaded 13880 existing records. [2025-10-17T17:40:19.080379] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:19.080608] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-17T17:40:19.080825] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-17T17:40:19.081040] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-17T17:40:19.081080] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-17T17:40:19.163126] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-17T17:40:19.436615] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:19.778625] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T17:40:19.958145] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-17T17:40:20.758087] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-17T17:40:20.950188] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T17:40:21.113492] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:40:21.558009] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-17T17:40:22.017152] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T17:40:22.358108] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-17T17:40:23.158079] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-17T17:40:23.322378] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:40:23.582633] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T17:40:23.646177] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:40:23.958093] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-17T17:40:24.755104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T17:40:24.758599] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-17T17:40:25.558032] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-17T17:40:25.778468] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T17:40:26.358043] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-17T17:40:27.002600] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T17:40:27.007383] [INFO ] [REMOTE ] BLCO: Full fetch complete (52271 records). [2025-10-17T17:40:27.007573] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-17T17:40:27.162923] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-17T17:40:27.399061] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-17T17:40:27.399147] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-17T17:40:27.399878] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-17T17:40:27.399981] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-17T17:40:27.401281] [DEBUG] [LOCAL ] BLCO: Trimmed 52271 records to 35655 (keeping 200 days of data) [2025-10-17T17:40:27.606851] [DEBUG] [LOCAL ] BLCO: Primary data saved (35655 records). [2025-10-17T17:40:27.606995] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-17T17:40:27.607078] [INFO ] [MAIN ] Update Progress: 296/2368 symbols completed. BLCO took 38.3s. Estimated remaining: 4h 42m 46s. Rate: 7.3 symbols/min [2025-10-17T17:40:27.781955] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:27.816582] [DEBUG] [LOCAL ] BLK: Loaded 34632 existing records from primary storage. [2025-10-17T17:40:27.817035] [INFO ] [MAIN ] BLK: Loaded 34632 existing records. [2025-10-17T17:40:27.958325] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-17T17:40:28.000869] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:28.001193] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-17T17:40:28.001399] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-17T17:40:28.001888] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-17T17:40:28.001948] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-17T17:40:28.372349] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:40:28.444131] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:28.629563] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T17:40:28.745304] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T17:40:28.757999] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-17T17:40:29.543944] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T17:40:29.558017] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-17T17:40:30.358099] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-17T17:40:30.762345] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:40:30.766236] [INFO ] [REMOTE ] BLD: Full fetch complete (39873 records). [2025-10-17T17:40:30.766345] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-17T17:40:31.159504] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-17T17:40:31.159176] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-17T17:40:31.159703] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-17T17:40:31.161401] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-17T17:40:31.161466] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-17T17:40:31.162888] [DEBUG] [LOCAL ] BLD: Trimmed 39873 records to 27717 (keeping 200 days of data) [2025-10-17T17:40:31.343984] [DEBUG] [LOCAL ] BLD: Primary data saved (27717 records). [2025-10-17T17:40:31.344123] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-17T17:40:31.344210] [INFO ] [MAIN ] Update Progress: 297/2368 symbols completed. BLD took 37.2s. Estimated remaining: 4h 42m 7s. Rate: 7.3 symbols/min [2025-10-17T17:40:31.507821] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:31.553173] [DEBUG] [LOCAL ] BLND: Loaded 49649 existing records from primary storage. [2025-10-17T17:40:31.553514] [INFO ] [MAIN ] BLND: Loaded 49649 existing records. [2025-10-17T17:40:31.724431] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:31.724675] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-17T17:40:31.724736] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-17T17:40:31.725053] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-17T17:40:31.725092] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-17T17:40:31.963337] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-17T17:40:32.079888] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:32.363606] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T17:40:32.758050] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-17T17:40:33.016536] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T17:40:33.058913] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:40:33.558099] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-17T17:40:34.355438] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T17:40:34.358400] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-17T17:40:34.593188] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T17:40:35.158067] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-17T17:40:35.958059] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-17T17:40:36.095889] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T17:40:36.554086] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T17:40:36.757995] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-17T17:40:37.558075] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-17T17:40:37.695284] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T17:40:38.343574] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T17:40:38.357973] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-17T17:40:38.671279] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:40:39.158010] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-17T17:40:39.232447] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T17:40:39.234443] [INFO ] [REMOTE ] BLE: Full fetch complete (19696 records). [2025-10-17T17:40:39.234528] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-17T17:40:39.589217] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-17T17:40:39.589297] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-17T17:40:39.589698] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-17T17:40:39.589759] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-17T17:40:39.590309] [DEBUG] [LOCAL ] BLE: Trimmed 19696 records to 13930 (keeping 200 days of data) [2025-10-17T17:40:39.670055] [DEBUG] [LOCAL ] BLE: Primary data saved (13930 records). [2025-10-17T17:40:39.670194] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-17T17:40:39.670275] [INFO ] [MAIN ] Update Progress: 298/2368 symbols completed. BLE took 20.9s. Estimated remaining: 4h 41m 59s. Rate: 7.3 symbols/min [2025-10-17T17:40:39.835088] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:39.835276] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-17T17:40:39.835316] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-17T17:40:39.835429] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-17T17:40:39.835486] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-17T17:40:39.835527] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-17T17:40:39.835560] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-17T17:40:39.971856] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-17T17:40:40.188374] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:40.758017] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-17T17:40:40.842607] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:40:41.558003] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-17T17:40:41.775142] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:40:41.775451] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-17T17:40:41.775566] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:40:41.775616] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-17T17:40:41.775678] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:40:41.775752] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-17T17:40:41.775816] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-17T17:40:41.775851] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-17T17:40:41.775891] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-17T17:40:41.775939] [INFO ] [MAIN ] Update Progress: 299/2368 symbols completed. BLSH took 2.1s. Estimated remaining: 4h 41m 9s. Rate: 7.4 symbols/min [2025-10-17T17:40:41.949720] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:41.979108] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T17:40:41.999327] [DEBUG] [LOCAL ] BLW: Loaded 13261 existing records from primary storage. [2025-10-17T17:40:41.999560] [INFO ] [MAIN ] BLW: Loaded 13261 existing records. [2025-10-17T17:40:42.171799] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:42.171953] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-17T17:40:42.171998] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-17T17:40:42.172272] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-17T17:40:42.172328] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-17T17:40:42.376187] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-17T17:40:42.529623] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:42.622027] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T17:40:43.158014] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-17T17:40:43.958052] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-17T17:40:44.034630] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T17:40:44.199191] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T17:40:44.758022] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-17T17:40:45.558027] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-17T17:40:45.580130] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:40:45.820211] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:40:46.358031] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-17T17:40:47.158007] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-17T17:40:47.258995] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:40:47.678313] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T17:40:47.958010] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-17T17:40:48.270622] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:40:48.758093] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-17T17:40:49.403274] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T17:40:49.558038] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-17T17:40:50.358041] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-17T17:40:50.813837] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T17:40:50.821403] [INFO ] [REMOTE ] BLDR: Full fetch complete (74700 records). [2025-10-17T17:40:50.821584] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-17T17:40:51.168893] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-17T17:40:51.229763] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-17T17:40:51.229877] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-17T17:40:51.230892] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-17T17:40:51.230994] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-17T17:40:51.233145] [DEBUG] [LOCAL ] BLDR: Trimmed 74700 records to 52629 (keeping 200 days of data) [2025-10-17T17:40:51.360142] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:40:51.379089] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T17:40:51.608620] [DEBUG] [LOCAL ] BLDR: Primary data saved (52629 records). [2025-10-17T17:40:51.608792] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-17T17:40:51.608879] [INFO ] [MAIN ] Update Progress: 300/2368 symbols completed. BLDR took 50.6s. Estimated remaining: 4h 41m 13s. Rate: 7.4 symbols/min [2025-10-17T17:40:51.774739] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:51.792828] [DEBUG] [LOCAL ] BLX: Loaded 15678 existing records from primary storage. [2025-10-17T17:40:51.793064] [INFO ] [MAIN ] BLX: Loaded 15678 existing records. [2025-10-17T17:40:51.968387] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-17T17:40:51.973993] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:51.975223] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-17T17:40:51.975284] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-17T17:40:51.975515] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-17T17:40:51.975574] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-17T17:40:52.323324] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:52.758033] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-17T17:40:53.139743] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T17:40:53.558044] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-17T17:40:53.620612] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:40:53.673109] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:40:54.358082] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-17T17:40:54.661261] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T17:40:55.158045] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-17T17:40:55.958002] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-17T17:40:56.037343] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:40:56.113328] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T17:40:56.758004] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-17T17:40:57.189974] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T17:40:57.558023] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-17T17:40:58.358044] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-17T17:40:58.671232] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:40:59.158009] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-17T17:40:59.280321] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T17:40:59.296184] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T17:40:59.958103] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-17T17:41:00.758051] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-17T17:41:00.774807] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:41:01.133476] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:41:01.558035] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-17T17:41:01.998880] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:41:02.358033] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-17T17:41:03.158041] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-17T17:41:03.206222] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:41:03.284540] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T17:41:03.958027] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-17T17:41:04.765518] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-17T17:41:04.770294] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:41:04.778023] [INFO ] [REMOTE ] BLND: Full fetch complete (72298 records). [2025-10-17T17:41:04.778176] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-17T17:41:05.165831] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-17T17:41:05.165913] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-17T17:41:05.166698] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-17T17:41:05.166760] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-17T17:41:05.168154] [DEBUG] [LOCAL ] BLND: Trimmed 72298 records to 50014 (keeping 200 days of data) [2025-10-17T17:41:05.444525] [DEBUG] [LOCAL ] BLND: Primary data saved (50014 records). [2025-10-17T17:41:05.444697] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-17T17:41:05.444800] [INFO ] [MAIN ] Update Progress: 301/2368 symbols completed. BLND took 34.1s. Estimated remaining: 4h 41m 44s. Rate: 7.3 symbols/min [2025-10-17T17:41:05.568063] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-17T17:41:05.626799] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:05.656528] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T17:41:05.664526] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T17:41:05.694737] [DEBUG] [LOCAL ] BMA: Loaded 36440 existing records from primary storage. [2025-10-17T17:41:05.695032] [INFO ] [MAIN ] BMA: Loaded 36440 existing records. [2025-10-17T17:41:05.868228] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:05.868459] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-17T17:41:05.868509] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-17T17:41:05.868818] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-17T17:41:05.868876] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-17T17:41:06.241242] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:06.358005] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-17T17:41:06.796922] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T17:41:07.158035] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-17T17:41:07.918535] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T17:41:07.957998] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-17T17:41:08.743993] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T17:41:08.749418] [INFO ] [REMOTE ] BLK: Full fetch complete (52957 records). [2025-10-17T17:41:08.749519] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-17T17:41:08.763145] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-17T17:41:08.884575] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T17:41:09.141258] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-17T17:41:09.141337] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-17T17:41:09.141976] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-17T17:41:09.142039] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-17T17:41:09.143143] [DEBUG] [LOCAL ] BLK: Trimmed 52957 records to 34882 (keeping 200 days of data) [2025-10-17T17:41:09.367162] [DEBUG] [LOCAL ] BLK: Primary data saved (34882 records). [2025-10-17T17:41:09.367293] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-17T17:41:09.367375] [INFO ] [MAIN ] Update Progress: 302/2368 symbols completed. BLK took 41.8s. Estimated remaining: 4h 41m 6s. Rate: 7.3 symbols/min [2025-10-17T17:41:09.535595] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:09.547927] [DEBUG] [LOCAL ] BME: Loaded 11376 existing records from primary storage. [2025-10-17T17:41:09.548134] [INFO ] [MAIN ] BME: Loaded 11376 existing records. [2025-10-17T17:41:09.563128] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-17T17:41:09.729607] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:09.729869] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-17T17:41:09.729916] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-17T17:41:09.730108] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-17T17:41:09.730147] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-17T17:41:10.087571] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:10.358038] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-17T17:41:10.778089] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:41:11.097357] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-17T17:41:11.166870] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T17:41:11.166027] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-17T17:41:11.958098] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-17T17:41:12.618594] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T17:41:12.758029] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-17T17:41:12.909038] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T17:41:13.558040] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-17T17:41:14.127403] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T17:41:14.190582] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T17:41:14.358085] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-17T17:41:15.158101] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-17T17:41:15.401591] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:41:15.958130] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-17T17:41:16.652801] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:41:16.758035] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-17T17:41:17.055526] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:41:17.558041] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-17T17:41:18.288152] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:41:18.358040] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-17T17:41:18.650265] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T17:41:19.158057] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-17T17:41:19.289839] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:41:19.958025] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-17T17:41:20.033510] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T17:41:20.758056] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-17T17:41:20.918547] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:41:20.921080] [INFO ] [REMOTE ] BLW: Full fetch complete (19222 records). [2025-10-17T17:41:20.921177] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-17T17:41:21.293908] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-17T17:41:21.293998] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-17T17:41:21.294363] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-17T17:41:21.294403] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-17T17:41:21.294981] [DEBUG] [LOCAL ] BLW: Trimmed 19222 records to 13364 (keeping 200 days of data) [2025-10-17T17:41:21.378986] [DEBUG] [LOCAL ] BLW: Primary data saved (13364 records). [2025-10-17T17:41:21.379180] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-17T17:41:21.379343] [INFO ] [MAIN ] Update Progress: 303/2368 symbols completed. BLW took 39.6s. Estimated remaining: 4h 41m 24s. Rate: 7.3 symbols/min [2025-10-17T17:41:21.545024] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:21.560326] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-17T17:41:21.573300] [DEBUG] [LOCAL ] BMEZ: Loaded 26080 existing records from primary storage. [2025-10-17T17:41:21.573580] [INFO ] [MAIN ] BMEZ: Loaded 26080 existing records. [2025-10-17T17:41:21.747555] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:21.747791] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-17T17:41:21.747841] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-17T17:41:21.748127] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-17T17:41:21.748194] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-17T17:41:22.145044] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:22.170674] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:41:22.185258] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T17:41:22.358103] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-17T17:41:23.135562] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T17:41:23.138326] [INFO ] [REMOTE ] BLX: Full fetch complete (22499 records). [2025-10-17T17:41:23.138415] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-17T17:41:23.163406] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-17T17:41:23.523262] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-17T17:41:23.523364] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-17T17:41:23.523812] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-17T17:41:23.523875] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-17T17:41:23.524930] [DEBUG] [LOCAL ] BLX: Trimmed 22499 records to 15775 (keeping 200 days of data) [2025-10-17T17:41:23.625364] [DEBUG] [LOCAL ] BLX: Primary data saved (15775 records). [2025-10-17T17:41:23.625517] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-17T17:41:23.625616] [INFO ] [MAIN ] Update Progress: 304/2368 symbols completed. BLX took 32.0s. Estimated remaining: 4h 40m 36s. Rate: 7.4 symbols/min [2025-10-17T17:41:23.800421] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:23.834526] [DEBUG] [LOCAL ] BMI: Loaded 24756 existing records from primary storage. [2025-10-17T17:41:23.834910] [INFO ] [MAIN ] BMI: Loaded 24756 existing records. [2025-10-17T17:41:23.963128] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-17T17:41:24.026914] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:24.027203] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-17T17:41:24.027297] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-17T17:41:24.027757] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-17T17:41:24.027829] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-17T17:41:24.138531] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T17:41:24.397272] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:24.758063] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-17T17:41:25.264683] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:41:25.466887] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:41:25.557991] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-17T17:41:26.358026] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-17T17:41:27.115924] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:41:27.157983] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-17T17:41:27.616411] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:41:27.958048] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-17T17:41:28.758799] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-17T17:41:28.760733] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T17:41:28.766877] [INFO ] [REMOTE ] BMA: Full fetch complete (52113 records). [2025-10-17T17:41:28.766974] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-17T17:41:29.161766] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-17T17:41:29.161892] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-17T17:41:29.162677] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-17T17:41:29.162747] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-17T17:41:29.163959] [DEBUG] [LOCAL ] BMA: Trimmed 52113 records to 36733 (keeping 200 days of data) [2025-10-17T17:41:29.388926] [DEBUG] [LOCAL ] BMA: Primary data saved (36733 records). [2025-10-17T17:41:29.389076] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-17T17:41:29.389178] [INFO ] [MAIN ] Update Progress: 305/2368 symbols completed. BMA took 23.9s. Estimated remaining: 4h 40m 12s. Rate: 7.4 symbols/min [2025-10-17T17:41:29.560795] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-17T17:41:29.563765] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:29.586812] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:41:29.599864] [DEBUG] [LOCAL ] BMN: Loaded 2621 existing records from primary storage. [2025-10-17T17:41:29.600151] [INFO ] [MAIN ] BMN: Loaded 2621 existing records. [2025-10-17T17:41:29.688199] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T17:41:29.797197] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:29.797471] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-17T17:41:29.797533] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-17T17:41:29.797710] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-17T17:41:29.797766] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-17T17:41:30.148510] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:30.358091] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-17T17:41:30.375061] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:41:30.516485] [DEBUG] [REMOTE ] BMEZ: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-17T17:41:30.516816] [WARN ] [REMOTE ] BMEZ: No data returned for month 2025-01 [2025-10-17T17:41:30.516904] [FATAL] [REMOTE ] BMEZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:41:30.516986] [FATAL] [MAIN ] BMEZ: Failed to fetch primary data. [2025-10-17T17:41:30.517057] [WARN ] [MAIN ] BMEZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:41:30.517140] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-17T17:41:30.517228] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-17T17:41:30.517284] [INFO ] [LOCAL ] BMEZ: Starting deletion of derivative data. [2025-10-17T17:41:30.517465] [DEBUG] [LOCAL ] BMEZ: Deleted derivative data file. [2025-10-17T17:41:30.517558] [INFO ] [MAIN ] Update Progress: 306/2368 symbols completed. BMEZ took 9.1s. Estimated remaining: 4h 39m 16s. Rate: 7.4 symbols/min [2025-10-17T17:41:30.690454] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:30.729767] [DEBUG] [LOCAL ] BMO: Loaded 41606 existing records from primary storage. [2025-10-17T17:41:30.730121] [INFO ] [MAIN ] BMO: Loaded 41606 existing records. [2025-10-17T17:41:30.903813] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:30.904028] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-17T17:41:30.904082] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-17T17:41:30.904282] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-17T17:41:30.904320] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-17T17:41:31.163334] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-17T17:41:31.261603] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:31.958034] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-17T17:41:32.240738] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T17:41:32.469758] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-17T17:41:32.758054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-17T17:41:33.558028] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-17T17:41:33.708820] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T17:41:34.358044] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-17T17:41:35.126694] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:41:35.157994] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-17T17:41:35.433793] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:41:35.958043] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-17T17:41:36.758013] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-17T17:41:36.884603] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:41:37.366372] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T17:41:37.558014] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-17T17:41:37.626410] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:41:38.013423] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T17:41:38.358080] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-17T17:41:39.158078] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-17T17:41:39.849475] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:41:39.958030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-17T17:41:40.300205] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:41:40.758006] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-17T17:41:40.858477] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T17:41:41.450867] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:41:41.557990] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-17T17:41:42.358029] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-17T17:41:42.902527] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T17:41:43.158030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-17T17:41:43.515109] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T17:41:43.958065] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-17T17:41:44.030010] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T17:41:44.479306] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T17:41:44.758036] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-17T17:41:45.558053] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-17T17:41:45.927987] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T17:41:46.358107] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-17T17:41:46.461142] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T17:41:46.463368] [INFO ] [REMOTE ] BME: Full fetch complete (15879 records). [2025-10-17T17:41:46.463469] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-17T17:41:46.831827] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-17T17:41:46.831933] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-17T17:41:46.832318] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-17T17:41:46.832360] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-17T17:41:46.833045] [DEBUG] [LOCAL ] BME: Trimmed 15879 records to 11421 (keeping 200 days of data) [2025-10-17T17:41:46.906557] [DEBUG] [LOCAL ] BME: Primary data saved (11421 records). [2025-10-17T17:41:46.906766] [INFO ] [MAIN ] BME: Full history saved. [2025-10-17T17:41:46.906896] [INFO ] [MAIN ] Update Progress: 307/2368 symbols completed. BME took 37.5s. Estimated remaining: 4h 40m 3s. Rate: 7.4 symbols/min [2025-10-17T17:41:47.075079] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:47.128345] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-17T17:41:47.128688] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-10-17T17:41:47.169209] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-17T17:41:47.322479] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:47.322749] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-17T17:41:47.322806] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-17T17:41:47.323054] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-17T17:41:47.323121] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-17T17:41:47.649080] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T17:41:47.732631] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:47.750917] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T17:41:47.958080] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-17T17:41:48.758112] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-17T17:41:49.558042] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-17T17:41:50.022629] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T17:41:50.026736] [INFO ] [REMOTE ] BMI: Full fetch complete (33606 records). [2025-10-17T17:41:50.026825] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-17T17:41:50.132323] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T17:41:50.340926] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-17T17:41:50.363459] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-17T17:41:50.489163] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-17T17:41:50.489273] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-17T17:41:50.490049] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-17T17:41:50.490117] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-17T17:41:50.491050] [DEBUG] [LOCAL ] BMI: Trimmed 33606 records to 24957 (keeping 200 days of data) [2025-10-17T17:41:50.652016] [DEBUG] [LOCAL ] BMI: Primary data saved (24957 records). [2025-10-17T17:41:50.652158] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-17T17:41:50.652246] [INFO ] [MAIN ] Update Progress: 308/2368 symbols completed. BMI took 27.0s. Estimated remaining: 4h 39m 26s. Rate: 7.4 symbols/min [2025-10-17T17:41:50.818373] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:50.818547] [DEBUG] [LOCAL ] BN: No existing data file found in primary storage. [2025-10-17T17:41:50.818585] [WARN ] [MAIN ] BN: No existing data found, performing full refresh instead. [2025-10-17T17:41:50.818753] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-17T17:41:50.818825] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-17T17:41:50.818880] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-17T17:41:50.818914] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-17T17:41:51.169232] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-17T17:41:51.173857] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:51.620980] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:41:51.958085] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-17T17:41:52.373161] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T17:41:52.758093] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-17T17:41:53.267706] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:41:53.558055] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-17T17:41:54.358062] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-17T17:41:54.623955] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:41:55.053800] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:41:55.157994] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-17T17:41:55.958064] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-17T17:41:56.242626] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:41:56.544416] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T17:41:56.565566] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:41:56.758031] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-17T17:41:57.558047] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-17T17:41:58.256309] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:41:58.358024] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-17T17:41:59.158021] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-17T17:41:59.239631] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T17:41:59.599522] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:41:59.958021] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-17T17:42:00.084790] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T17:42:00.454909] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-17T17:42:00.758032] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-17T17:42:01.251861] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T17:42:01.558024] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-17T17:42:02.358047] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-17T17:42:03.005077] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T17:42:03.006088] [INFO ] [REMOTE ] BMN: Full fetch complete (3707 records). [2025-10-17T17:42:03.006161] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-17T17:42:03.168711] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-17T17:42:03.381585] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-17T17:42:03.381684] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-17T17:42:03.381822] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-17T17:42:03.381862] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-17T17:42:03.382200] [DEBUG] [LOCAL ] BMN: Trimmed 3707 records to 2635 (keeping 200 days of data) [2025-10-17T17:42:03.399510] [DEBUG] [LOCAL ] BMN: Primary data saved (2635 records). [2025-10-17T17:42:03.399583] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-17T17:42:03.399673] [INFO ] [MAIN ] Update Progress: 309/2368 symbols completed. BMN took 34.0s. Estimated remaining: 4h 39m 48s. Rate: 7.4 symbols/min [2025-10-17T17:42:03.600005] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:03.635286] [DEBUG] [LOCAL ] BNED: Loaded 28780 existing records from primary storage. [2025-10-17T17:42:03.635766] [INFO ] [MAIN ] BNED: Loaded 28780 existing records. [2025-10-17T17:42:03.797746] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T17:42:03.903078] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:03.903375] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-17T17:42:03.903428] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-17T17:42:03.903820] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-17T17:42:03.903884] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-17T17:42:03.964415] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-17T17:42:04.304158] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:04.758039] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-17T17:42:05.306795] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T17:42:05.558033] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-17T17:42:05.689687] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T17:42:06.358012] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-17T17:42:06.727230] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T17:42:07.158019] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-17T17:42:07.283194] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T17:42:07.958033] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-17T17:42:08.045434] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:42:08.758008] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-17T17:42:09.115762] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T17:42:09.385825] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T17:42:09.558018] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-17T17:42:10.358100] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-17T17:42:10.692469] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T17:42:10.698587] [INFO ] [REMOTE ] BMO: Full fetch complete (60024 records). [2025-10-17T17:42:10.698780] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-17T17:42:11.093400] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-17T17:42:11.093571] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-17T17:42:11.094311] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-17T17:42:11.094375] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-17T17:42:11.095849] [DEBUG] [LOCAL ] BMO: Trimmed 60024 records to 41935 (keeping 200 days of data) [2025-10-17T17:42:11.160380] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-17T17:42:11.359907] [DEBUG] [LOCAL ] BMO: Primary data saved (41935 records). [2025-10-17T17:42:11.360036] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-17T17:42:11.360115] [INFO ] [MAIN ] Update Progress: 310/2368 symbols completed. BMO took 40.8s. Estimated remaining: 4h 39m 39s. Rate: 7.4 symbols/min [2025-10-17T17:42:11.533197] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:11.540107] [DEBUG] [LOCAL ] BNH: Loaded 5044 existing records from primary storage. [2025-10-17T17:42:11.540317] [INFO ] [MAIN ] BNH: Loaded 5044 existing records. [2025-10-17T17:42:11.692430] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T17:42:11.766593] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:11.766819] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-17T17:42:11.766867] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-17T17:42:11.767119] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-17T17:42:11.767176] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-17T17:42:11.975631] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-17T17:42:12.131853] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:12.195853] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T17:42:12.624091] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-17T17:42:12.758065] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-17T17:42:13.428275] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T17:42:13.558000] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-17T17:42:13.647387] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:42:14.358024] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-17T17:42:14.702775] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T17:42:15.158072] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-17T17:42:15.756626] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:42:15.958099] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-17T17:42:16.512334] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T17:42:16.758096] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-17T17:42:17.269510] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:42:17.558031] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-17T17:42:18.357990] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-17T17:42:18.889334] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T17:42:18.927210] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T17:42:19.158055] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-17T17:42:19.734991] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T17:42:19.958051] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-17T17:42:20.226200] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T17:42:20.545762] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T17:42:20.758037] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-17T17:42:21.558049] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-17T17:42:22.123930] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T17:42:22.358077] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-17T17:42:22.482525] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T17:42:22.490314] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-17T17:42:22.490472] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-17T17:42:22.912365] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-17T17:42:22.912439] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-17T17:42:22.913276] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-17T17:42:22.913369] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-17T17:42:22.914833] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54537 (keeping 200 days of data) [2025-10-17T17:42:23.191851] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-17T17:42:23.246517] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-17T17:42:23.246791] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-17T17:42:23.247531] [INFO ] [MAIN ] Update Progress: 311/2368 symbols completed. BMY took 36.3s. Estimated remaining: 4h 39m 55s. Rate: 7.3 symbols/min [2025-10-17T17:42:23.422121] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:23.427637] [DEBUG] [LOCAL ] BNJ: Loaded 2620 existing records from primary storage. [2025-10-17T17:42:23.427894] [INFO ] [MAIN ] BNJ: Loaded 2620 existing records. [2025-10-17T17:42:23.665362] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T17:42:23.705179] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:23.706106] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-17T17:42:23.706156] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-17T17:42:23.706279] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-17T17:42:23.706321] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-17T17:42:23.967755] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-17T17:42:24.055914] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:24.758142] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-17T17:42:24.988772] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:42:25.039824] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T17:42:25.558028] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-17T17:42:25.646591] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T17:42:26.358154] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-17T17:42:26.887968] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:42:26.889141] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T17:42:27.158076] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-17T17:42:27.958020] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-17T17:42:27.968887] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:42:28.758072] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-17T17:42:29.558103] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-17T17:42:29.717492] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T17:42:30.044896] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T17:42:30.331696] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T17:42:30.357986] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-17T17:42:30.826592] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T17:42:31.158041] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-17T17:42:31.716639] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T17:42:31.958044] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-17T17:42:32.758038] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-17T17:42:33.558078] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-17T17:42:33.940464] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:42:34.029151] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:42:34.030194] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:42:34.036373] [INFO ] [REMOTE ] BNED: Full fetch complete (42394 records). [2025-10-17T17:42:34.036490] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-17T17:42:34.371423] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-17T17:42:34.424408] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-17T17:42:34.424495] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-17T17:42:34.425076] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-17T17:42:34.425140] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-17T17:42:34.426245] [DEBUG] [LOCAL ] BNED: Trimmed 42394 records to 28914 (keeping 200 days of data) [2025-10-17T17:42:34.590098] [DEBUG] [LOCAL ] BNED: Primary data saved (28914 records). [2025-10-17T17:42:34.590244] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-17T17:42:34.590328] [INFO ] [MAIN ] Update Progress: 312/2368 symbols completed. BNED took 31.2s. Estimated remaining: 4h 40m 8s. Rate: 7.3 symbols/min [2025-10-17T17:42:34.766559] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:34.813186] [DEBUG] [LOCAL ] BNL: Loaded 47629 existing records from primary storage. [2025-10-17T17:42:34.813509] [INFO ] [MAIN ] BNL: Loaded 47629 existing records. [2025-10-17T17:42:34.998713] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:34.998969] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-17T17:42:34.999018] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-17T17:42:34.999222] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-17T17:42:34.999261] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-17T17:42:35.162573] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-17T17:42:35.302087] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T17:42:35.402213] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:35.958104] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-17T17:42:36.672260] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T17:42:36.758059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-17T17:42:37.206689] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T17:42:37.220233] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T17:42:37.223263] [INFO ] [REMOTE ] BN: Full fetch complete (76953 records). [2025-10-17T17:42:37.223424] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-17T17:42:37.561830] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-17T17:42:37.608423] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-17T17:42:37.608510] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-17T17:42:37.609350] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-17T17:42:37.609416] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-17T17:42:37.611059] [DEBUG] [LOCAL ] BN: Trimmed 76953 records to 53768 (keeping 200 days of data) [2025-10-17T17:42:37.936622] [DEBUG] [LOCAL ] BN: Primary data saved (53768 records). [2025-10-17T17:42:37.937405] [INFO ] [MAIN ] BN: Full history saved. [2025-10-17T17:42:37.937525] [INFO ] [MAIN ] Update Progress: 313/2368 symbols completed. BN took 47.3s. Estimated remaining: 4h 39m 28s. Rate: 7.4 symbols/min [2025-10-17T17:42:38.117108] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:38.169992] [DEBUG] [LOCAL ] BNS: Loaded 51872 existing records from primary storage. [2025-10-17T17:42:38.170200] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:42:38.171768] [INFO ] [MAIN ] BNS: Loaded 51872 existing records. [2025-10-17T17:42:38.364412] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:38.359330] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-17T17:42:38.364861] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-17T17:42:38.366094] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-17T17:42:38.366845] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-17T17:42:38.367039] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-17T17:42:38.745534] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:39.066861] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T17:42:39.068213] [INFO ] [REMOTE ] BNH: Full fetch complete (6856 records). [2025-10-17T17:42:39.068287] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-17T17:42:39.163191] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-17T17:42:39.425686] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-17T17:42:39.425768] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-17T17:42:39.425950] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-17T17:42:39.425988] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-17T17:42:39.426359] [DEBUG] [LOCAL ] BNH: Trimmed 6856 records to 5065 (keeping 200 days of data) [2025-10-17T17:42:39.457598] [DEBUG] [LOCAL ] BNH: Primary data saved (5065 records). [2025-10-17T17:42:39.457723] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-17T17:42:39.457813] [INFO ] [MAIN ] Update Progress: 314/2368 symbols completed. BNH took 28.1s. Estimated remaining: 4h 38m 37s. Rate: 7.4 symbols/min [2025-10-17T17:42:39.624334] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:39.630282] [DEBUG] [LOCAL ] BNT: Loaded 3543 existing records from primary storage. [2025-10-17T17:42:39.630455] [INFO ] [MAIN ] BNT: Loaded 3543 existing records. [2025-10-17T17:42:39.711526] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T17:42:39.807929] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:39.808111] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-17T17:42:39.808158] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-17T17:42:39.808288] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-17T17:42:39.808325] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-17T17:42:39.962691] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-17T17:42:40.161096] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:40.566674] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T17:42:40.758023] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-17T17:42:41.233952] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T17:42:41.558029] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-17T17:42:41.980468] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-17T17:42:42.358096] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-17T17:42:42.893671] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T17:42:43.158076] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-17T17:42:43.766034] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T17:42:43.958089] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-17T17:42:44.758069] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-17T17:42:45.239469] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T17:42:45.558000] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-17T17:42:45.630090] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:42:45.882925] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-17T17:42:46.358046] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-17T17:42:47.158039] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-17T17:42:47.707945] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T17:42:47.709096] [INFO ] [REMOTE ] BNJ: Full fetch complete (3986 records). [2025-10-17T17:42:47.709164] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-17T17:42:47.960882] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-17T17:42:48.083807] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-17T17:42:48.083933] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-17T17:42:48.084218] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-17T17:42:48.084339] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-17T17:42:48.084859] [DEBUG] [LOCAL ] BNJ: Trimmed 3986 records to 2639 (keeping 200 days of data) [2025-10-17T17:42:48.134091] [DEBUG] [LOCAL ] BNJ: Primary data saved (2639 records). [2025-10-17T17:42:48.134872] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-17T17:42:48.136897] [INFO ] [MAIN ] Update Progress: 315/2368 symbols completed. BNJ took 24.9s. Estimated remaining: 4h 38m 32s. Rate: 7.4 symbols/min [2025-10-17T17:42:48.136740] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:42:48.323578] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:48.323797] [DEBUG] [LOCAL ] BNY: No existing data file found in primary storage. [2025-10-17T17:42:48.323877] [WARN ] [MAIN ] BNY: No existing data found, performing full refresh instead. [2025-10-17T17:42:48.324020] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-17T17:42:48.324063] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-17T17:42:48.324304] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-17T17:42:48.324339] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-17T17:42:48.692035] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:48.758025] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-17T17:42:49.557999] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-17T17:42:49.658379] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:42:49.697414] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T17:42:49.918228] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T17:42:50.358026] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-17T17:42:50.966087] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T17:42:51.158095] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-17T17:42:51.958055] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-17T17:42:52.758060] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-17T17:42:52.788335] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:42:53.371239] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:42:53.420874] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:42:53.558029] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-17T17:42:54.358049] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-17T17:42:54.414836] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T17:42:55.158048] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-17T17:42:55.784102] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T17:42:55.809391] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T17:42:55.958032] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-17T17:42:56.758057] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-17T17:42:57.558045] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-17T17:42:57.607063] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T17:42:57.610287] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T17:42:58.358033] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-17T17:42:58.373186] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:42:59.158034] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-17T17:42:59.887324] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-17T17:42:59.958062] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-17T17:43:00.099265] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:43:00.758002] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-17T17:43:00.841435] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-17T17:43:01.558047] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-17T17:43:02.358036] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-17T17:43:03.073016] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:43:03.166803] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-17T17:43:03.171892] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T17:43:03.958072] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-17T17:43:04.508041] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-17T17:43:04.651440] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (3.89 seconds). [2025-10-17T17:43:04.758000] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-17T17:43:05.183275] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:43:05.558036] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-17T17:43:05.606968] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T17:43:05.608858] [INFO ] [REMOTE ] BNY: Full fetch complete (10388 records). [2025-10-17T17:43:05.608934] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-17T17:43:05.981660] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-17T17:43:05.981750] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-17T17:43:05.981997] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-17T17:43:05.982037] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-17T17:43:05.982465] [DEBUG] [LOCAL ] BNY: Trimmed 10388 records to 7307 (keeping 200 days of data) [2025-10-17T17:43:06.025936] [DEBUG] [LOCAL ] BNY: Primary data saved (7307 records). [2025-10-17T17:43:06.026044] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-17T17:43:06.026117] [INFO ] [MAIN ] Update Progress: 316/2368 symbols completed. BNY took 17.9s. Estimated remaining: 4h 39m 27s. Rate: 7.3 symbols/min [2025-10-17T17:43:06.191092] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:06.215095] [DEBUG] [LOCAL ] BOC: Loaded 18699 existing records from primary storage. [2025-10-17T17:43:06.216257] [INFO ] [MAIN ] BOC: Loaded 18699 existing records. [2025-10-17T17:43:06.363209] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-17T17:43:06.405333] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:06.406405] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-17T17:43:06.406747] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-17T17:43:06.407392] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-17T17:43:06.407699] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-17T17:43:06.824055] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:06.865217] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T17:43:07.055024] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T17:43:07.158071] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-17T17:43:07.958123] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-17T17:43:08.765368] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-17T17:43:08.785408] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T17:43:09.054629] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:43:09.505861] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T17:43:09.558047] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-17T17:43:10.302691] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T17:43:10.358078] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-17T17:43:11.158060] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-17T17:43:11.284827] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:43:11.958048] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-17T17:43:12.398667] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T17:43:12.758075] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-17T17:43:12.811178] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:43:13.558040] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-17T17:43:14.358106] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-17T17:43:14.687560] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:43:14.954768] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T17:43:15.170100] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-17T17:43:15.173315] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T17:43:15.958043] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-17T17:43:16.219566] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:43:16.758054] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-17T17:43:17.558023] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-17T17:43:17.816583] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T17:43:17.855582] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T17:43:18.358069] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-17T17:43:19.163384] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-17T17:43:19.173160] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T17:43:19.180434] [INFO ] [REMOTE ] BNL: Full fetch complete (67301 records). [2025-10-17T17:43:19.180586] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-17T17:43:19.508627] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T17:43:19.618372] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-17T17:43:19.618469] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-17T17:43:19.619281] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-17T17:43:19.619352] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-17T17:43:19.620884] [DEBUG] [LOCAL ] BNL: Trimmed 67301 records to 47981 (keeping 200 days of data) [2025-10-17T17:43:19.915110] [DEBUG] [LOCAL ] BNL: Primary data saved (47981 records). [2025-10-17T17:43:19.915260] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-17T17:43:19.915348] [INFO ] [MAIN ] Update Progress: 317/2368 symbols completed. BNL took 45.3s. Estimated remaining: 4h 39m 56s. Rate: 7.3 symbols/min [2025-10-17T17:43:19.958033] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-17T17:43:20.003067] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:43:20.004401] [INFO ] [REMOTE ] BNT: Full fetch complete (4767 records). [2025-10-17T17:43:20.004474] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-17T17:43:20.370210] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-17T17:43:20.370287] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-17T17:43:20.370431] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-17T17:43:20.370470] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-17T17:43:20.370853] [DEBUG] [LOCAL ] BNT: Trimmed 4767 records to 3594 (keeping 200 days of data) [2025-10-17T17:43:20.392466] [DEBUG] [LOCAL ] BNT: Primary data saved (3594 records). [2025-10-17T17:43:20.392538] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-17T17:43:20.392610] [INFO ] [MAIN ] Update Progress: 318/2368 symbols completed. BNT took 40.9s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-17T17:43:20.758125] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-17T17:43:20.971115] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T17:43:21.558047] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-17T17:43:22.400447] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T17:43:22.411088] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-17T17:43:22.628074] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T17:43:23.158048] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-17T17:43:24.153568] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:43:24.165802] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-17T17:43:24.215045] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T17:43:24.758067] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-17T17:43:25.859152] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:43:25.863837] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-17T17:43:25.964088] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T17:43:26.358099] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-17T17:43:26.973415] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T17:43:26.977701] [INFO ] [REMOTE ] BOC: Full fetch complete (25893 records). [2025-10-17T17:43:26.977838] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-17T17:43:27.353027] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-17T17:43:27.353120] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-17T17:43:27.353541] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-17T17:43:27.353583] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-17T17:43:27.354346] [DEBUG] [LOCAL ] BOC: Trimmed 25893 records to 18798 (keeping 200 days of data) [2025-10-17T17:43:27.460500] [DEBUG] [LOCAL ] BOC: Primary data saved (18798 records). [2025-10-17T17:43:27.460673] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-17T17:43:27.460796] [INFO ] [MAIN ] Update Progress: 319/2368 symbols completed. BOC took 21.4s. Estimated remaining: 4h 38m 43s. Rate: 7.4 symbols/min [2025-10-17T17:43:28.270583] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T17:43:28.282010] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-17T17:43:30.066718] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:43:30.074070] [INFO ] [REMOTE ] BNS: Full fetch complete (74675 records). [2025-10-17T17:43:30.074233] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-17T17:43:30.480740] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-17T17:43:30.480830] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-17T17:43:30.481600] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-17T17:43:30.481662] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-17T17:43:30.483040] [DEBUG] [LOCAL ] BNS: Trimmed 74675 records to 52255 (keeping 200 days of data) [2025-10-17T17:43:30.795699] [DEBUG] [LOCAL ] BNS: Primary data saved (52255 records). [2025-10-17T17:43:30.795901] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-17T17:43:30.796855] [INFO ] [MAIN ] Update Progress: 320/2368 symbols completed. BNS took 52.9s. Estimated remaining: 4h 38m 4s. Rate: 7.4 symbols/min [2025-10-17T17:43:31.485573] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.464830] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.575331] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.594397] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.651959] [DEBUG] [LOCAL ] BOE: Loaded 18339 existing records from primary storage. [2025-10-17T17:43:31.654222] [DEBUG] [LOCAL ] BOND: Loaded 32683 existing records from primary storage. [2025-10-17T17:43:31.654630] [INFO ] [MAIN ] BOND: Loaded 32683 existing records. [2025-10-17T17:43:31.654542] [INFO ] [MAIN ] BOE: Loaded 18339 existing records. [2025-10-17T17:43:31.724518] [DEBUG] [LOCAL ] BOH: Loaded 30879 existing records from primary storage. [2025-10-17T17:43:31.811951] [INFO ] [MAIN ] BOH: Loaded 30879 existing records. [2025-10-17T17:43:31.823165] [DEBUG] [LOCAL ] BOOT: Loaded 40066 existing records from primary storage. [2025-10-17T17:43:31.888754] [INFO ] [MAIN ] BOOT: Loaded 40066 existing records. [2025-10-17T17:43:32.214202] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.339390] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.335679] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.373487] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-17T17:43:32.389878] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.421435] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-17T17:43:32.432805] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-17T17:43:32.426367] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.435348] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-17T17:43:32.435279] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-17T17:43:32.435214] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.451465] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-17T17:43:32.455274] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.489638] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-17T17:43:32.489800] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-17T17:43:32.475706] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-17T17:43:32.505362] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.540419] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-17T17:43:32.577255] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-17T17:43:32.587635] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-17T17:43:33.667173] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.716862] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-17T17:43:33.811463] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.834329] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.850968] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-17T17:43:33.861699] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-17T17:43:33.916618] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.916904] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-17T17:43:35.099446] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:43:35.104425] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-17T17:43:35.189791] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:43:35.196610] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-17T17:43:35.268575] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T17:43:35.275267] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-17T17:43:35.369188] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:43:35.377202] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-17T17:43:35.913017] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T17:43:35.918422] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-17T17:43:36.426359] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T17:43:36.433372] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-17T17:43:36.562017] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T17:43:36.569837] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-17T17:43:36.952373] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T17:43:36.957141] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-17T17:43:37.124103] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T17:43:37.559552] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-17T17:43:37.562907] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T17:43:37.861823] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T17:43:37.997395] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:43:38.358046] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-17T17:43:39.068041] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T17:43:39.158042] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-17T17:43:39.574808] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T17:43:39.958092] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-17T17:43:40.493982] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T17:43:40.758052] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-17T17:43:41.558036] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-17T17:43:41.645414] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:43:42.097183] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T17:43:42.357139] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T17:43:42.362376] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-17T17:43:43.158122] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-17T17:43:43.864790] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:43:43.958011] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-17T17:43:44.189628] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:43:44.758049] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-17T17:43:45.558030] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-17T17:43:45.810127] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T17:43:45.901931] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:43:46.358024] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-17T17:43:46.904508] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T17:43:47.158057] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-17T17:43:47.374143] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T17:43:47.958044] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-17T17:43:48.310607] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T17:43:48.758025] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-17T17:43:49.056394] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:43:49.558027] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-17T17:43:49.731584] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T17:43:50.358051] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-17T17:43:50.988252] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T17:43:51.158031] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-17T17:43:51.230180] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T17:43:51.958119] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-17T17:43:52.758053] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-17T17:43:52.857894] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T17:43:53.343574] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T17:43:53.558021] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-17T17:43:53.666125] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:43:54.358026] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-17T17:43:54.947147] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T17:43:55.154512] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T17:43:55.162240] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-17T17:43:55.958034] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-17T17:43:56.758005] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-17T17:43:56.841007] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:43:57.307222] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:43:57.558047] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-17T17:43:57.931247] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T17:43:58.358092] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-17T17:43:58.996134] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T17:43:59.158066] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-17T17:43:59.728757] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:43:59.733907] [INFO ] [REMOTE ] BOH: Full fetch complete (45451 records). [2025-10-17T17:43:59.734101] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-17T17:43:59.963152] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-17T17:44:00.123085] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-17T17:44:00.123168] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-17T17:44:00.123744] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-17T17:44:00.123807] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-17T17:44:00.124790] [DEBUG] [LOCAL ] BOH: Trimmed 45451 records to 31214 (keeping 200 days of data) [2025-10-17T17:44:00.321625] [DEBUG] [LOCAL ] BOH: Primary data saved (31214 records). [2025-10-17T17:44:00.321782] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-17T17:44:00.321889] [INFO ] [MAIN ] Update Progress: 321/2368 symbols completed. BOH took 29.5s. Estimated remaining: 4h 40m 12s. Rate: 7.3 symbols/min [2025-10-17T17:44:00.492820] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:00.540809] [DEBUG] [LOCAL ] BORR: Loaded 51498 existing records from primary storage. [2025-10-17T17:44:00.541118] [INFO ] [MAIN ] BORR: Loaded 51498 existing records. [2025-10-17T17:44:00.722530] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:00.722878] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-17T17:44:00.723026] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-17T17:44:00.729715] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-17T17:44:00.740785] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-17T17:44:00.773217] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T17:44:00.772030] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-17T17:44:01.126847] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:01.136042] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T17:44:01.139572] [INFO ] [REMOTE ] BOE: Full fetch complete (26745 records). [2025-10-17T17:44:01.139672] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-17T17:44:01.509819] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-17T17:44:01.509915] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-17T17:44:01.510391] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-17T17:44:01.510438] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-17T17:44:01.511188] [DEBUG] [LOCAL ] BOE: Trimmed 26745 records to 18435 (keeping 200 days of data) [2025-10-17T17:44:01.565716] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-17T17:44:01.622585] [DEBUG] [LOCAL ] BOE: Primary data saved (18435 records). [2025-10-17T17:44:01.622758] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-17T17:44:01.622862] [INFO ] [MAIN ] Update Progress: 322/2368 symbols completed. BOE took 30.8s. Estimated remaining: 4h 39m 20s. Rate: 7.3 symbols/min [2025-10-17T17:44:01.821622] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:01.849588] [DEBUG] [LOCAL ] BOW: Loaded 23436 existing records from primary storage. [2025-10-17T17:44:01.849909] [INFO ] [MAIN ] BOW: Loaded 23436 existing records. [2025-10-17T17:44:02.025084] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:02.025330] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-17T17:44:02.025380] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-17T17:44:02.025553] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-17T17:44:02.025593] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-17T17:44:02.360888] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-17T17:44:02.382953] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:03.066550] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T17:44:03.071608] [INFO ] [REMOTE ] BOND: Full fetch complete (46612 records). [2025-10-17T17:44:03.071734] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-17T17:44:03.166835] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-17T17:44:03.440983] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-17T17:44:03.441060] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-17T17:44:03.441626] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-17T17:44:03.441707] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-17T17:44:03.442614] [DEBUG] [LOCAL ] BOND: Trimmed 46612 records to 32938 (keeping 200 days of data) [2025-10-17T17:44:03.647207] [DEBUG] [LOCAL ] BOND: Primary data saved (32938 records). [2025-10-17T17:44:03.647375] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-17T17:44:03.647498] [INFO ] [MAIN ] Update Progress: 323/2368 symbols completed. BOND took 32.8s. Estimated remaining: 4h 38m 33s. Rate: 7.3 symbols/min [2025-10-17T17:44:03.821083] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:03.868772] [DEBUG] [LOCAL ] BOX: Loaded 50563 existing records from primary storage. [2025-10-17T17:44:03.869096] [INFO ] [MAIN ] BOX: Loaded 50563 existing records. [2025-10-17T17:44:04.045092] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:04.045344] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-17T17:44:04.045399] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-17T17:44:04.045808] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-17T17:44:04.045866] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-17T17:44:04.409558] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:04.410147] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-17T17:44:04.423432] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:44:04.457068] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T17:44:04.758067] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-17T17:44:05.564836] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-17T17:44:05.566867] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (4.79 seconds). [2025-10-17T17:44:06.083525] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:44:06.357994] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-17T17:44:06.553038] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:44:06.558793] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T17:44:07.158011] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-17T17:44:07.957990] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-17T17:44:08.056467] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T17:44:08.061851] [INFO ] [REMOTE ] BOOT: Full fetch complete (60084 records). [2025-10-17T17:44:08.061956] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-17T17:44:08.463833] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-17T17:44:08.463951] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-17T17:44:08.464638] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-17T17:44:08.464847] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-17T17:44:08.475590] [DEBUG] [LOCAL ] BOOT: Trimmed 60084 records to 40347 (keeping 200 days of data) [2025-10-17T17:44:08.494165] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T17:44:08.740042] [DEBUG] [LOCAL ] BOOT: Primary data saved (40347 records). [2025-10-17T17:44:08.740166] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-17T17:44:08.740242] [INFO ] [MAIN ] Update Progress: 324/2368 symbols completed. BOOT took 37.9s. Estimated remaining: 4h 38m 5s. Rate: 7.4 symbols/min [2025-10-17T17:44:08.763206] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-17T17:44:08.919569] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:08.970856] [DEBUG] [LOCAL ] BP: Loaded 54098 existing records from primary storage. [2025-10-17T17:44:08.971294] [INFO ] [MAIN ] BP: Loaded 54098 existing records. [2025-10-17T17:44:09.156572] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:09.156870] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-17T17:44:09.156921] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-17T17:44:09.157182] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-17T17:44:09.157240] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-17T17:44:09.538351] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:09.563304] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-17T17:44:09.580538] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:44:09.696352] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:44:10.358071] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-17T17:44:11.158085] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-17T17:44:11.328691] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:44:11.633629] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:44:11.958081] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-17T17:44:12.702517] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:44:12.758068] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-17T17:44:13.558034] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-17T17:44:14.170967] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T17:44:14.358008] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-17T17:44:14.701005] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:44:14.798036] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T17:44:15.158037] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-17T17:44:15.958100] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-17T17:44:16.507818] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T17:44:16.758078] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-17T17:44:17.056178] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T17:44:17.558032] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-17T17:44:17.939306] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-17T17:44:18.358044] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-17T17:44:18.662546] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T17:44:18.816404] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-17T17:44:19.158091] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-17T17:44:19.964679] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-17T17:44:19.997281] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:44:20.758084] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-17T17:44:20.944693] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T17:44:21.013890] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:44:21.558046] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-17T17:44:22.358026] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-17T17:44:22.388419] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T17:44:22.432887] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:44:23.158121] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-17T17:44:23.958102] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-17T17:44:24.584151] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T17:44:24.758015] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-17T17:44:24.935725] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T17:44:25.167284] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T17:44:25.558068] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-17T17:44:26.192476] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:44:26.292728] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T17:44:26.358055] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-17T17:44:27.158002] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-17T17:44:27.554837] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:44:27.559930] [INFO ] [REMOTE ] BOW: Full fetch complete (32117 records). [2025-10-17T17:44:27.560085] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-17T17:44:27.952048] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-17T17:44:27.952181] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-17T17:44:27.952664] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-17T17:44:27.952725] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-17T17:44:27.953477] [DEBUG] [LOCAL ] BOW: Trimmed 32117 records to 23579 (keeping 200 days of data) [2025-10-17T17:44:27.999988] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-17T17:44:28.088267] [DEBUG] [LOCAL ] BOW: Primary data saved (23579 records). [2025-10-17T17:44:28.088398] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-17T17:44:28.088478] [INFO ] [MAIN ] Update Progress: 325/2368 symbols completed. BOW took 26.5s. Estimated remaining: 4h 39m 7s. Rate: 7.3 symbols/min [2025-10-17T17:44:28.256510] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:28.291812] [DEBUG] [LOCAL ] BR: Loaded 35110 existing records from primary storage. [2025-10-17T17:44:28.292098] [INFO ] [MAIN ] BR: Loaded 35110 existing records. [2025-10-17T17:44:28.469782] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:28.470034] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-17T17:44:28.470082] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-17T17:44:28.470357] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-17T17:44:28.470414] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-17T17:44:28.763384] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-17T17:44:28.847482] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:29.190749] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T17:44:29.558062] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-17T17:44:29.994720] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T17:44:30.229055] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:44:30.358029] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-17T17:44:31.157998] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-17T17:44:31.251992] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:44:31.958089] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-17T17:44:32.674404] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T17:44:32.758080] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-17T17:44:32.855968] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:44:33.558031] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-17T17:44:33.657928] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T17:44:34.358079] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-17T17:44:34.817176] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T17:44:35.017848] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:44:35.158053] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-17T17:44:35.958067] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-17T17:44:36.515725] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T17:44:36.526244] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:44:36.525469] [INFO ] [REMOTE ] BOX: Full fetch complete (72306 records). [2025-10-17T17:44:36.533433] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-17T17:44:36.765446] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-17T17:44:36.919330] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-17T17:44:36.919410] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-17T17:44:36.920201] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-17T17:44:36.920265] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-17T17:44:36.921626] [DEBUG] [LOCAL ] BOX: Trimmed 72306 records to 50897 (keeping 200 days of data) [2025-10-17T17:44:37.213514] [DEBUG] [LOCAL ] BOX: Primary data saved (50897 records). [2025-10-17T17:44:37.213678] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-17T17:44:37.214155] [INFO ] [MAIN ] Update Progress: 326/2368 symbols completed. BOX took 33.6s. Estimated remaining: 4h 39m 5s. Rate: 7.3 symbols/min [2025-10-17T17:44:37.384583] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:37.433458] [DEBUG] [LOCAL ] BRBR: Loaded 52076 existing records from primary storage. [2025-10-17T17:44:37.433791] [INFO ] [MAIN ] BRBR: Loaded 52076 existing records. [2025-10-17T17:44:37.574503] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-17T17:44:37.616500] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:37.616719] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-17T17:44:37.616785] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-17T17:44:37.617105] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-17T17:44:37.617166] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-17T17:44:38.017834] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:38.020249] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T17:44:38.358109] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-17T17:44:38.709386] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T17:44:39.120136] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:44:39.157995] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-17T17:44:39.958006] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-17T17:44:40.178155] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T17:44:40.185244] [INFO ] [REMOTE ] BORR: Full fetch complete (74595 records). [2025-10-17T17:44:40.185390] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-17T17:44:40.585785] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-17T17:44:40.585907] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-17T17:44:40.586884] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-17T17:44:40.586987] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-17T17:44:40.588610] [DEBUG] [LOCAL ] BORR: Trimmed 74595 records to 51855 (keeping 200 days of data) [2025-10-17T17:44:40.780472] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-17T17:44:40.813332] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T17:44:40.927806] [DEBUG] [LOCAL ] BORR: Primary data saved (51855 records). [2025-10-17T17:44:40.928025] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-17T17:44:40.928141] [INFO ] [MAIN ] Update Progress: 327/2368 symbols completed. BORR took 40.6s. Estimated remaining: 4h 38m 29s. Rate: 7.3 symbols/min [2025-10-17T17:44:41.110683] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:41.137163] [DEBUG] [LOCAL ] BRC: Loaded 18774 existing records from primary storage. [2025-10-17T17:44:41.137628] [INFO ] [MAIN ] BRC: Loaded 18774 existing records. [2025-10-17T17:44:41.323321] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:41.323617] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-17T17:44:41.323700] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-17T17:44:41.323987] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-17T17:44:41.324027] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-17T17:44:41.568508] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-17T17:44:41.697913] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:41.909595] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T17:44:42.358043] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-17T17:44:42.445052] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T17:44:42.793082] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T17:44:43.158036] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-17T17:44:43.958081] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-17T17:44:44.438225] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T17:44:44.736328] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T17:44:44.757990] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-17T17:44:45.148181] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T17:44:45.558015] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-17T17:44:46.257341] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:44:46.358043] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-17T17:44:46.640197] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T17:44:47.158037] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-17T17:44:47.657241] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T17:44:47.941088] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:44:47.958073] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-17T17:44:48.758059] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-17T17:44:49.558004] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-17T17:44:49.593818] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T17:44:50.358041] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-17T17:44:51.023441] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:44:51.157993] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-17T17:44:51.528179] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-17T17:44:51.535810] [INFO ] [REMOTE ] BP: Full fetch complete (77882 records). [2025-10-17T17:44:51.535936] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-17T17:44:51.931798] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-17T17:44:51.931908] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-17T17:44:51.932798] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-17T17:44:51.932942] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-17T17:44:51.934551] [DEBUG] [LOCAL ] BP: Trimmed 77882 records to 54488 (keeping 200 days of data) [2025-10-17T17:44:51.987134] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-17T17:44:52.088372] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T17:44:52.301761] [DEBUG] [LOCAL ] BP: Primary data saved (54488 records). [2025-10-17T17:44:52.301895] [INFO ] [MAIN ] BP: Full history saved. [2025-10-17T17:44:52.302409] [INFO ] [MAIN ] Update Progress: 328/2368 symbols completed. BP took 43.6s. Estimated remaining: 4h 38m 40s. Rate: 7.3 symbols/min [2025-10-17T17:44:52.469083] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:52.469296] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-17T17:44:52.469372] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-17T17:44:52.469576] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-17T17:44:52.469672] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-17T17:44:52.469885] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-17T17:44:52.469942] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-17T17:44:52.760829] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-17T17:44:52.843783] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:44:52.847166] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:53.223983] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:44:53.558025] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-17T17:44:54.358012] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-17T17:44:54.634298] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T17:44:54.658890] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T17:44:55.158030] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-17T17:44:55.632110] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T17:44:55.958035] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-17T17:44:56.753718] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T17:44:56.763534] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-17T17:44:57.558011] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-17T17:44:57.622363] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T17:44:58.281830] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:44:58.287176] [INFO ] [REMOTE ] BR: Full fetch complete (50043 records). [2025-10-17T17:44:58.287297] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-17T17:44:58.364395] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-17T17:44:58.685316] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-17T17:44:58.685509] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-17T17:44:58.686236] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-17T17:44:58.686380] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-17T17:44:58.701117] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:44:58.706694] [DEBUG] [LOCAL ] BR: Trimmed 50043 records to 35340 (keeping 200 days of data) [2025-10-17T17:44:58.924368] [DEBUG] [LOCAL ] BR: Primary data saved (35340 records). [2025-10-17T17:44:58.924506] [INFO ] [MAIN ] BR: Full history saved. [2025-10-17T17:44:58.924589] [INFO ] [MAIN ] Update Progress: 329/2368 symbols completed. BR took 30.8s. Estimated remaining: 4h 38m 22s. Rate: 7.3 symbols/min [2025-10-17T17:44:59.093493] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:59.093678] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-17T17:44:59.093732] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-17T17:44:59.093865] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-17T17:44:59.093910] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-17T17:44:59.093950] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-17T17:44:59.093982] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-17T17:44:59.167633] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-17T17:44:59.446632] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:59.958063] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-17T17:45:00.227480] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T17:45:00.620305] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T17:45:00.758077] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-17T17:45:01.558038] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-17T17:45:01.847681] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T17:45:02.358011] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-17T17:45:02.359586] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:45:03.158023] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-17T17:45:03.232627] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T17:45:03.958124] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-17T17:45:04.137537] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:45:04.180034] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T17:45:04.758037] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-17T17:45:05.558051] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-17T17:45:05.628437] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:45:06.358039] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-17T17:45:06.570748] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:45:07.158018] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-17T17:45:07.391994] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:45:07.392450] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T17:45:07.958081] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-17T17:45:08.758108] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-17T17:45:08.830162] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T17:45:08.993088] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T17:45:09.004049] [INFO ] [REMOTE ] BRBR: Full fetch complete (72601 records). [2025-10-17T17:45:09.004288] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-17T17:45:09.005385] [FATAL] [VALIDATOR ] BRBR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:45:09.005526] [FATAL] [MAIN ] BRBR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:45:09.005593] [WARN ] [MAIN ] BRBR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:45:09.005711] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-17T17:45:09.005811] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-17T17:45:09.005869] [INFO ] [LOCAL ] BRBR: Starting deletion of derivative data. [2025-10-17T17:45:09.006103] [DEBUG] [LOCAL ] BRBR: Deleted derivative data file. [2025-10-17T17:45:09.006747] [INFO ] [MAIN ] Update Progress: 330/2368 symbols completed. BRBR took 31.8s. Estimated remaining: 4h 38m 26s. Rate: 7.3 symbols/min [2025-10-17T17:45:09.227994] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:09.288812] [DEBUG] [LOCAL ] BROS: Loaded 53690 existing records from primary storage. [2025-10-17T17:45:09.289215] [INFO ] [MAIN ] BROS: Loaded 53690 existing records. [2025-10-17T17:45:09.463429] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:45:09.463639] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-17T17:45:09.463720] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-17T17:45:09.464021] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-17T17:45:09.464076] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-17T17:45:09.561828] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-17T17:45:09.811041] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:10.358109] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-17T17:45:10.788036] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T17:45:11.130517] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:45:11.157992] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-17T17:45:11.958003] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-17T17:45:12.399450] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:45:12.682676] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T17:45:12.758010] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-17T17:45:12.980873] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T17:45:13.558029] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-17T17:45:13.915694] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T17:45:14.358087] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-17T17:45:15.158087] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-17T17:45:15.474274] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T17:45:15.958058] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-17T17:45:16.124618] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T17:45:16.758063] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-17T17:45:17.204339] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T17:45:17.241806] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T17:45:17.246172] [INFO ] [REMOTE ] BRC: Full fetch complete (28522 records). [2025-10-17T17:45:17.246292] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-17T17:45:17.563146] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-17T17:45:17.622828] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-17T17:45:17.622911] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-17T17:45:17.623355] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-17T17:45:17.623396] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-17T17:45:17.624286] [DEBUG] [LOCAL ] BRC: Trimmed 28522 records to 18893 (keeping 200 days of data) [2025-10-17T17:45:17.740014] [DEBUG] [LOCAL ] BRC: Primary data saved (18893 records). [2025-10-17T17:45:17.740166] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-17T17:45:17.740253] [INFO ] [MAIN ] Update Progress: 331/2368 symbols completed. BRC took 36.8s. Estimated remaining: 4h 38m 21s. Rate: 7.3 symbols/min [2025-10-17T17:45:17.910866] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:17.911082] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-17T17:45:17.911126] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-17T17:45:17.911250] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-17T17:45:17.911291] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-17T17:45:17.911332] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-17T17:45:17.911366] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-17T17:45:18.285446] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:18.317808] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:45:18.358003] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-17T17:45:19.158071] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-17T17:45:19.285627] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T17:45:19.958080] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-17T17:45:20.084251] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:45:20.652249] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:45:20.652568] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-17T17:45:20.652691] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:45:20.652751] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-17T17:45:20.652789] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:45:20.652855] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-17T17:45:20.652925] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-17T17:45:20.652971] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-17T17:45:20.653013] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-17T17:45:20.653063] [INFO ] [MAIN ] Update Progress: 332/2368 symbols completed. BRSL took 2.9s. Estimated remaining: 4h 37m 40s. Rate: 7.3 symbols/min [2025-10-17T17:45:20.762356] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-17T17:45:20.852706] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:45:20.888419] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:20.924771] [DEBUG] [LOCAL ] BRSP: Loaded 37050 existing records from primary storage. [2025-10-17T17:45:20.925098] [INFO ] [MAIN ] BRSP: Loaded 37050 existing records. [2025-10-17T17:45:21.163876] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:45:21.164097] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-17T17:45:21.164143] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-17T17:45:21.164417] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-17T17:45:21.164474] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-17T17:45:21.525776] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:21.558047] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-17T17:45:22.358100] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-17T17:45:22.803731] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:45:23.155738] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T17:45:23.164332] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-17T17:45:23.958078] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-17T17:45:24.330957] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:45:24.758050] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-17T17:45:25.034945] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T17:45:25.504579] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:45:25.510047] [INFO ] [REMOTE ] BRCC: Full fetch complete (57463 records). [2025-10-17T17:45:25.510151] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-17T17:45:25.563218] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-17T17:45:25.906493] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-17T17:45:25.906583] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-17T17:45:25.907281] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-17T17:45:25.907347] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-17T17:45:25.908732] [DEBUG] [LOCAL ] BRCC: Trimmed 57463 records to 40784 (keeping 200 days of data) [2025-10-17T17:45:26.133749] [DEBUG] [LOCAL ] BRCC: Primary data saved (40784 records). [2025-10-17T17:45:26.133872] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-17T17:45:26.133942] [INFO ] [MAIN ] Update Progress: 333/2368 symbols completed. BRCC took 33.8s. Estimated remaining: 4h 37m 16s. Rate: 7.3 symbols/min [2025-10-17T17:45:26.304307] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:45:26.349050] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:26.349286] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-17T17:45:26.349342] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-17T17:45:26.349503] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-17T17:45:26.349557] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-17T17:45:26.349603] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-17T17:45:26.349674] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-17T17:45:26.363208] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-17T17:45:26.726047] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:27.084759] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T17:45:27.158106] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-17T17:45:27.881824] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T17:45:27.958029] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-17T17:45:28.707109] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T17:45:28.758012] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-17T17:45:28.811319] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:45:29.360592] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:45:29.558032] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-17T17:45:30.358033] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-17T17:45:30.847893] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T17:45:31.158047] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-17T17:45:31.460840] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:45:31.471319] [INFO ] [REMOTE ] BRO: Full fetch complete (74971 records). [2025-10-17T17:45:31.471521] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-17T17:45:31.794226] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-17T17:45:31.886617] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-17T17:45:31.886729] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-17T17:45:31.887639] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-17T17:45:31.887723] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-17T17:45:31.889764] [DEBUG] [LOCAL ] BRO: Trimmed 74971 records to 52839 (keeping 200 days of data) [2025-10-17T17:45:31.979741] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-17T17:45:32.217705] [DEBUG] [LOCAL ] BRO: Primary data saved (52839 records). [2025-10-17T17:45:32.217848] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-17T17:45:32.217921] [INFO ] [MAIN ] Update Progress: 334/2368 symbols completed. BRO took 33.3s. Estimated remaining: 4h 36m 55s. Rate: 7.3 symbols/min [2025-10-17T17:45:32.392509] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:32.392709] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-17T17:45:32.392765] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-17T17:45:32.392881] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-17T17:45:32.392944] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-17T17:45:32.393012] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-17T17:45:32.393085] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-17T17:45:32.762720] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:32.762818] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-17T17:45:33.557991] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-17T17:45:33.650480] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:45:33.696080] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:45:34.219051] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T17:45:34.358059] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-17T17:45:34.460638] [DEBUG] [REMOTE ] BROS: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-17T17:45:34.460983] [WARN ] [REMOTE ] BROS: No data returned for month 2025-06 [2025-10-17T17:45:34.461075] [FATAL] [REMOTE ] BROS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:45:34.461175] [FATAL] [MAIN ] BROS: Failed to fetch primary data. [2025-10-17T17:45:34.461247] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:45:34.461324] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-17T17:45:34.461388] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-10-17T17:45:34.461425] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-10-17T17:45:34.461536] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-10-17T17:45:34.461999] [INFO ] [MAIN ] Update Progress: 335/2368 symbols completed. BROS took 25.5s. Estimated remaining: 4h 36m 11s. Rate: 7.4 symbols/min [2025-10-17T17:45:34.636290] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:34.636506] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-10-17T17:45:34.636571] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-10-17T17:45:34.636769] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-17T17:45:34.636823] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-17T17:45:34.636869] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-17T17:45:34.636904] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-17T17:45:34.995426] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:35.158024] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-17T17:45:35.958027] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-17T17:45:36.758008] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-17T17:45:36.859057] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:45:36.912500] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T17:45:37.443422] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T17:45:37.558026] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-17T17:45:38.358036] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-17T17:45:39.158016] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-17T17:45:39.224196] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:45:39.963460] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-17T17:45:39.969544] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:45:40.384610] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T17:45:40.454440] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T17:45:40.758078] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-17T17:45:41.558030] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-17T17:45:42.358052] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-17T17:45:42.410710] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:45:42.539696] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T17:45:42.799280] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:45:43.158074] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-17T17:45:43.958060] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-17T17:45:44.655394] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:45:44.669294] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:45:44.758030] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-17T17:45:45.371622] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T17:45:45.558046] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-17T17:45:46.358018] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-17T17:45:46.517971] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T17:45:47.105509] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T17:45:47.107146] [INFO ] [REMOTE ] BRT: Full fetch complete (7055 records). [2025-10-17T17:45:47.107240] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-17T17:45:47.163984] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-17T17:45:47.470498] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-17T17:45:47.470577] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-17T17:45:47.470825] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-17T17:45:47.470887] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-17T17:45:47.471320] [DEBUG] [LOCAL ] BRT: Trimmed 7055 records to 5316 (keeping 200 days of data) [2025-10-17T17:45:47.504080] [DEBUG] [LOCAL ] BRT: Primary data saved (5316 records). [2025-10-17T17:45:47.504208] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-17T17:45:47.504317] [INFO ] [MAIN ] Update Progress: 336/2368 symbols completed. BRT took 21.4s. Estimated remaining: 4h 36m 32s. Rate: 7.3 symbols/min [2025-10-17T17:45:47.709932] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:47.745734] [DEBUG] [LOCAL ] BSAC: Loaded 33148 existing records from primary storage. [2025-10-17T17:45:47.746028] [INFO ] [MAIN ] BSAC: Loaded 33148 existing records. [2025-10-17T17:45:47.922577] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:45:47.922805] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-17T17:45:47.922865] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-17T17:45:47.923174] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-17T17:45:47.923241] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-17T17:45:47.965380] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-17T17:45:48.272270] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:48.597412] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T17:45:48.758032] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-17T17:45:49.558068] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-17T17:45:49.658035] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:45:50.126977] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T17:45:50.305556] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T17:45:50.357995] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-17T17:45:51.158013] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-17T17:45:51.388766] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T17:45:51.958056] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-17T17:45:52.267467] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T17:45:52.758035] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-17T17:45:53.558042] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-17T17:45:53.776035] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:45:53.849841] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T17:45:54.357993] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-17T17:45:54.745809] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T17:45:55.158033] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-17T17:45:55.721148] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T17:45:55.958053] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-17T17:45:56.758041] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-17T17:45:56.866967] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:45:56.948565] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T17:45:57.558028] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-17T17:45:58.258460] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:45:58.358088] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-17T17:45:58.523618] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T17:45:59.158035] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-17T17:45:59.575794] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T17:45:59.958090] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-17T17:46:00.758094] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-17T17:46:01.132069] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:46:01.250557] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T17:46:01.558112] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-17T17:46:02.358038] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-17T17:46:02.423433] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:46:02.429910] [INFO ] [REMOTE ] BRSP: Full fetch complete (53985 records). [2025-10-17T17:46:02.430110] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-17T17:46:02.431174] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:46:02.431271] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:46:02.431316] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:46:02.431361] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-17T17:46:02.431444] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-17T17:46:02.431504] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-17T17:46:02.431701] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-17T17:46:02.431807] [INFO ] [MAIN ] Update Progress: 337/2368 symbols completed. BRSP took 41.8s. Estimated remaining: 4h 37m 5s. Rate: 7.3 symbols/min [2025-10-17T17:46:02.629587] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:02.629958] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-17T17:46:02.630005] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-17T17:46:02.630228] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-17T17:46:02.630286] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-17T17:46:02.630333] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-17T17:46:02.630369] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-17T17:46:03.077761] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:03.158032] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-17T17:46:03.281768] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T17:46:03.958066] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-17T17:46:04.012499] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:46:04.638370] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T17:46:04.763316] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-17T17:46:04.780662] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T17:46:05.558069] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-17T17:46:06.358079] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-17T17:46:07.158066] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-17T17:46:07.801665] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T17:46:07.958052] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-17T17:46:08.037635] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (3.27 seconds). [2025-10-17T17:46:08.167708] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T17:46:08.321033] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T17:46:08.758061] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-17T17:46:09.155149] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:46:09.159683] [INFO ] [REMOTE ] BRW: Full fetch complete (30294 records). [2025-10-17T17:46:09.160068] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-17T17:46:09.564997] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-17T17:46:09.573532] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-17T17:46:09.574904] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-17T17:46:09.575691] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-17T17:46:09.575818] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-17T17:46:09.577238] [DEBUG] [LOCAL ] BRW: Trimmed 30294 records to 21211 (keeping 200 days of data) [2025-10-17T17:46:09.714122] [DEBUG] [LOCAL ] BRW: Primary data saved (21211 records). [2025-10-17T17:46:09.714299] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-17T17:46:09.714414] [INFO ] [MAIN ] Update Progress: 338/2368 symbols completed. BRW took 37.5s. Estimated remaining: 4h 36m 51s. Rate: 7.3 symbols/min [2025-10-17T17:46:09.908708] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:09.921805] [DEBUG] [LOCAL ] BSL: Loaded 8327 existing records from primary storage. [2025-10-17T17:46:09.922077] [INFO ] [MAIN ] BSL: Loaded 8327 existing records. [2025-10-17T17:46:10.131430] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:10.132030] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-17T17:46:10.132336] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-17T17:46:10.141604] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-17T17:46:10.150705] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-17T17:46:10.226075] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:46:10.364680] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-17T17:46:10.555001] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:10.932628] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:46:11.158084] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-17T17:46:11.958037] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-17T17:46:12.132467] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T17:46:12.499236] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T17:46:12.558951] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T17:46:12.758067] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-17T17:46:13.558098] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-17T17:46:14.167548] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T17:46:14.358074] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-17T17:46:14.976626] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T17:46:15.158070] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-17T17:46:15.958035] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-17T17:46:16.083716] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T17:46:16.200538] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T17:46:16.209112] [INFO ] [REMOTE ] BRX: Full fetch complete (75151 records). [2025-10-17T17:46:16.209367] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-17T17:46:16.653795] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-17T17:46:16.653962] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-17T17:46:16.655129] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-17T17:46:16.655201] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-17T17:46:16.657616] [DEBUG] [LOCAL ] BRX: Trimmed 75151 records to 52572 (keeping 200 days of data) [2025-10-17T17:46:16.760042] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-17T17:46:17.025406] [DEBUG] [LOCAL ] BRX: Primary data saved (52572 records). [2025-10-17T17:46:17.025634] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-17T17:46:17.025790] [INFO ] [MAIN ] Update Progress: 339/2368 symbols completed. BRX took 42.6s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-17T17:46:17.224285] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:17.264009] [DEBUG] [LOCAL ] BSM: Loaded 32574 existing records from primary storage. [2025-10-17T17:46:17.264675] [INFO ] [MAIN ] BSM: Loaded 32574 existing records. [2025-10-17T17:46:17.488671] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:46:17.521172] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:17.522961] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-17T17:46:17.523077] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-17T17:46:17.523460] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-17T17:46:17.523531] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-17T17:46:17.563180] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-17T17:46:17.942445] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:18.087159] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:46:18.358104] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-17T17:46:19.010537] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T17:46:19.158112] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-17T17:46:19.827303] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T17:46:19.835286] [INFO ] [REMOTE ] BSAC: Full fetch complete (44986 records). [2025-10-17T17:46:19.835499] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-17T17:46:19.963134] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-17T17:46:20.325587] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-17T17:46:20.325749] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-17T17:46:20.326703] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-17T17:46:20.326781] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-17T17:46:20.331916] [DEBUG] [LOCAL ] BSAC: Trimmed 44986 records to 33351 (keeping 200 days of data) [2025-10-17T17:46:20.543701] [DEBUG] [LOCAL ] BSAC: Primary data saved (33351 records). [2025-10-17T17:46:20.544098] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-17T17:46:20.544291] [INFO ] [MAIN ] Update Progress: 340/2368 symbols completed. BSAC took 33.0s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-17T17:46:20.684638] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T17:46:20.751988] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:20.752313] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-17T17:46:20.752416] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-17T17:46:20.752856] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-17T17:46:20.753020] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-17T17:46:20.753088] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-17T17:46:20.753132] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-17T17:46:20.758389] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-17T17:46:20.901230] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:46:21.255759] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:21.558064] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-17T17:46:21.666184] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:46:22.358017] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-17T17:46:22.805423] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:46:23.158036] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-17T17:46:23.550620] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T17:46:23.958099] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-17T17:46:24.405442] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:46:24.758067] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-17T17:46:25.363277] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:46:25.558019] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-17T17:46:25.722066] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T17:46:26.358034] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-17T17:46:27.158027] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-17T17:46:27.195441] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:46:27.746371] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T17:46:27.898352] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T17:46:27.957995] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-17T17:46:28.758060] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-17T17:46:29.306171] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T17:46:29.558010] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-17T17:46:29.827045] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:46:30.358052] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-17T17:46:30.931699] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T17:46:31.158032] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-17T17:46:31.702445] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T17:46:31.958003] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-17T17:46:32.254451] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:46:32.757999] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-17T17:46:33.196288] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T17:46:33.558026] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-17T17:46:33.965960] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:46:34.245898] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:46:34.358027] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-17T17:46:35.158035] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-17T17:46:35.274357] [DEBUG] [REMOTE ] BSL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T17:46:35.274719] [WARN ] [REMOTE ] BSL: No data returned for month 2025-07 [2025-10-17T17:46:35.274810] [FATAL] [REMOTE ] BSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:46:35.274889] [FATAL] [MAIN ] BSL: Failed to fetch primary data. [2025-10-17T17:46:35.274951] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:46:35.275022] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-17T17:46:35.275087] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-17T17:46:35.275123] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-17T17:46:35.275237] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-17T17:46:35.275302] [INFO ] [MAIN ] Update Progress: 341/2368 symbols completed. BSL took 25.6s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-17T17:46:35.449383] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:35.449607] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-17T17:46:35.449683] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-17T17:46:35.449798] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-17T17:46:35.449841] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-17T17:46:35.449882] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-17T17:46:35.449914] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-17T17:46:35.822530] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:35.837229] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:46:35.958010] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-17T17:46:36.758039] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-17T17:46:37.279094] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:46:37.558029] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-17T17:46:38.192972] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:46:38.331753] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:46:38.358025] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-17T17:46:39.158033] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-17T17:46:39.506407] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T17:46:39.958024] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-17T17:46:40.325878] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:46:40.758046] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-17T17:46:41.490092] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T17:46:41.558108] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-17T17:46:41.809354] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T17:46:42.358043] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-17T17:46:42.811680] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T17:46:43.158029] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-17T17:46:43.796630] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T17:46:43.802839] [INFO ] [REMOTE ] BSBR: Full fetch complete (51129 records). [2025-10-17T17:46:43.803001] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-17T17:46:43.965791] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-17T17:46:44.207469] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-17T17:46:44.207716] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-17T17:46:44.208414] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-17T17:46:44.208465] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-17T17:46:44.209768] [DEBUG] [LOCAL ] BSBR: Trimmed 51129 records to 36277 (keeping 200 days of data) [2025-10-17T17:46:44.304566] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T17:46:44.432803] [DEBUG] [LOCAL ] BSBR: Primary data saved (36277 records). [2025-10-17T17:46:44.432958] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-17T17:46:44.433043] [INFO ] [MAIN ] Update Progress: 342/2368 symbols completed. BSBR took 42.0s. Estimated remaining: 4h 36m 30s. Rate: 7.3 symbols/min [2025-10-17T17:46:44.600445] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:44.651312] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-17T17:46:44.651616] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-10-17T17:46:44.763235] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-17T17:46:44.830850] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:44.831029] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-17T17:46:44.831116] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-17T17:46:44.831382] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-17T17:46:44.831429] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-17T17:46:45.193241] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:45.268744] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:46:45.558041] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-17T17:46:45.804049] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:46:46.358042] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-17T17:46:46.757495] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T17:46:47.158068] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-17T17:46:47.376083] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T17:46:47.958082] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-17T17:46:48.450908] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T17:46:48.758027] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-17T17:46:49.273404] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T17:46:49.278521] [INFO ] [REMOTE ] BSM: Full fetch complete (46940 records). [2025-10-17T17:46:49.278725] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-17T17:46:49.563194] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-17T17:46:49.679760] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-17T17:46:49.679897] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-17T17:46:49.681037] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-17T17:46:49.681131] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-17T17:46:49.699238] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T17:46:49.705623] [DEBUG] [LOCAL ] BSM: Trimmed 46940 records to 32822 (keeping 200 days of data) [2025-10-17T17:46:49.930079] [DEBUG] [LOCAL ] BSM: Primary data saved (32822 records). [2025-10-17T17:46:49.930237] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-17T17:46:49.930324] [INFO ] [MAIN ] Update Progress: 343/2368 symbols completed. BSM took 32.9s. Estimated remaining: 4h 36m 6s. Rate: 7.3 symbols/min [2025-10-17T17:46:50.100330] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:50.108097] [DEBUG] [LOCAL ] BTA: Loaded 5735 existing records from primary storage. [2025-10-17T17:46:50.108285] [INFO ] [MAIN ] BTA: Loaded 5735 existing records. [2025-10-17T17:46:50.280939] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:50.281196] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-17T17:46:50.281243] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-17T17:46:50.281397] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-17T17:46:50.281454] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-17T17:46:50.363137] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-17T17:46:50.648008] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:51.158065] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-17T17:46:51.485997] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T17:46:51.549589] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:46:51.958141] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-17T17:46:52.010504] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:46:52.758098] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-17T17:46:53.558093] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-17T17:46:53.624536] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:46:53.667234] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T17:46:54.358110] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-17T17:46:55.146625] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T17:46:55.157997] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-17T17:46:55.369903] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T17:46:55.803336] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T17:46:55.958069] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-17T17:46:56.758054] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-17T17:46:57.073474] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T17:46:57.372815] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:46:57.558023] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-17T17:46:58.358076] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-17T17:46:59.158016] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-17T17:46:59.430818] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T17:46:59.539526] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T17:46:59.958083] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-17T17:47:00.429314] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:47:00.434598] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36705 records). [2025-10-17T17:47:00.434893] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-17T17:47:00.763137] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-17T17:47:00.833233] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-17T17:47:00.833326] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-17T17:47:00.833856] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-17T17:47:00.833922] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-17T17:47:00.834979] [DEBUG] [LOCAL ] BSTZ: Trimmed 36705 records to 25243 (keeping 200 days of data) [2025-10-17T17:47:00.989395] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25243 records). [2025-10-17T17:47:00.989537] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-17T17:47:00.989614] [INFO ] [MAIN ] Update Progress: 344/2368 symbols completed. BSTZ took 25.7s. Estimated remaining: 4h 36m 15s. Rate: 7.3 symbols/min [2025-10-17T17:47:01.165456] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:01.183414] [DEBUG] [LOCAL ] BTCM: Loaded 17122 existing records from primary storage. [2025-10-17T17:47:01.183661] [INFO ] [MAIN ] BTCM: Loaded 17122 existing records. [2025-10-17T17:47:01.362007] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:01.362183] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-17T17:47:01.362231] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-17T17:47:01.362386] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-17T17:47:01.362450] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-17T17:47:01.576177] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-17T17:47:01.727504] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:02.280691] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T17:47:02.300262] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T17:47:02.303146] [INFO ] [REMOTE ] BST: Full fetch complete (28356 records). [2025-10-17T17:47:02.303294] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-17T17:47:02.303883] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:47:02.303978] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:47:02.304022] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:47:02.304089] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-17T17:47:02.304155] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-17T17:47:02.304193] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-17T17:47:02.304233] [DEBUG] [LOCAL ] BST: No derivative data file found to delete. [2025-10-17T17:47:02.304294] [INFO ] [MAIN ] Update Progress: 345/2368 symbols completed. BST took 41.8s. Estimated remaining: 4h 35m 26s. Rate: 7.3 symbols/min [2025-10-17T17:47:02.363275] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-17T17:47:02.484898] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:02.533092] [DEBUG] [LOCAL ] BTE: Loaded 53118 existing records from primary storage. [2025-10-17T17:47:02.533397] [INFO ] [MAIN ] BTE: Loaded 53118 existing records. [2025-10-17T17:47:02.719428] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:02.719669] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-17T17:47:02.719731] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-17T17:47:02.720014] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-17T17:47:02.720053] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-17T17:47:03.074839] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:47:03.079802] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:03.157987] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-17T17:47:03.734731] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T17:47:03.958023] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-17T17:47:04.263037] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T17:47:04.359543] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-17T17:47:04.758049] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-17T17:47:05.558033] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-17T17:47:06.358002] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-17T17:47:06.583356] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:47:06.817372] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:47:07.106536] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T17:47:07.158061] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-17T17:47:07.958093] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-17T17:47:08.758045] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-17T17:47:09.083296] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T17:47:09.241422] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T17:47:09.387511] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T17:47:09.558000] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-17T17:47:10.358080] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-17T17:47:11.027006] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T17:47:11.028590] [INFO ] [REMOTE ] BTA: Full fetch complete (9544 records). [2025-10-17T17:47:11.028693] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-17T17:47:11.170126] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-17T17:47:11.399027] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-17T17:47:11.399125] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-17T17:47:11.399424] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-17T17:47:11.399503] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-17T17:47:11.400024] [DEBUG] [LOCAL ] BTA: Trimmed 9544 records to 5810 (keeping 200 days of data) [2025-10-17T17:47:11.438119] [DEBUG] [LOCAL ] BTA: Primary data saved (5810 records). [2025-10-17T17:47:11.438345] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-17T17:47:11.438449] [INFO ] [MAIN ] Update Progress: 346/2368 symbols completed. BTA took 21.5s. Estimated remaining: 4h 35m 24s. Rate: 7.3 symbols/min [2025-10-17T17:47:11.621756] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T17:47:11.657729] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:11.707259] [DEBUG] [LOCAL ] BTI: Loaded 53986 existing records from primary storage. [2025-10-17T17:47:11.707601] [INFO ] [MAIN ] BTI: Loaded 53986 existing records. [2025-10-17T17:47:11.888679] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:11.888945] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-17T17:47:11.889015] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-17T17:47:11.889451] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-17T17:47:11.889509] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-17T17:47:11.963516] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-17T17:47:12.157033] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:47:12.267368] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:12.758054] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-17T17:47:13.557999] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-17T17:47:13.616244] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:47:13.649119] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:47:14.358041] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-17T17:47:14.922010] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T17:47:15.158080] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-17T17:47:15.773010] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-17T17:47:15.958100] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-17T17:47:16.758122] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-17T17:47:16.770314] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:47:16.953979] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:47:17.558007] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-17T17:47:18.230458] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:47:18.358018] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-17T17:47:19.019933] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T17:47:19.158006] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-17T17:47:19.498296] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:47:19.803869] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:47:19.958059] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-17T17:47:20.758141] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-17T17:47:21.558051] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-17T17:47:21.866712] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:47:22.358078] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-17T17:47:22.731239] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-17T17:47:23.141260] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T17:47:23.158007] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-17T17:47:23.958052] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-17T17:47:24.197029] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:47:24.758105] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-17T17:47:24.799540] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T17:47:25.558068] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-17T17:47:25.869626] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T17:47:25.931867] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:47:26.358151] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-17T17:47:27.158084] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-17T17:47:27.238792] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:47:27.958080] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-17T17:47:28.321104] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:47:28.459269] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-17T17:47:28.758074] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-17T17:47:29.564043] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-17T17:47:29.578025] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:47:29.747064] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T17:47:29.750824] [INFO ] [REMOTE ] BTCM: Full fetch complete (20327 records). [2025-10-17T17:47:29.750934] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-17T17:47:30.116118] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-17T17:47:30.116195] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-17T17:47:30.116578] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-17T17:47:30.116620] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-17T17:47:30.117363] [DEBUG] [LOCAL ] BTCM: Trimmed 20327 records to 17289 (keeping 200 days of data) [2025-10-17T17:47:30.212121] [DEBUG] [LOCAL ] BTCM: Primary data saved (17289 records). [2025-10-17T17:47:30.212269] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-17T17:47:30.212353] [INFO ] [MAIN ] Update Progress: 347/2368 symbols completed. BTCM took 29.2s. Estimated remaining: 4h 36m 17s. Rate: 7.3 symbols/min [2025-10-17T17:47:30.377824] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-17T17:47:30.382485] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:30.393351] [DEBUG] [LOCAL ] BTO: Loaded 8975 existing records from primary storage. [2025-10-17T17:47:30.393578] [INFO ] [MAIN ] BTO: Loaded 8975 existing records. [2025-10-17T17:47:30.566549] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:30.566787] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-17T17:47:30.566838] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-17T17:47:30.567010] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-17T17:47:30.567065] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-17T17:47:30.984975] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:31.158002] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-17T17:47:31.581727] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T17:47:31.958063] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-17T17:47:32.544008] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-17T17:47:32.551509] [INFO ] [REMOTE ] BSX: Full fetch complete (77856 records). [2025-10-17T17:47:32.551638] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-17T17:47:32.758499] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-17T17:47:32.955729] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-17T17:47:32.955839] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-17T17:47:32.956759] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-17T17:47:32.956842] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-17T17:47:32.988428] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T17:47:32.986759] [DEBUG] [LOCAL ] BSX: Trimmed 77856 records to 54468 (keeping 200 days of data) [2025-10-17T17:47:33.319673] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-10-17T17:47:33.319814] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-17T17:47:33.319894] [INFO ] [MAIN ] Update Progress: 348/2368 symbols completed. BSX took 48.9s. Estimated remaining: 4h 35m 40s. Rate: 7.3 symbols/min [2025-10-17T17:47:33.494505] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:33.494683] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-17T17:47:33.494736] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-17T17:47:33.494847] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-17T17:47:33.494889] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-17T17:47:33.494933] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-17T17:47:33.494965] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-17T17:47:33.558607] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-17T17:47:33.769842] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T17:47:33.870484] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:33.931144] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:47:34.358034] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-17T17:47:35.141055] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T17:47:35.157982] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-17T17:47:35.331895] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:47:35.958065] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-17T17:47:35.972807] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T17:47:36.065798] [DEBUG] [REMOTE ] BTE: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T17:47:36.066120] [WARN ] [REMOTE ] BTE: No data returned for month 2025-09 [2025-10-17T17:47:36.066211] [FATAL] [REMOTE ] BTE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:47:36.066313] [FATAL] [MAIN ] BTE: Failed to fetch primary data. [2025-10-17T17:47:36.066380] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:47:36.066454] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-17T17:47:36.066519] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-17T17:47:36.066555] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-17T17:47:36.066773] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-17T17:47:36.067232] [INFO ] [MAIN ] Update Progress: 349/2368 symbols completed. BTE took 33.8s. Estimated remaining: 4h 34m 60s. Rate: 7.3 symbols/min [2025-10-17T17:47:36.231913] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:36.287252] [DEBUG] [LOCAL ] BTU: Loaded 53714 existing records from primary storage. [2025-10-17T17:47:36.287773] [INFO ] [MAIN ] BTU: Loaded 53714 existing records. [2025-10-17T17:47:36.473961] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:36.474353] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-17T17:47:36.474481] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-17T17:47:36.475211] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-17T17:47:36.475290] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-17T17:47:36.763209] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-17T17:47:36.890910] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:37.558021] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-17T17:47:38.344579] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T17:47:38.357984] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-17T17:47:39.158003] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-17T17:47:39.197630] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T17:47:39.231591] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-17T17:47:39.958029] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-17T17:47:40.701735] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T17:47:40.758009] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-17T17:47:40.849122] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:47:41.558037] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-17T17:47:41.575076] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:47:42.358033] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-17T17:47:43.158042] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-17T17:47:43.469611] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T17:47:43.957994] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-17T17:47:44.466362] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T17:47:44.487841] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:47:44.758018] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-17T17:47:45.533030] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:47:45.558003] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-17T17:47:46.358036] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-17T17:47:46.488614] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T17:47:46.747825] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T17:47:47.158041] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-17T17:47:47.958010] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-17T17:47:48.055629] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T17:47:48.238317] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T17:47:48.758038] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-17T17:47:49.558020] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-17T17:47:49.647886] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:47:50.169523] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T17:47:50.177527] [INFO ] [REMOTE ] BTI: Full fetch complete (77637 records). [2025-10-17T17:47:50.177766] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-17T17:47:50.359360] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-17T17:47:50.586720] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-17T17:47:50.586819] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-17T17:47:50.587722] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-17T17:47:50.587794] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-17T17:47:50.589310] [DEBUG] [LOCAL ] BTI: Trimmed 77637 records to 54375 (keeping 200 days of data) [2025-10-17T17:47:50.920007] [DEBUG] [LOCAL ] BTI: Primary data saved (54375 records). [2025-10-17T17:47:50.920138] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-17T17:47:50.920722] [INFO ] [MAIN ] Update Progress: 350/2368 symbols completed. BTI took 39.5s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-17T17:47:51.088099] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:51.088323] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-17T17:47:51.088422] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-17T17:47:51.088573] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-17T17:47:51.088780] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-17T17:47:51.088892] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-17T17:47:51.088988] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-17T17:47:51.163272] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-17T17:47:51.447427] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:51.476777] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T17:47:51.497340] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T17:47:51.960184] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T17:47:51.959328] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-17T17:47:52.157915] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:47:52.158172] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-17T17:47:52.158258] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:47:52.158304] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-17T17:47:52.158336] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:47:52.158384] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-17T17:47:52.158434] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-17T17:47:52.158478] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-17T17:47:52.158516] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-17T17:47:52.158560] [INFO ] [MAIN ] Update Progress: 351/2368 symbols completed. BTX took 1.2s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-17T17:47:52.325404] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:52.353661] [DEBUG] [LOCAL ] BTZ: Loaded 22717 existing records from primary storage. [2025-10-17T17:47:52.353972] [INFO ] [MAIN ] BTZ: Loaded 22717 existing records. [2025-10-17T17:47:52.527200] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:52.527405] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-17T17:47:52.527475] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-17T17:47:52.527777] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-17T17:47:52.527841] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-17T17:47:52.763250] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-17T17:47:52.883485] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:53.558065] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-17T17:47:54.358076] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-17T17:47:54.738171] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T17:47:55.121572] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T17:47:55.157980] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-17T17:47:55.255245] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T17:47:55.952828] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:47:55.954789] [INFO ] [REMOTE ] BTO: Full fetch complete (13317 records). [2025-10-17T17:47:55.954880] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-17T17:47:55.966108] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-17T17:47:56.331414] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-17T17:47:56.331833] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-17T17:47:56.332365] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-17T17:47:56.332414] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-17T17:47:56.333320] [DEBUG] [LOCAL ] BTO: Trimmed 13317 records to 9046 (keeping 200 days of data) [2025-10-17T17:47:56.393032] [DEBUG] [LOCAL ] BTO: Primary data saved (9046 records). [2025-10-17T17:47:56.393298] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-17T17:47:56.393445] [INFO ] [MAIN ] Update Progress: 352/2368 symbols completed. BTO took 26.2s. Estimated remaining: 4h 34m 11s. Rate: 7.4 symbols/min [2025-10-17T17:47:56.578001] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:56.639255] [DEBUG] [LOCAL ] BUD: Loaded 52981 existing records from primary storage. [2025-10-17T17:47:56.639722] [INFO ] [MAIN ] BUD: Loaded 52981 existing records. [2025-10-17T17:47:56.763312] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-17T17:47:56.831921] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:56.832237] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-17T17:47:56.832291] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-17T17:47:56.832746] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-17T17:47:56.832806] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-17T17:47:57.214815] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:57.344330] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T17:47:57.558086] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-17T17:47:57.771764] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T17:47:58.358031] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-17T17:47:59.158097] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-17T17:47:59.343286] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T17:47:59.645752] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T17:47:59.963426] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-17T17:47:59.971738] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T17:48:00.758032] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-17T17:48:00.917685] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T17:48:01.558034] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-17T17:48:02.222567] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T17:48:02.358084] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-17T17:48:03.158116] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-17T17:48:03.438044] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:48:03.500146] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T17:48:03.958065] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-17T17:48:04.069123] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:48:04.758029] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-17T17:48:05.558057] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-17T17:48:05.936707] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T17:48:06.358062] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-17T17:48:06.592014] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:48:06.776190] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T17:48:07.158058] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-17T17:48:07.958020] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-17T17:48:08.320416] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T17:48:08.758052] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-17T17:48:09.042177] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:48:09.196746] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T17:48:09.558035] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-17T17:48:09.922763] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T17:48:10.358165] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-17T17:48:11.156084] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T17:48:11.158030] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-17T17:48:11.159158] [INFO ] [REMOTE ] BTT: Full fetch complete (22582 records). [2025-10-17T17:48:11.159240] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-17T17:48:11.159797] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:48:11.159879] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:48:11.160013] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:48:11.160126] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-17T17:48:11.160199] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-17T17:48:11.160248] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-17T17:48:11.160315] [DEBUG] [LOCAL ] BTT: No derivative data file found to delete. [2025-10-17T17:48:11.160384] [INFO ] [MAIN ] Update Progress: 353/2368 symbols completed. BTT took 37.8s. Estimated remaining: 4h 34m 41s. Rate: 7.3 symbols/min [2025-10-17T17:48:11.339684] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:11.353425] [DEBUG] [LOCAL ] BUI: Loaded 12010 existing records from primary storage. [2025-10-17T17:48:11.353729] [INFO ] [MAIN ] BUI: Loaded 12010 existing records. [2025-10-17T17:48:11.556770] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:11.557044] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-17T17:48:11.557179] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-17T17:48:11.557425] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-17T17:48:11.557586] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-17T17:48:11.715859] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T17:48:11.951741] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:11.957985] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-17T17:48:12.204684] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:48:12.758009] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-17T17:48:12.940561] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T17:48:13.558042] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-17T17:48:14.357055] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T17:48:14.359907] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-17T17:48:14.660561] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T17:48:15.158003] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-17T17:48:15.467278] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:48:15.958040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-17T17:48:16.758060] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-17T17:48:16.834916] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:48:16.870157] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:48:17.558062] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-17T17:48:18.309093] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T17:48:18.357982] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-17T17:48:18.804135] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T17:48:19.158004] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-17T17:48:19.360436] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:48:19.958083] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-17T17:48:20.758048] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-17T17:48:20.815524] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T17:48:20.864128] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T17:48:21.558037] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-17T17:48:21.887633] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:48:22.358028] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-17T17:48:23.157996] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-17T17:48:23.447071] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T17:48:23.532694] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T17:48:23.536722] [INFO ] [REMOTE ] BTZ: Full fetch complete (33286 records). [2025-10-17T17:48:23.536905] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-17T17:48:23.923385] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-17T17:48:23.921084] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T17:48:23.924684] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-17T17:48:23.927251] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-17T17:48:23.927731] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-17T17:48:23.929270] [DEBUG] [LOCAL ] BTZ: Trimmed 33286 records to 22828 (keeping 200 days of data) [2025-10-17T17:48:23.979383] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-17T17:48:24.074155] [DEBUG] [LOCAL ] BTZ: Primary data saved (22828 records). [2025-10-17T17:48:24.074353] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-17T17:48:24.074511] [INFO ] [MAIN ] Update Progress: 354/2368 symbols completed. BTZ took 31.9s. Estimated remaining: 4h 34m 60s. Rate: 7.3 symbols/min [2025-10-17T17:48:24.244007] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:24.291026] [DEBUG] [LOCAL ] BUR: Loaded 45717 existing records from primary storage. [2025-10-17T17:48:24.291333] [INFO ] [MAIN ] BUR: Loaded 45717 existing records. [2025-10-17T17:48:24.467663] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:24.467901] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-17T17:48:24.467951] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-17T17:48:24.468292] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-17T17:48:24.468346] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-17T17:48:24.763385] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-17T17:48:24.861625] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:25.558006] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-17T17:48:26.065788] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T17:48:26.358066] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-17T17:48:26.367845] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:48:26.797022] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T17:48:26.804516] [INFO ] [REMOTE ] BTU: Full fetch complete (77273 records). [2025-10-17T17:48:26.804688] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-17T17:48:27.178570] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-17T17:48:27.204195] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-17T17:48:27.204290] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-17T17:48:27.205288] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-17T17:48:27.205357] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-17T17:48:27.207004] [DEBUG] [LOCAL ] BTU: Trimmed 77273 records to 54104 (keeping 200 days of data) [2025-10-17T17:48:27.543796] [DEBUG] [LOCAL ] BTU: Primary data saved (54104 records). [2025-10-17T17:48:27.543974] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-17T17:48:27.544550] [INFO ] [MAIN ] Update Progress: 355/2368 symbols completed. BTU took 51.5s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-17T17:48:27.716963] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:27.760525] [DEBUG] [LOCAL ] BURL: Loaded 46016 existing records from primary storage. [2025-10-17T17:48:27.760871] [INFO ] [MAIN ] BURL: Loaded 46016 existing records. [2025-10-17T17:48:27.937480] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:27.937813] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-17T17:48:27.937901] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-17T17:48:27.938188] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-17T17:48:27.938247] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-17T17:48:27.970718] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-17T17:48:28.347910] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:28.351245] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T17:48:28.758126] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-17T17:48:28.792358] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:48:28.890395] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T17:48:29.558096] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-17T17:48:30.358066] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-17T17:48:30.626035] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:48:30.633524] [INFO ] [REMOTE ] BUD: Full fetch complete (76494 records). [2025-10-17T17:48:30.633737] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-17T17:48:31.035324] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-17T17:48:31.035526] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-17T17:48:31.036474] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-17T17:48:31.036540] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-17T17:48:31.038060] [DEBUG] [LOCAL ] BUD: Trimmed 76494 records to 53369 (keeping 200 days of data) [2025-10-17T17:48:31.164400] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-17T17:48:31.178027] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T17:48:31.196420] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T17:48:31.408694] [DEBUG] [LOCAL ] BUD: Primary data saved (53369 records). [2025-10-17T17:48:31.408832] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-17T17:48:31.408914] [INFO ] [MAIN ] Update Progress: 356/2368 symbols completed. BUD took 35.0s. Estimated remaining: 4h 33m 52s. Rate: 7.3 symbols/min [2025-10-17T17:48:31.608668] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:31.624133] [DEBUG] [LOCAL ] BUXX: Loaded 15455 existing records from primary storage. [2025-10-17T17:48:31.624324] [INFO ] [MAIN ] BUXX: Loaded 15455 existing records. [2025-10-17T17:48:31.800443] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:31.800733] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-17T17:48:31.800790] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-17T17:48:31.801038] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-17T17:48:31.801094] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-17T17:48:31.969377] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-17T17:48:32.148192] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:32.758049] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-17T17:48:32.966586] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T17:48:33.328677] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T17:48:33.371468] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:48:33.558038] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-17T17:48:34.304212] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T17:48:34.357991] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-17T17:48:35.108121] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T17:48:35.158050] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-17T17:48:35.958097] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-17T17:48:36.130542] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:48:36.758082] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-17T17:48:37.008131] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T17:48:37.558033] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-17T17:48:38.346370] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:48:38.357975] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-17T17:48:38.587017] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T17:48:39.158022] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-17T17:48:39.963207] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-17T17:48:39.985755] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T17:48:40.720614] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T17:48:40.757985] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-17T17:48:40.991968] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:48:41.558000] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-17T17:48:41.745454] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T17:48:41.747867] [INFO ] [REMOTE ] BUI: Full fetch complete (16687 records). [2025-10-17T17:48:41.747960] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-17T17:48:42.129150] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-17T17:48:42.129237] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-17T17:48:42.129623] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-17T17:48:42.129708] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-17T17:48:42.130601] [DEBUG] [LOCAL ] BUI: Trimmed 16687 records to 12102 (keeping 200 days of data) [2025-10-17T17:48:42.210431] [DEBUG] [LOCAL ] BUI: Primary data saved (12102 records). [2025-10-17T17:48:42.210550] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-17T17:48:42.210635] [INFO ] [MAIN ] Update Progress: 357/2368 symbols completed. BUI took 31.1s. Estimated remaining: 4h 33m 59s. Rate: 7.3 symbols/min [2025-10-17T17:48:42.358060] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-17T17:48:43.158051] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-17T17:48:43.196437] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:48:43.289784] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:48:43.958078] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-17T17:48:44.660417] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:48:44.757999] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-17T17:48:45.558000] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-17T17:48:45.750445] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T17:48:46.307116] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T17:48:46.358019] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-17T17:48:46.646453] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T17:48:47.158058] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-17T17:48:47.958083] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-17T17:48:48.060464] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:48:48.549497] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T17:48:48.758021] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-17T17:48:48.828846] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T17:48:49.558031] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-17T17:48:50.358004] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-17T17:48:50.698837] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T17:48:51.158020] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-17T17:48:51.174618] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:48:51.348708] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T17:48:51.958043] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-17T17:48:52.691286] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T17:48:52.758054] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-17T17:48:53.189370] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T17:48:53.558046] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-17T17:48:54.358078] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-17T17:48:54.425104] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T17:48:55.158107] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-17T17:48:55.271580] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T17:48:55.274555] [INFO ] [REMOTE ] BUXX: Full fetch complete (20651 records). [2025-10-17T17:48:55.274720] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-17T17:48:55.440922] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:48:55.490401] [INFO ] [REMOTE ] BUR: Full fetch complete (64260 records). [2025-10-17T17:48:55.516633] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-17T17:48:56.217571] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-17T17:48:56.223388] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-17T17:48:56.223879] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-17T17:48:56.223957] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-17T17:48:56.261343] [DEBUG] [LOCAL ] BUXX: Trimmed 20651 records to 15594 (keeping 200 days of data) [2025-10-17T17:48:56.448844] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-17T17:48:56.452595] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-17T17:48:56.462885] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-17T17:48:56.465418] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-17T17:48:56.470713] [DEBUG] [LOCAL ] BUR: Trimmed 64260 records to 46071 (keeping 200 days of data) [2025-10-17T17:48:56.477266] [DEBUG] [LOCAL ] BUXX: Primary data saved (15594 records). [2025-10-17T17:48:56.535420] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-17T17:48:56.562162] [INFO ] [MAIN ] Update Progress: 358/2368 symbols completed. BUXX took 25.2s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-17T17:48:56.753565] [DEBUG] [LOCAL ] BUR: Primary data saved (46071 records). [2025-10-17T17:48:56.753830] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-17T17:48:56.754436] [INFO ] [MAIN ] Update Progress: 359/2368 symbols completed. BUR took 32.7s. Estimated remaining: 4h 33m 32s. Rate: 7.3 symbols/min [2025-10-17T17:48:56.783410] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:48:56.793894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-17T17:48:58.480465] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:48:58.490269] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-17T17:49:00.100156] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:49:00.106173] [INFO ] [REMOTE ] BURL: Full fetch complete (65841 records). [2025-10-17T17:49:00.106275] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-17T17:49:00.498007] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-17T17:49:00.498094] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-17T17:49:00.498906] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-17T17:49:00.498974] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-17T17:49:00.500376] [DEBUG] [LOCAL ] BURL: Trimmed 65841 records to 46304 (keeping 200 days of data) [2025-10-17T17:49:00.791719] [DEBUG] [LOCAL ] BURL: Primary data saved (46304 records). [2025-10-17T17:49:00.791857] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-17T17:49:00.792375] [INFO ] [MAIN ] Update Progress: 360/2368 symbols completed. BURL took 33.2s. Estimated remaining: 4h 33m 1s. Rate: 7.4 symbols/min [2025-10-17T17:49:01.357085] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.464441] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.480251] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.499204] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.568130] [DEBUG] [LOCAL ] BV: Loaded 38827 existing records from primary storage. [2025-10-17T17:49:01.579025] [INFO ] [MAIN ] BV: Loaded 38827 existing records. [2025-10-17T17:49:01.617164] [DEBUG] [LOCAL ] BW: Loaded 40868 existing records from primary storage. [2025-10-17T17:49:01.658308] [INFO ] [MAIN ] BW: Loaded 40868 existing records. [2025-10-17T17:49:01.701568] [DEBUG] [LOCAL ] BWA: Loaded 52519 existing records from primary storage. [2025-10-17T17:49:01.740755] [DEBUG] [LOCAL ] BVN: Loaded 44679 existing records from primary storage. [2025-10-17T17:49:01.756531] [INFO ] [MAIN ] BWA: Loaded 52519 existing records. [2025-10-17T17:49:01.759170] [INFO ] [MAIN ] BVN: Loaded 44679 existing records. [2025-10-17T17:49:02.066455] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.233731] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.234072] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.280275] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-17T17:49:02.285586] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.280205] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.303373] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.313424] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-17T17:49:02.313540] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-17T17:49:02.340376] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-17T17:49:02.340438] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-17T17:49:02.340499] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-17T17:49:02.340870] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-17T17:49:02.340719] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-17T17:49:02.343787] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.396005] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.384949] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-17T17:49:02.410500] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-17T17:49:02.469429] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-17T17:49:02.489206] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-17T17:49:03.552043] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.604540] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-17T17:49:03.749455] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.784532] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.784835] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-17T17:49:03.800212] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-17T17:49:03.806349] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.807312] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-17T17:49:05.300988] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:49:05.307902] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-17T17:49:05.507349] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:49:05.516915] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-17T17:49:05.594871] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T17:49:05.604452] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-17T17:49:05.793370] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T17:49:05.804169] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-17T17:49:06.575885] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:49:06.582747] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-17T17:49:06.673704] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T17:49:06.683265] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-17T17:49:07.098898] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:49:07.107295] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-17T17:49:07.145135] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:49:07.155482] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-17T17:49:07.879438] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T17:49:07.891050] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-17T17:49:08.062115] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:49:08.070038] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-17T17:49:08.621508] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T17:49:08.763200] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-17T17:49:08.796388] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:49:09.370163] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:49:09.558038] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-17T17:49:09.632415] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T17:49:09.977479] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:49:10.358035] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-17T17:49:10.990792] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T17:49:11.158048] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-17T17:49:11.957250] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T17:49:11.966585] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-17T17:49:12.758013] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-17T17:49:13.081016] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T17:49:13.472295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:49:13.558007] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-17T17:49:13.895191] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:49:14.358053] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-17T17:49:15.100183] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:49:15.157991] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-17T17:49:15.958022] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-17T17:49:16.302208] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:49:16.736176] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T17:49:16.758002] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-17T17:49:17.472411] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:49:17.557990] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-17T17:49:17.717416] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T17:49:18.358107] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-17T17:49:18.967497] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:49:19.158039] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-17T17:49:19.958034] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-17T17:49:20.002258] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T17:49:20.589255] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:49:20.758031] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-17T17:49:21.563239] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-17T17:49:21.579474] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T17:49:22.260067] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:49:22.357987] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-17T17:49:23.158013] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-17T17:49:23.255192] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:49:23.824265] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:49:23.958014] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-17T17:49:24.604702] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T17:49:24.758078] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-17T17:49:25.513341] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:49:25.557994] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-17T17:49:26.358117] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-17T17:49:26.516493] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:49:27.158044] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-17T17:49:27.548515] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T17:49:27.555320] [INFO ] [REMOTE ] BVN: Full fetch complete (63322 records). [2025-10-17T17:49:27.555436] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-17T17:49:27.937259] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-17T17:49:27.937333] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-17T17:49:27.938073] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-17T17:49:27.938137] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-17T17:49:27.939336] [DEBUG] [LOCAL ] BVN: Trimmed 63322 records to 45065 (keeping 200 days of data) [2025-10-17T17:49:27.987339] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-17T17:49:28.197770] [DEBUG] [LOCAL ] BVN: Primary data saved (45065 records). [2025-10-17T17:49:28.197919] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-17T17:49:28.198004] [INFO ] [MAIN ] Update Progress: 361/2368 symbols completed. BVN took 27.4s. Estimated remaining: 4h 34m 40s. Rate: 7.3 symbols/min [2025-10-17T17:49:28.379599] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:28.409395] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T17:49:28.430024] [DEBUG] [LOCAL ] BWG: Loaded 12662 existing records from primary storage. [2025-10-17T17:49:28.430268] [INFO ] [MAIN ] BWG: Loaded 12662 existing records. [2025-10-17T17:49:28.606279] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:28.606543] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-17T17:49:28.606594] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-17T17:49:28.606814] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-17T17:49:28.606876] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-17T17:49:28.763107] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-17T17:49:29.012431] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:29.035216] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:49:29.043226] [INFO ] [REMOTE ] BW: Full fetch complete (59467 records). [2025-10-17T17:49:29.043430] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-17T17:49:29.422922] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-17T17:49:29.423003] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-17T17:49:29.423865] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-17T17:49:29.423934] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-17T17:49:29.425165] [DEBUG] [LOCAL ] BW: Trimmed 59467 records to 41213 (keeping 200 days of data) [2025-10-17T17:49:29.581098] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-17T17:49:29.651072] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T17:49:29.658165] [INFO ] [REMOTE ] BV: Full fetch complete (54833 records). [2025-10-17T17:49:29.661424] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-17T17:49:29.804718] [DEBUG] [LOCAL ] BW: Primary data saved (41213 records). [2025-10-17T17:49:29.822392] [INFO ] [MAIN ] BW: Full history saved. [2025-10-17T17:49:29.842433] [INFO ] [MAIN ] Update Progress: 362/2368 symbols completed. BW took 29.0s. Estimated remaining: 4h 33m 55s. Rate: 7.3 symbols/min [2025-10-17T17:49:30.234342] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:30.272490] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-17T17:49:30.272556] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-17T17:49:30.273242] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-17T17:49:30.273357] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-17T17:49:30.274811] [DEBUG] [LOCAL ] BV: Trimmed 54833 records to 39100 (keeping 200 days of data) [2025-10-17T17:49:30.391037] [DEBUG] [LOCAL ] BWLP: Loaded 32486 existing records from primary storage. [2025-10-17T17:49:30.392595] [INFO ] [MAIN ] BWLP: Loaded 32486 existing records. [2025-10-17T17:49:30.528247] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T17:49:30.544243] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-17T17:49:30.677928] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:30.704261] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-17T17:49:30.704398] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-17T17:49:30.758122] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T17:49:30.758226] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-17T17:49:30.758895] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-17T17:49:30.927035] [DEBUG] [LOCAL ] BV: Primary data saved (39100 records). [2025-10-17T17:49:30.945560] [INFO ] [MAIN ] BV: Full history saved. [2025-10-17T17:49:30.947834] [INFO ] [MAIN ] Update Progress: 363/2368 symbols completed. BV took 30.2s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-17T17:49:31.168292] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-17T17:49:31.300665] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:31.415096] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:31.416588] [DEBUG] [LOCAL ] BWMX: Loaded 7843 existing records from primary storage. [2025-10-17T17:49:31.417216] [INFO ] [MAIN ] BWMX: Loaded 7843 existing records. [2025-10-17T17:49:31.540218] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T17:49:31.633112] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:31.633440] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-17T17:49:31.633492] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-17T17:49:31.633836] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-17T17:49:31.633898] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-17T17:49:31.963252] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-17T17:49:32.026085] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:32.758041] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-17T17:49:33.018852] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:49:33.408249] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-17T17:49:33.558017] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-17T17:49:33.748388] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:49:34.358065] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-17T17:49:35.158069] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-17T17:49:35.176372] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T17:49:35.331039] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:49:35.958031] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-17T17:49:36.632345] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T17:49:36.758018] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-17T17:49:36.766243] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T17:49:37.558075] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-17T17:49:38.113812] [DEBUG] [REMOTE ] BWMX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-17T17:49:38.114396] [WARN ] [REMOTE ] BWMX: No data returned for month 2025-01 [2025-10-17T17:49:38.114548] [FATAL] [REMOTE ] BWMX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:49:38.114769] [FATAL] [MAIN ] BWMX: Failed to fetch primary data. [2025-10-17T17:49:38.115004] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:49:38.121828] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-17T17:49:38.132252] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-17T17:49:38.133572] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-10-17T17:49:38.133454] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:49:38.140224] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-10-17T17:49:38.141114] [INFO ] [MAIN ] Update Progress: 364/2368 symbols completed. BWMX took 7.2s. Estimated remaining: 4h 32m 55s. Rate: 7.3 symbols/min [2025-10-17T17:49:38.305486] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:38.312051] [DEBUG] [LOCAL ] BWNB: Loaded 4220 existing records from primary storage. [2025-10-17T17:49:38.312227] [INFO ] [MAIN ] BWNB: Loaded 4220 existing records. [2025-10-17T17:49:38.363268] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-17T17:49:38.491795] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:38.492047] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-17T17:49:38.492103] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-17T17:49:38.492229] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-17T17:49:38.492341] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-17T17:49:38.851552] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:39.158035] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-17T17:49:39.254180] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T17:49:39.958027] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-17T17:49:40.585722] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T17:49:40.758031] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-17T17:49:41.019839] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:49:41.250771] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:49:41.558038] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-17T17:49:42.358081] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-17T17:49:43.158014] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-17T17:49:43.407373] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T17:49:43.415209] [INFO ] [REMOTE ] BWA: Full fetch complete (75921 records). [2025-10-17T17:49:43.415406] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-17T17:49:43.845926] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-17T17:49:43.846050] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-17T17:49:43.847158] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-17T17:49:43.847228] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-17T17:49:43.848921] [DEBUG] [LOCAL ] BWA: Trimmed 75921 records to 52901 (keeping 200 days of data) [2025-10-17T17:49:43.963139] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-17T17:49:43.989044] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T17:49:44.212947] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T17:49:44.237291] [DEBUG] [LOCAL ] BWA: Primary data saved (52901 records). [2025-10-17T17:49:44.237470] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-17T17:49:44.237577] [INFO ] [MAIN ] Update Progress: 365/2368 symbols completed. BWA took 43.4s. Estimated remaining: 4h 32m 35s. Rate: 7.3 symbols/min [2025-10-17T17:49:44.403813] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:44.410154] [DEBUG] [LOCAL ] BWSN: Loaded 5203 existing records from primary storage. [2025-10-17T17:49:44.410319] [INFO ] [MAIN ] BWSN: Loaded 5203 existing records. [2025-10-17T17:49:44.513183] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T17:49:44.590256] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:44.590480] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-17T17:49:44.590528] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-17T17:49:44.590762] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-17T17:49:44.590822] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-17T17:49:44.764329] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-17T17:49:44.939401] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:45.391572] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T17:49:45.558013] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-17T17:49:46.127922] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T17:49:46.358058] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-17T17:49:47.158240] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-17T17:49:47.204536] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:49:47.711814] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-17T17:49:47.958124] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-17T17:49:48.393065] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T17:49:48.758010] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-17T17:49:49.257471] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T17:49:49.558036] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-17T17:49:50.060269] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T17:49:50.358074] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-17T17:49:50.939132] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:49:51.158045] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-17T17:49:51.907009] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T17:49:51.958065] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-17T17:49:52.629924] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:49:52.758062] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-17T17:49:53.558080] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-17T17:49:53.571999] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:49:54.037490] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T17:49:54.358064] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-17T17:49:54.954357] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T17:49:55.158043] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-17T17:49:55.785258] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:49:55.958023] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-17T17:49:56.758012] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-17T17:49:56.975939] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T17:49:57.558051] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-17T17:49:58.333019] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:49:58.352492] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T17:49:58.359139] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-17T17:49:59.158028] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-17T17:49:59.266006] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:49:59.958065] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-17T17:50:00.478937] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T17:50:00.758063] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-17T17:50:00.793394] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:50:00.794913] [INFO ] [REMOTE ] BWSN: Full fetch complete (6346 records). [2025-10-17T17:50:00.795000] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-17T17:50:01.160275] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-17T17:50:01.160379] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-17T17:50:01.160624] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-17T17:50:01.160713] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-17T17:50:01.161146] [DEBUG] [LOCAL ] BWSN: Trimmed 6346 records to 5235 (keeping 200 days of data) [2025-10-17T17:50:01.194272] [DEBUG] [LOCAL ] BWSN: Primary data saved (5235 records). [2025-10-17T17:50:01.194395] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-17T17:50:01.194486] [INFO ] [MAIN ] Update Progress: 366/2368 symbols completed. BWSN took 17.0s. Estimated remaining: 4h 33m 15s. Rate: 7.3 symbols/min [2025-10-17T17:50:01.369075] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:01.413488] [DEBUG] [LOCAL ] BWXT: Loaded 47497 existing records from primary storage. [2025-10-17T17:50:01.413822] [INFO ] [MAIN ] BWXT: Loaded 47497 existing records. [2025-10-17T17:50:01.504322] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T17:50:01.563162] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-17T17:50:01.633470] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:01.633728] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-17T17:50:01.633787] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-17T17:50:01.634608] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-17T17:50:01.634695] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-17T17:50:02.019152] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:02.358092] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-17T17:50:03.158765] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-17T17:50:03.158676] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T17:50:03.958045] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-17T17:50:04.099627] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T17:50:04.164777] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T17:50:04.670631] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:50:04.758010] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-17T17:50:05.346261] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T17:50:05.557995] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-17T17:50:06.358096] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-17T17:50:06.891126] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T17:50:06.892280] [INFO ] [REMOTE ] BWNB: Full fetch complete (5588 records). [2025-10-17T17:50:06.892376] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-17T17:50:07.030434] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:50:07.163176] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-17T17:50:07.312457] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-17T17:50:07.312540] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-17T17:50:07.312725] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-17T17:50:07.312786] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-17T17:50:07.313178] [DEBUG] [LOCAL ] BWNB: Trimmed 5588 records to 4225 (keeping 200 days of data) [2025-10-17T17:50:07.338970] [DEBUG] [LOCAL ] BWNB: Primary data saved (4225 records). [2025-10-17T17:50:07.339090] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-17T17:50:07.339178] [INFO ] [MAIN ] Update Progress: 367/2368 symbols completed. BWNB took 29.2s. Estimated remaining: 4h 32m 56s. Rate: 7.3 symbols/min [2025-10-17T17:50:07.504302] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:07.557681] [DEBUG] [LOCAL ] BX: Loaded 53873 existing records from primary storage. [2025-10-17T17:50:07.558012] [INFO ] [MAIN ] BX: Loaded 53873 existing records. [2025-10-17T17:50:07.749356] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:07.749706] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-17T17:50:07.749796] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-17T17:50:07.750022] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-17T17:50:07.750092] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-17T17:50:07.964827] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-17T17:50:08.122807] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:08.758067] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-17T17:50:08.920415] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T17:50:09.001914] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:50:09.003538] [INFO ] [REMOTE ] BWG: Full fetch complete (17721 records). [2025-10-17T17:50:09.003608] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-17T17:50:09.004028] [FATAL] [VALIDATOR ] BWG: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:50:09.004111] [FATAL] [MAIN ] BWG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:50:09.004154] [WARN ] [MAIN ] BWG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:50:09.004220] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-17T17:50:09.004283] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-17T17:50:09.004335] [INFO ] [LOCAL ] BWG: Starting deletion of derivative data. [2025-10-17T17:50:09.004491] [DEBUG] [LOCAL ] BWG: Deleted derivative data file. [2025-10-17T17:50:09.004612] [INFO ] [MAIN ] Update Progress: 368/2368 symbols completed. BWG took 40.8s. Estimated remaining: 4h 32m 12s. Rate: 7.3 symbols/min [2025-10-17T17:50:09.215492] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:09.232899] [DEBUG] [LOCAL ] BXC: Loaded 13714 existing records from primary storage. [2025-10-17T17:50:09.233188] [INFO ] [MAIN ] BXC: Loaded 13714 existing records. [2025-10-17T17:50:09.413950] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:09.414159] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-17T17:50:09.414207] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-17T17:50:09.414524] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-17T17:50:09.414581] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-17T17:50:09.562129] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-17T17:50:09.780142] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:10.358045] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-17T17:50:11.160938] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-17T17:50:11.164686] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:50:11.229107] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T17:50:11.958036] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-17T17:50:12.738737] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T17:50:12.758092] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-17T17:50:12.912720] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:50:13.366455] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (4.61 seconds). [2025-10-17T17:50:13.558040] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-17T17:50:14.174223] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:50:14.358043] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-17T17:50:15.141730] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:50:15.157988] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-17T17:50:15.511715] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T17:50:15.958071] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-17T17:50:16.010979] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T17:50:16.758084] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-17T17:50:17.558035] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-17T17:50:17.677942] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-17T17:50:18.358101] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-17T17:50:18.896457] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-17T17:50:18.901520] [INFO ] [REMOTE ] BWLP: Full fetch complete (47956 records). [2025-10-17T17:50:18.902354] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-17T17:50:19.166582] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-17T17:50:19.306869] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-17T17:50:19.306738] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T17:50:19.310505] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-17T17:50:19.311691] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-17T17:50:19.311889] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-17T17:50:19.313181] [DEBUG] [LOCAL ] BWLP: Trimmed 47956 records to 32641 (keeping 200 days of data) [2025-10-17T17:50:19.439334] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:50:19.543912] [DEBUG] [LOCAL ] BWLP: Primary data saved (32641 records). [2025-10-17T17:50:19.544049] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-17T17:50:19.544130] [INFO ] [MAIN ] Update Progress: 369/2368 symbols completed. BWLP took 49.7s. Estimated remaining: 4h 32m 17s. Rate: 7.3 symbols/min [2025-10-17T17:50:19.717029] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:19.760258] [DEBUG] [LOCAL ] BXMT: Loaded 47685 existing records from primary storage. [2025-10-17T17:50:19.760604] [INFO ] [MAIN ] BXMT: Loaded 47685 existing records. [2025-10-17T17:50:19.935754] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:19.935970] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-17T17:50:19.936042] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-17T17:50:19.936233] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-17T17:50:19.936286] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-17T17:50:19.966272] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-17T17:50:20.285462] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:20.758016] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-17T17:50:20.852577] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:50:21.036461] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T17:50:21.558077] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-17T17:50:22.358011] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-17T17:50:22.813860] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T17:50:23.158085] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-17T17:50:23.247257] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:50:23.915920] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:50:23.957990] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-17T17:50:24.031512] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:50:24.758039] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-17T17:50:24.863717] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:50:25.558079] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-17T17:50:26.358047] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-17T17:50:26.594201] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T17:50:27.158166] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-17T17:50:27.483443] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:50:27.958067] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-17T17:50:28.086143] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:50:28.651079] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:50:28.758033] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-17T17:50:29.558045] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-17T17:50:30.055573] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-17T17:50:30.358077] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-17T17:50:30.577239] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T17:50:30.991472] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:50:31.158057] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-17T17:50:31.174669] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:50:31.958085] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-17T17:50:32.758039] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-17T17:50:33.197800] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T17:50:33.558034] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-17T17:50:33.923749] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:50:34.358010] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-17T17:50:34.489272] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:50:34.522794] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:50:34.525242] [INFO ] [REMOTE ] BXC: Full fetch complete (18250 records). [2025-10-17T17:50:34.525316] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-17T17:50:34.904788] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-17T17:50:34.904875] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-17T17:50:34.905446] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-17T17:50:34.905486] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-17T17:50:34.906304] [DEBUG] [LOCAL ] BXC: Trimmed 18250 records to 13776 (keeping 200 days of data) [2025-10-17T17:50:34.985461] [DEBUG] [LOCAL ] BXC: Primary data saved (13776 records). [2025-10-17T17:50:34.985600] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-17T17:50:34.985704] [INFO ] [MAIN ] Update Progress: 370/2368 symbols completed. BXC took 26.0s. Estimated remaining: 4h 32m 48s. Rate: 7.3 symbols/min [2025-10-17T17:50:35.147834] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:35.158812] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-17T17:50:35.168727] [DEBUG] [LOCAL ] BXMX: Loaded 19610 existing records from primary storage. [2025-10-17T17:50:35.168948] [INFO ] [MAIN ] BXMX: Loaded 19610 existing records. [2025-10-17T17:50:35.352295] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:35.352532] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-17T17:50:35.352584] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-17T17:50:35.352856] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-17T17:50:35.352927] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-17T17:50:35.729411] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:35.958011] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-17T17:50:36.538376] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-17T17:50:36.655258] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:50:36.758035] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-17T17:50:37.120748] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:50:37.558041] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-17T17:50:38.358037] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-17T17:50:38.405511] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T17:50:39.158032] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-17T17:50:39.338739] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T17:50:39.958033] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-17T17:50:40.219959] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T17:50:40.423499] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:50:40.758105] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-17T17:50:41.558054] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-17T17:50:42.242919] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T17:50:42.250136] [INFO ] [REMOTE ] BWXT: Full fetch complete (67984 records). [2025-10-17T17:50:42.250300] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-17T17:50:42.359441] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-17T17:50:42.653134] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-17T17:50:42.653306] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-17T17:50:42.654151] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-17T17:50:42.654231] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-17T17:50:42.655698] [DEBUG] [LOCAL ] BWXT: Trimmed 67984 records to 47875 (keeping 200 days of data) [2025-10-17T17:50:42.902109] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T17:50:42.997775] [DEBUG] [LOCAL ] BWXT: Primary data saved (47875 records). [2025-10-17T17:50:42.998012] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-17T17:50:42.999000] [INFO ] [MAIN ] Update Progress: 371/2368 symbols completed. BWXT took 41.8s. Estimated remaining: 4h 32m 39s. Rate: 7.3 symbols/min [2025-10-17T17:50:43.130375] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:50:43.160416] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-17T17:50:43.213469] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:43.260669] [DEBUG] [LOCAL ] BXP: Loaded 50256 existing records from primary storage. [2025-10-17T17:50:43.261113] [INFO ] [MAIN ] BXP: Loaded 50256 existing records. [2025-10-17T17:50:43.443462] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:43.454450] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-17T17:50:43.455085] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-17T17:50:43.455603] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:50:43.459847] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-17T17:50:43.460352] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-17T17:50:43.832025] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:43.958036] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-17T17:50:44.758039] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-17T17:50:45.383582] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T17:50:45.391367] [INFO ] [REMOTE ] BX: Full fetch complete (77585 records). [2025-10-17T17:50:45.391509] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-17T17:50:45.563562] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-17T17:50:45.804547] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-17T17:50:45.805126] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-17T17:50:45.814519] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-17T17:50:45.831121] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-17T17:50:45.833691] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T17:50:45.850009] [DEBUG] [LOCAL ] BX: Trimmed 77585 records to 54263 (keeping 200 days of data) [2025-10-17T17:50:45.857459] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T17:50:46.198227] [DEBUG] [LOCAL ] BX: Primary data saved (54263 records). [2025-10-17T17:50:46.198409] [INFO ] [MAIN ] BX: Full history saved. [2025-10-17T17:50:46.198495] [INFO ] [MAIN ] Update Progress: 372/2368 symbols completed. BX took 38.9s. Estimated remaining: 4h 32m 4s. Rate: 7.3 symbols/min [2025-10-17T17:50:46.368112] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:46.364732] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-17T17:50:46.411225] [DEBUG] [LOCAL ] BXSL: Loaded 48504 existing records from primary storage. [2025-10-17T17:50:46.411526] [INFO ] [MAIN ] BXSL: Loaded 48504 existing records. [2025-10-17T17:50:46.586865] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:46.587089] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-17T17:50:46.587138] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-17T17:50:46.587333] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-17T17:50:46.587391] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-17T17:50:46.955970] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:47.158013] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-17T17:50:47.210126] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:50:47.629509] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T17:50:47.958068] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-17T17:50:48.758034] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-17T17:50:48.984205] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:50:49.491157] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:50:49.558021] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-17T17:50:50.341665] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T17:50:50.358011] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-17T17:50:51.158026] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-17T17:50:51.253188] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:50:51.352357] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T17:50:51.958053] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-17T17:50:52.541025] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T17:50:52.758039] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-17T17:50:53.558040] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-17T17:50:53.633606] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:50:54.358091] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-17T17:50:54.537927] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:50:54.547886] [INFO ] [REMOTE ] BXMT: Full fetch complete (69934 records). [2025-10-17T17:50:54.548040] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-17T17:50:54.937029] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-17T17:50:54.937115] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-17T17:50:54.937980] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-17T17:50:54.938047] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-17T17:50:54.939454] [DEBUG] [LOCAL ] BXMT: Trimmed 69934 records to 48048 (keeping 200 days of data) [2025-10-17T17:50:55.160224] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-17T17:50:55.246118] [DEBUG] [LOCAL ] BXMT: Primary data saved (48048 records). [2025-10-17T17:50:55.246263] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-17T17:50:55.247193] [INFO ] [MAIN ] Update Progress: 373/2368 symbols completed. BXMT took 35.7s. Estimated remaining: 4h 32m 0s. Rate: 7.3 symbols/min [2025-10-17T17:50:55.430588] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:55.463668] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:50:55.489398] [DEBUG] [LOCAL ] BY: Loaded 21987 existing records from primary storage. [2025-10-17T17:50:55.489683] [INFO ] [MAIN ] BY: Loaded 21987 existing records. [2025-10-17T17:50:55.668804] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:55.669170] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-17T17:50:55.669301] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-17T17:50:55.669949] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-17T17:50:55.670008] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-17T17:50:55.963107] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-17T17:50:55.965892] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:50:56.083870] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:56.085353] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T17:50:56.758027] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-17T17:50:57.558015] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-17T17:50:57.717669] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:50:57.746235] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T17:50:58.358055] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-17T17:50:59.158006] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-17T17:50:59.228100] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:50:59.393769] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:50:59.877492] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T17:50:59.958075] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-17T17:51:00.758037] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-17T17:51:01.230723] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:51:01.558061] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-17T17:51:02.097155] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T17:51:02.358070] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-17T17:51:02.456110] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:51:03.158037] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-17T17:51:03.958074] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-17T17:51:04.090615] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:51:04.758063] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-17T17:51:04.962485] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:51:05.004010] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:51:05.558024] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-17T17:51:05.779141] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T17:51:06.358037] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-17T17:51:07.038084] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:51:07.158052] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-17T17:51:07.637907] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:51:07.958103] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-17T17:51:08.709632] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:51:08.758070] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-17T17:51:08.840026] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T17:51:09.558044] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-17T17:51:10.358055] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-17T17:51:10.542665] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:51:11.158060] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-17T17:51:11.209560] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:51:11.540206] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T17:51:11.958109] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-17T17:51:12.532321] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:51:12.535774] [INFO ] [REMOTE ] BXMX: Full fetch complete (28707 records). [2025-10-17T17:51:12.535880] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-17T17:51:12.763234] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-17T17:51:12.923897] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-17T17:51:12.923981] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-17T17:51:12.924419] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-17T17:51:12.924462] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-17T17:51:12.925292] [DEBUG] [LOCAL ] BXMX: Trimmed 28707 records to 19717 (keeping 200 days of data) [2025-10-17T17:51:13.044307] [DEBUG] [LOCAL ] BXMX: Primary data saved (19717 records). [2025-10-17T17:51:13.044459] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-17T17:51:13.044544] [INFO ] [MAIN ] Update Progress: 374/2368 symbols completed. BXMX took 38.1s. Estimated remaining: 4h 32m 43s. Rate: 7.3 symbols/min [2025-10-17T17:51:13.212883] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:13.252444] [DEBUG] [LOCAL ] BYD: Loaded 45233 existing records from primary storage. [2025-10-17T17:51:13.252794] [INFO ] [MAIN ] BYD: Loaded 45233 existing records. [2025-10-17T17:51:13.437487] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:13.437770] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-17T17:51:13.437823] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-17T17:51:13.438879] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-17T17:51:13.438937] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-17T17:51:13.559200] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-17T17:51:13.822219] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:13.862546] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:51:13.918714] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:51:14.358083] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-17T17:51:15.158040] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-17T17:51:15.420671] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:51:15.421348] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T17:51:15.958044] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-17T17:51:16.578674] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T17:51:16.758031] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-17T17:51:17.033674] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:51:17.557997] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-17T17:51:18.358038] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-17T17:51:18.509941] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T17:51:19.158023] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-17T17:51:19.315912] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T17:51:19.325870] [INFO ] [REMOTE ] BXP: Full fetch complete (72218 records). [2025-10-17T17:51:19.326066] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-17T17:51:19.760914] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-17T17:51:19.761010] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-17T17:51:19.761872] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-17T17:51:19.761939] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-17T17:51:19.763452] [DEBUG] [LOCAL ] BXP: Trimmed 72218 records to 50594 (keeping 200 days of data) [2025-10-17T17:51:19.963134] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-17T17:51:20.120032] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T17:51:20.147449] [DEBUG] [LOCAL ] BXP: Primary data saved (50594 records). [2025-10-17T17:51:20.147664] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-17T17:51:20.147795] [INFO ] [MAIN ] Update Progress: 375/2368 symbols completed. BXP took 37.1s. Estimated remaining: 4h 32m 29s. Rate: 7.3 symbols/min [2025-10-17T17:51:20.352806] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:20.365728] [DEBUG] [LOCAL ] BYM: Loaded 11798 existing records from primary storage. [2025-10-17T17:51:20.365973] [INFO ] [MAIN ] BYM: Loaded 11798 existing records. [2025-10-17T17:51:20.566331] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:20.566557] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-17T17:51:20.566607] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-17T17:51:20.566951] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-17T17:51:20.567010] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-17T17:51:20.772431] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-17T17:51:20.991095] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:21.145923] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:51:21.149481] [INFO ] [REMOTE ] BY: Full fetch complete (29758 records). [2025-10-17T17:51:21.149605] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-17T17:51:21.316896] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T17:51:21.414567] [INFO ] [REMOTE ] BXSL: Full fetch complete (69985 records). [2025-10-17T17:51:21.455807] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-17T17:51:21.563050] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-17T17:51:21.734754] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-17T17:51:21.743417] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-17T17:51:21.760166] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-17T17:51:21.765091] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-17T17:51:21.877122] [DEBUG] [LOCAL ] BY: Trimmed 29758 records to 22175 (keeping 200 days of data) [2025-10-17T17:51:22.080991] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-17T17:51:22.083522] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-17T17:51:22.084710] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-17T17:51:22.085039] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-17T17:51:22.091149] [DEBUG] [LOCAL ] BXSL: Trimmed 69985 records to 48894 (keeping 200 days of data) [2025-10-17T17:51:22.209892] [DEBUG] [LOCAL ] BY: Primary data saved (22175 records). [2025-10-17T17:51:22.211458] [INFO ] [MAIN ] BY: Full history saved. [2025-10-17T17:51:22.212189] [INFO ] [MAIN ] Update Progress: 376/2368 symbols completed. BY took 27.0s. Estimated remaining: 4h 31m 48s. Rate: 7.3 symbols/min [2025-10-17T17:51:22.390833] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:22.424633] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T17:51:22.435916] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-17T17:51:22.536548] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T17:51:22.586980] [DEBUG] [LOCAL ] BZH: Loaded 32633 existing records from primary storage. [2025-10-17T17:51:22.602444] [INFO ] [MAIN ] BZH: Loaded 32633 existing records. [2025-10-17T17:51:22.793535] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:22.794844] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-17T17:51:22.795441] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-17T17:51:22.796384] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-17T17:51:22.796701] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-17T17:51:23.129745] [DEBUG] [LOCAL ] BXSL: Primary data saved (48894 records). [2025-10-17T17:51:23.140576] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-17T17:51:23.151303] [INFO ] [MAIN ] Update Progress: 377/2368 symbols completed. BXSL took 37.0s. Estimated remaining: 4h 31m 2s. Rate: 7.3 symbols/min [2025-10-17T17:51:23.161886] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-17T17:51:23.301535] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:23.416044] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:23.468568] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-17T17:51:23.468976] [INFO ] [MAIN ] C: Loaded 54130 existing records. [2025-10-17T17:51:23.659619] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:23.659865] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-17T17:51:23.659914] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-17T17:51:23.660856] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-17T17:51:23.660916] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-17T17:51:23.996380] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-17T17:51:24.027685] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T17:51:24.092978] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T17:51:24.096563] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:24.758051] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-17T17:51:25.396584] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T17:51:25.558100] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-17T17:51:26.358070] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-17T17:51:26.846737] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T17:51:27.158070] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-17T17:51:27.281554] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:51:27.412203] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T17:51:27.626996] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:51:27.958083] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-17T17:51:28.758082] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-17T17:51:29.557999] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-17T17:51:29.778825] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T17:51:30.075969] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T17:51:30.358095] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-17T17:51:31.158004] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-17T17:51:31.513259] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T17:51:31.796483] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:51:31.958112] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-17T17:51:32.241033] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T17:51:32.758074] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-17T17:51:33.331169] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T17:51:33.558067] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-17T17:51:34.262792] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:51:34.358051] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-17T17:51:35.158084] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-17T17:51:35.672301] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T17:51:35.890501] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T17:51:35.958039] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-17T17:51:36.744401] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T17:51:36.757994] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-17T17:51:37.558035] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-17T17:51:37.609978] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:51:38.102874] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T17:51:38.358006] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-17T17:51:38.463056] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:51:39.158042] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-17T17:51:39.958028] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-17T17:51:39.978015] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:51:40.560618] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T17:51:40.757990] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-17T17:51:41.558039] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-17T17:51:41.593034] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:51:41.620899] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T17:51:42.358032] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-17T17:51:42.812890] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:51:43.112258] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T17:51:43.158059] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-17T17:51:43.958003] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-17T17:51:44.092941] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:51:44.758127] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-17T17:51:45.353133] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T17:51:45.558008] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-17T17:51:46.333403] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T17:51:46.357998] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-17T17:51:46.397147] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:51:46.399129] [INFO ] [REMOTE ] BYM: Full fetch complete (17384 records). [2025-10-17T17:51:46.399209] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-17T17:51:46.780989] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-17T17:51:46.781098] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-17T17:51:46.781725] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-17T17:51:46.781789] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-17T17:51:46.782459] [DEBUG] [LOCAL ] BYM: Trimmed 17384 records to 11842 (keeping 200 days of data) [2025-10-17T17:51:46.865216] [DEBUG] [LOCAL ] BYM: Primary data saved (11842 records). [2025-10-17T17:51:46.865425] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-17T17:51:46.865536] [INFO ] [MAIN ] Update Progress: 378/2368 symbols completed. BYM took 26.7s. Estimated remaining: 4h 32m 16s. Rate: 7.3 symbols/min [2025-10-17T17:51:47.052421] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:47.075906] [DEBUG] [LOCAL ] CAAP: Loaded 20020 existing records from primary storage. [2025-10-17T17:51:47.076246] [INFO ] [MAIN ] CAAP: Loaded 20020 existing records. [2025-10-17T17:51:47.163290] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-17T17:51:47.268462] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:47.268793] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-17T17:51:47.268850] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-17T17:51:47.269350] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-17T17:51:47.269410] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-17T17:51:47.639850] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:47.958071] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-17T17:51:48.024391] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:51:48.030913] [INFO ] [REMOTE ] BYD: Full fetch complete (65357 records). [2025-10-17T17:51:48.031071] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-17T17:51:48.412098] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-17T17:51:48.412179] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-17T17:51:48.412912] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-17T17:51:48.412977] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-17T17:51:48.414277] [DEBUG] [LOCAL ] BYD: Trimmed 65357 records to 45593 (keeping 200 days of data) [2025-10-17T17:51:48.708514] [DEBUG] [LOCAL ] BYD: Primary data saved (45593 records). [2025-10-17T17:51:48.708701] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-17T17:51:48.708801] [INFO ] [MAIN ] Update Progress: 379/2368 symbols completed. BYD took 35.7s. Estimated remaining: 4h 31m 34s. Rate: 7.3 symbols/min [2025-10-17T17:51:48.771353] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-17T17:51:48.880128] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:48.896615] [DEBUG] [LOCAL ] CABO: Loaded 16869 existing records from primary storage. [2025-10-17T17:51:48.896924] [INFO ] [MAIN ] CABO: Loaded 16869 existing records. [2025-10-17T17:51:49.073836] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:49.074197] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-17T17:51:49.074278] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-17T17:51:49.075059] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-17T17:51:49.075121] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-17T17:51:49.291547] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:51:49.454218] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:49.491675] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T17:51:49.558011] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-17T17:51:50.298625] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:51:50.358041] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-17T17:51:50.480001] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:51:51.158114] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-17T17:51:51.918838] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:51:51.933997] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T17:51:51.958033] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-17T17:51:52.758072] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-17T17:51:53.325147] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:51:53.329708] [INFO ] [REMOTE ] BZH: Full fetch complete (47206 records). [2025-10-17T17:51:53.329810] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-17T17:51:53.563130] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-17T17:51:53.729177] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-17T17:51:53.729269] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-17T17:51:53.729931] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-17T17:51:53.729997] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-17T17:51:53.731187] [DEBUG] [LOCAL ] BZH: Trimmed 47206 records to 32798 (keeping 200 days of data) [2025-10-17T17:51:53.915413] [DEBUG] [LOCAL ] BZH: Primary data saved (32798 records). [2025-10-17T17:51:53.915540] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-17T17:51:53.915620] [INFO ] [MAIN ] Update Progress: 380/2368 symbols completed. BZH took 31.7s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-17T17:51:54.085325] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:54.085506] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-10-17T17:51:54.085545] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-10-17T17:51:54.085694] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-17T17:51:54.085749] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-17T17:51:54.085796] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-17T17:51:54.085829] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-17T17:51:54.365874] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-17T17:51:54.457161] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:54.766750] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:51:54.788015] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T17:51:55.158028] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-17T17:51:55.435339] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:51:55.958053] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-17T17:51:56.758079] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-17T17:51:57.029425] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T17:51:57.143809] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-17T17:51:57.558061] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-17T17:51:58.085582] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:51:58.358094] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-17T17:51:58.452089] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:51:59.158135] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-17T17:51:59.471223] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:51:59.958080] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-17T17:52:00.758049] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-17T17:52:01.473933] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T17:52:01.558036] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-17T17:52:01.924620] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-17T17:52:01.951826] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T17:52:02.358064] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-17T17:52:02.605915] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T17:52:03.158030] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-17T17:52:03.627376] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:52:03.958081] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-17T17:52:04.565767] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:52:04.758123] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-17T17:52:05.014255] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:52:05.558041] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-17T17:52:06.358001] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-17T17:52:06.663490] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:52:06.898020] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-17T17:52:07.158047] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-17T17:52:07.820067] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T17:52:07.958058] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-17T17:52:08.270173] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:52:08.758008] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-17T17:52:08.915111] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T17:52:09.368120] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:52:09.558031] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-17T17:52:10.358107] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-17T17:52:10.529479] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T17:52:11.158020] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-17T17:52:11.958065] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-17T17:52:11.982834] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:52:12.655237] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-17T17:52:12.758007] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-17T17:52:12.993883] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:52:13.558032] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-17T17:52:13.860618] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T17:52:13.862690] [INFO ] [REMOTE ] CABO: Full fetch complete (23161 records). [2025-10-17T17:52:13.862810] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-17T17:52:14.234091] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-17T17:52:14.234197] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-17T17:52:14.234835] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-17T17:52:14.234957] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-17T17:52:14.235587] [DEBUG] [LOCAL ] CABO: Trimmed 23161 records to 16919 (keeping 200 days of data) [2025-10-17T17:52:14.336540] [DEBUG] [LOCAL ] CABO: Primary data saved (16919 records). [2025-10-17T17:52:14.336738] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-17T17:52:14.336855] [INFO ] [MAIN ] Update Progress: 381/2368 symbols completed. CABO took 25.6s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-17T17:52:14.365560] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-17T17:52:14.506009] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:14.554123] [DEBUG] [LOCAL ] CADE: Loaded 49873 existing records from primary storage. [2025-10-17T17:52:14.554475] [INFO ] [MAIN ] CADE: Loaded 49873 existing records. [2025-10-17T17:52:14.748735] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:14.749125] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-17T17:52:14.749232] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-17T17:52:14.758089] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-17T17:52:14.772396] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-17T17:52:14.811242] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T17:52:15.163229] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-17T17:52:15.193795] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:15.958022] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-17T17:52:16.458497] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T17:52:16.462321] [INFO ] [REMOTE ] CAAP: Full fetch complete (27940 records). [2025-10-17T17:52:16.462418] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-17T17:52:16.764270] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-17T17:52:16.901722] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-17T17:52:16.901826] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-17T17:52:16.902427] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-17T17:52:16.902604] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-17T17:52:16.903500] [DEBUG] [LOCAL ] CAAP: Trimmed 27940 records to 20139 (keeping 200 days of data) [2025-10-17T17:52:17.012798] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-17T17:52:17.023301] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-17T17:52:17.024348] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-17T17:52:17.382144] [DEBUG] [LOCAL ] CAAP: Primary data saved (20139 records). [2025-10-17T17:52:17.392673] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-17T17:52:17.397990] [INFO ] [MAIN ] Update Progress: 382/2368 symbols completed. CAAP took 30.5s. Estimated remaining: 4h 31m 31s. Rate: 7.3 symbols/min [2025-10-17T17:52:17.587452] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-17T17:52:17.604962] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-17T17:52:17.619202] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-17T17:52:17.625070] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-17T17:52:17.697312] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:17.697516] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 54520 (keeping 200 days of data) [2025-10-17T17:52:17.841538] [DEBUG] [LOCAL ] CAE: Loaded 39534 existing records from primary storage. [2025-10-17T17:52:17.842789] [INFO ] [MAIN ] CAE: Loaded 39534 existing records. [2025-10-17T17:52:18.043574] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:18.059794] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-17T17:52:18.065360] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-17T17:52:18.080561] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-17T17:52:18.081281] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-17T17:52:18.135938] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T17:52:18.224965] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-17T17:52:18.723024] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:18.728973] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-17T17:52:18.733948] [DEBUG] [LOCAL ] C: Primary data saved (54520 records). [2025-10-17T17:52:18.734593] [INFO ] [MAIN ] C: Full history saved. [2025-10-17T17:52:18.734706] [INFO ] [MAIN ] Update Progress: 383/2368 symbols completed. C took 55.6s. Estimated remaining: 4h 30m 47s. Rate: 7.3 symbols/min [2025-10-17T17:52:18.911749] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:18.935307] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T17:52:18.945992] [DEBUG] [LOCAL ] CAF: Loaded 3501 existing records from primary storage. [2025-10-17T17:52:18.946458] [INFO ] [MAIN ] CAF: Loaded 3501 existing records. [2025-10-17T17:52:19.126298] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:19.126498] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-17T17:52:19.126547] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-17T17:52:19.126718] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-17T17:52:19.126775] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-17T17:52:19.169055] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-17T17:52:19.485685] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:19.958010] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-17T17:52:19.985154] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:52:20.082249] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T17:52:20.758009] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-17T17:52:20.773465] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T17:52:21.131695] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T17:52:21.558027] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-17T17:52:22.067415] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:52:22.357993] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-17T17:52:22.766723] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:52:23.006502] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T17:52:23.158088] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-17T17:52:23.535110] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-17T17:52:23.958081] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-17T17:52:24.758018] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-17T17:52:25.409395] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T17:52:25.493771] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T17:52:25.558019] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-17T17:52:26.358076] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-17T17:52:27.163114] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-17T17:52:27.178822] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:52:27.797214] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:52:27.812063] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T17:52:27.958035] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-17T17:52:28.758071] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-17T17:52:29.114101] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:52:29.558073] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-17T17:52:30.210538] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T17:52:30.350336] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:52:30.358577] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-17T17:52:31.158054] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-17T17:52:31.505533] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T17:52:31.958045] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-17T17:52:32.758032] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-17T17:52:32.935887] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T17:52:33.017106] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T17:52:33.558036] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-17T17:52:34.121636] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T17:52:34.269303] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:52:34.358041] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-17T17:52:34.821006] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T17:52:35.158031] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-17T17:52:35.615478] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T17:52:35.958040] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-17T17:52:36.758027] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-17T17:52:37.266971] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T17:52:37.558047] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-17T17:52:38.132307] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:52:38.368368] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-17T17:52:38.376406] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T17:52:38.981000] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T17:52:38.982203] [INFO ] [REMOTE ] CAF: Full fetch complete (5547 records). [2025-10-17T17:52:38.982278] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-17T17:52:39.162456] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-17T17:52:39.343592] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-17T17:52:39.343699] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-17T17:52:39.343873] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-17T17:52:39.343933] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-17T17:52:39.344300] [DEBUG] [LOCAL ] CAF: Trimmed 5547 records to 3545 (keeping 200 days of data) [2025-10-17T17:52:39.364742] [DEBUG] [LOCAL ] CAF: Primary data saved (3545 records). [2025-10-17T17:52:39.364816] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-17T17:52:39.364908] [INFO ] [MAIN ] Update Progress: 384/2368 symbols completed. CAF took 20.6s. Estimated remaining: 4h 31m 43s. Rate: 7.3 symbols/min [2025-10-17T17:52:39.529282] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:39.580981] [DEBUG] [LOCAL ] CAG: Loaded 54055 existing records from primary storage. [2025-10-17T17:52:39.581302] [INFO ] [MAIN ] CAG: Loaded 54055 existing records. [2025-10-17T17:52:39.758702] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:39.758949] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-17T17:52:39.759000] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-17T17:52:39.759188] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-17T17:52:39.759231] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-17T17:52:39.966904] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-17T17:52:40.124362] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:40.601125] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T17:52:40.758027] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-17T17:52:41.558037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-17T17:52:41.559798] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:52:42.356916] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T17:52:42.365570] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-17T17:52:43.158110] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-17T17:52:43.539740] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-17T17:52:43.540961] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:52:43.560024] [INFO ] [REMOTE ] CACI: Full fetch complete (38271 records). [2025-10-17T17:52:43.560335] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-17T17:52:43.963367] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-17T17:52:44.105630] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-17T17:52:44.105783] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-17T17:52:44.106724] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-17T17:52:44.106804] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-17T17:52:44.108185] [DEBUG] [LOCAL ] CACI: Trimmed 38271 records to 23405 (keeping 200 days of data) [2025-10-17T17:52:44.275043] [DEBUG] [LOCAL ] CACI: Primary data saved (23405 records). [2025-10-17T17:52:44.275182] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-17T17:52:44.275322] [INFO ] [MAIN ] Update Progress: 385/2368 symbols completed. CACI took 50.4s. Estimated remaining: 4h 31m 18s. Rate: 7.3 symbols/min [2025-10-17T17:52:44.450254] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:44.505125] [DEBUG] [LOCAL ] CAH: Loaded 51839 existing records from primary storage. [2025-10-17T17:52:44.505447] [INFO ] [MAIN ] CAH: Loaded 51839 existing records. [2025-10-17T17:52:44.688890] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:44.689152] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-17T17:52:44.689364] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-17T17:52:44.689782] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-17T17:52:44.689887] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-17T17:52:44.758991] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-17T17:52:44.856929] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:52:45.149153] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:45.559294] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-17T17:52:45.562106] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:52:46.358070] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-17T17:52:46.635077] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:52:47.158070] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-17T17:52:47.222223] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:52:47.958019] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-17T17:52:48.315531] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:52:48.758086] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-17T17:52:48.840558] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T17:52:49.558037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-17T17:52:49.639060] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T17:52:50.259435] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:52:50.357980] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-17T17:52:51.158057] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-17T17:52:51.360362] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T17:52:51.872357] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:52:51.879786] [INFO ] [REMOTE ] CAE: Full fetch complete (56506 records). [2025-10-17T17:52:51.879953] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-17T17:52:51.963159] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-17T17:52:52.259848] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-17T17:52:52.259927] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-17T17:52:52.260576] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-17T17:52:52.260618] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-17T17:52:52.261708] [DEBUG] [LOCAL ] CAE: Trimmed 56506 records to 39813 (keeping 200 days of data) [2025-10-17T17:52:52.493391] [DEBUG] [LOCAL ] CAE: Primary data saved (39813 records). [2025-10-17T17:52:52.493604] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-17T17:52:52.493737] [INFO ] [MAIN ] Update Progress: 386/2368 symbols completed. CAE took 35.1s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-17T17:52:52.700290] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:52.741372] [DEBUG] [LOCAL ] CAL: Loaded 43267 existing records from primary storage. [2025-10-17T17:52:52.741697] [INFO ] [MAIN ] CAL: Loaded 43267 existing records. [2025-10-17T17:52:52.772301] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-17T17:52:52.919867] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:52.926498] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-17T17:52:52.937743] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-17T17:52:52.938343] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-17T17:52:52.938408] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-17T17:52:52.939236] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:52:53.019076] [INFO ] [REMOTE ] CADE: Full fetch complete (70615 records). [2025-10-17T17:52:53.035202] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-17T17:52:53.662431] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:53.697038] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-17T17:52:53.722604] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-17T17:52:53.722783] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-17T17:52:53.723904] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-17T17:52:53.723989] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-17T17:52:53.726023] [DEBUG] [LOCAL ] CADE: Trimmed 70615 records to 50257 (keeping 200 days of data) [2025-10-17T17:52:53.866872] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T17:52:54.077206] [DEBUG] [LOCAL ] CADE: Primary data saved (50257 records). [2025-10-17T17:52:54.077375] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-17T17:52:54.077493] [INFO ] [MAIN ] Update Progress: 387/2368 symbols completed. CADE took 39.7s. Estimated remaining: 4h 30m 28s. Rate: 7.3 symbols/min [2025-10-17T17:52:54.255848] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:54.291543] [DEBUG] [LOCAL ] CALX: Loaded 37885 existing records from primary storage. [2025-10-17T17:52:54.291897] [INFO ] [MAIN ] CALX: Loaded 37885 existing records. [2025-10-17T17:52:54.368309] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-17T17:52:54.474808] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:54.475233] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-17T17:52:54.475322] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-17T17:52:54.475703] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-17T17:52:54.475762] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-17T17:52:54.853473] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:54.927527] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T17:52:55.158046] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-17T17:52:55.609171] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T17:52:55.958003] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-17T17:52:56.101328] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T17:52:56.612245] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:52:56.758112] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-17T17:52:57.112618] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T17:52:57.558049] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-17T17:52:58.358018] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-17T17:52:58.724056] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:52:59.158039] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-17T17:52:59.466133] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:52:59.502185] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:52:59.958065] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-17T17:53:00.758103] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-17T17:53:01.220634] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:53:01.550355] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T17:53:01.558087] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-17T17:53:02.358052] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-17T17:53:02.728145] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:53:03.158035] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-17T17:53:03.404325] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:53:03.848008] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T17:53:03.958073] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-17T17:53:04.758066] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-17T17:53:05.294868] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T17:53:05.558115] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-17T17:53:05.760181] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T17:53:06.336880] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T17:53:06.358062] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-17T17:53:07.158039] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-17T17:53:07.563060] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T17:53:07.602624] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T17:53:07.958125] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-17T17:53:08.741095] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T17:53:08.757989] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-17T17:53:09.558046] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-17T17:53:09.614465] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T17:53:10.123980] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T17:53:10.358070] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-17T17:53:11.158023] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-17T17:53:11.226812] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T17:53:11.963531] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-17T17:53:11.978145] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:53:12.758069] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-17T17:53:13.018730] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T17:53:13.491298] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:53:13.558055] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-17T17:53:14.089358] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:53:14.358131] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-17T17:53:15.158082] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-17T17:53:15.341849] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:53:15.958135] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-17T17:53:16.392834] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T17:53:16.400521] [INFO ] [REMOTE ] CAG: Full fetch complete (77434 records). [2025-10-17T17:53:16.400825] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-17T17:53:16.402064] [FATAL] [VALIDATOR ] CAG: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:53:16.402165] [FATAL] [MAIN ] CAG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:53:16.402217] [WARN ] [MAIN ] CAG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:53:16.402286] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-17T17:53:16.402389] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-17T17:53:16.402451] [INFO ] [LOCAL ] CAG: Starting deletion of derivative data. [2025-10-17T17:53:16.402714] [DEBUG] [LOCAL ] CAG: Deleted derivative data file. [2025-10-17T17:53:16.402836] [INFO ] [MAIN ] Update Progress: 388/2368 symbols completed. CAG took 37.0s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-17T17:53:16.586027] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:16.617102] [DEBUG] [LOCAL ] CANG: Loaded 27143 existing records from primary storage. [2025-10-17T17:53:16.617493] [INFO ] [MAIN ] CANG: Loaded 27143 existing records. [2025-10-17T17:53:16.765964] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-17T17:53:16.811925] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:16.812232] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-17T17:53:16.812288] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-17T17:53:16.812627] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-17T17:53:16.812712] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-17T17:53:17.182497] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T17:53:17.251804] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:17.558055] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-17T17:53:17.836769] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T17:53:18.228890] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T17:53:18.358024] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-17T17:53:18.863960] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:53:19.158125] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-17T17:53:19.853856] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:53:19.958064] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-17T17:53:20.758074] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-17T17:53:21.073249] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T17:53:21.081014] [INFO ] [REMOTE ] CAH: Full fetch complete (74837 records). [2025-10-17T17:53:21.081269] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-17T17:53:21.286694] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:53:21.511421] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-17T17:53:21.511517] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-17T17:53:21.512349] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-17T17:53:21.512421] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-17T17:53:21.513930] [DEBUG] [LOCAL ] CAH: Trimmed 74837 records to 52214 (keeping 200 days of data) [2025-10-17T17:53:21.569618] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-17T17:53:21.872990] [DEBUG] [LOCAL ] CAH: Primary data saved (52214 records). [2025-10-17T17:53:21.873158] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-17T17:53:21.874090] [INFO ] [MAIN ] Update Progress: 389/2368 symbols completed. CAH took 37.6s. Estimated remaining: 4h 31m 9s. Rate: 7.3 symbols/min [2025-10-17T17:53:22.047165] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:22.055557] [DEBUG] [LOCAL ] CAPL: Loaded 5684 existing records from primary storage. [2025-10-17T17:53:22.055805] [INFO ] [MAIN ] CAPL: Loaded 5684 existing records. [2025-10-17T17:53:22.253037] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:53:22.256796] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:22.262522] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-17T17:53:22.262835] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-17T17:53:22.263010] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-17T17:53:22.263068] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-17T17:53:22.293940] [INFO ] [REMOTE ] CALX: Full fetch complete (54239 records). [2025-10-17T17:53:22.336586] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-17T17:53:22.360362] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-17T17:53:22.865836] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:23.049985] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-17T17:53:23.065162] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-17T17:53:23.065956] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-17T17:53:23.066045] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-17T17:53:23.068584] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T17:53:23.079193] [DEBUG] [LOCAL ] CALX: Trimmed 54239 records to 38084 (keeping 200 days of data) [2025-10-17T17:53:23.160695] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-17T17:53:23.305297] [DEBUG] [LOCAL ] CALX: Primary data saved (38084 records). [2025-10-17T17:53:23.305533] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-17T17:53:23.305666] [INFO ] [MAIN ] Update Progress: 390/2368 symbols completed. CALX took 29.2s. Estimated remaining: 4h 30m 27s. Rate: 7.3 symbols/min [2025-10-17T17:53:23.496387] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:23.556562] [DEBUG] [LOCAL ] CARR: Loaded 53992 existing records from primary storage. [2025-10-17T17:53:23.557055] [INFO ] [MAIN ] CARR: Loaded 53992 existing records. [2025-10-17T17:53:23.771340] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:23.772189] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-17T17:53:23.772272] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-17T17:53:23.772823] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-17T17:53:23.772886] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-17T17:53:23.959687] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-17T17:53:24.144722] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:53:24.258223] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:53:24.263528] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:24.758019] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-17T17:53:24.842138] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T17:53:25.558042] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-17T17:53:26.323179] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:53:26.358031] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-17T17:53:26.607503] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T17:53:27.158025] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-17T17:53:27.202528] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T17:53:27.958042] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-17T17:53:28.572030] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:53:28.758031] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-17T17:53:28.787191] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T17:53:29.558026] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-17T17:53:29.819229] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:53:30.358028] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-17T17:53:30.374076] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T17:53:31.158030] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-17T17:53:31.632198] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:53:31.958027] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-17T17:53:32.758013] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-17T17:53:32.929365] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T17:53:33.558026] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-17T17:53:33.648994] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T17:53:33.655870] [INFO ] [REMOTE ] CAL: Full fetch complete (61823 records). [2025-10-17T17:53:33.656024] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-17T17:53:34.097773] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T17:53:34.097934] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-17T17:53:34.103921] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-17T17:53:34.105320] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-17T17:53:34.105388] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-17T17:53:34.106616] [DEBUG] [LOCAL ] CAL: Trimmed 61823 records to 43547 (keeping 200 days of data) [2025-10-17T17:53:34.365706] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-17T17:53:34.379746] [DEBUG] [LOCAL ] CAL: Primary data saved (43547 records). [2025-10-17T17:53:34.379881] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-17T17:53:34.380745] [INFO ] [MAIN ] Update Progress: 391/2368 symbols completed. CAL took 41.9s. Estimated remaining: 4h 30m 33s. Rate: 7.3 symbols/min [2025-10-17T17:53:34.553130] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:34.592126] [DEBUG] [LOCAL ] CARS: Loaded 40101 existing records from primary storage. [2025-10-17T17:53:34.592416] [INFO ] [MAIN ] CARS: Loaded 40101 existing records. [2025-10-17T17:53:34.772635] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:34.773184] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-17T17:53:34.773292] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-17T17:53:34.773768] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-17T17:53:34.773827] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-17T17:53:35.134521] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:35.159327] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-17T17:53:35.164714] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:53:35.584493] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T17:53:35.958109] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-17T17:53:36.683217] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:53:36.758108] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-17T17:53:37.131958] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T17:53:37.558030] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-17T17:53:37.987257] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T17:53:38.358083] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-17T17:53:38.966509] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T17:53:39.155265] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T17:53:39.158106] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-17T17:53:39.958024] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-17T17:53:40.480251] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T17:53:40.758019] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-17T17:53:41.130160] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:53:41.558029] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-17T17:53:41.828440] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:53:42.358031] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-17T17:53:42.935721] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:53:42.940236] [INFO ] [REMOTE ] CANG: Full fetch complete (39771 records). [2025-10-17T17:53:42.940337] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-17T17:53:43.163194] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-17T17:53:43.324493] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-17T17:53:43.324576] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-17T17:53:43.325135] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-17T17:53:43.325197] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-17T17:53:43.326088] [DEBUG] [LOCAL ] CANG: Trimmed 39771 records to 27428 (keeping 200 days of data) [2025-10-17T17:53:43.481423] [DEBUG] [LOCAL ] CANG: Primary data saved (27428 records). [2025-10-17T17:53:43.481612] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-17T17:53:43.481737] [INFO ] [MAIN ] Update Progress: 392/2368 symbols completed. CANG took 27.1s. Estimated remaining: 4h 30m 29s. Rate: 7.3 symbols/min [2025-10-17T17:53:43.653597] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:43.702779] [DEBUG] [LOCAL ] CAT: Loaded 53348 existing records from primary storage. [2025-10-17T17:53:43.703124] [INFO ] [MAIN ] CAT: Loaded 53348 existing records. [2025-10-17T17:53:43.887307] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:43.887673] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-17T17:53:43.887754] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-17T17:53:43.888034] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-17T17:53:43.888118] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-17T17:53:43.963837] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-17T17:53:44.166957] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:53:44.298927] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:44.633954] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:53:44.758039] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-17T17:53:44.983700] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:53:45.354968] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T17:53:45.558040] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-17T17:53:46.358066] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-17T17:53:47.158090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-17T17:53:47.298792] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:53:47.848071] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T17:53:47.958122] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-17T17:53:48.280905] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T17:53:48.563485] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T17:53:48.758102] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-17T17:53:49.558026] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-17T17:53:50.358106] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-17T17:53:50.364634] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:53:51.126403] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:53:51.158000] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-17T17:53:51.958090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-17T17:53:52.357053] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T17:53:52.451384] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:53:52.758013] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-17T17:53:52.820944] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T17:53:52.822305] [INFO ] [REMOTE ] CAPL: Full fetch complete (8724 records). [2025-10-17T17:53:52.822378] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-17T17:53:53.179515] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-17T17:53:53.179862] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-17T17:53:53.180106] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-17T17:53:53.180150] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-17T17:53:53.180575] [DEBUG] [LOCAL ] CAPL: Trimmed 8724 records to 5696 (keeping 200 days of data) [2025-10-17T17:53:53.216364] [DEBUG] [LOCAL ] CAPL: Primary data saved (5696 records). [2025-10-17T17:53:53.216519] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-17T17:53:53.216610] [INFO ] [MAIN ] Update Progress: 393/2368 symbols completed. CAPL took 31.3s. Estimated remaining: 4h 30m 29s. Rate: 7.3 symbols/min [2025-10-17T17:53:53.385508] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:53.394232] [DEBUG] [LOCAL ] CATO: Loaded 6736 existing records from primary storage. [2025-10-17T17:53:53.394463] [INFO ] [MAIN ] CATO: Loaded 6736 existing records. [2025-10-17T17:53:53.571718] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-17T17:53:53.577327] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:53.579223] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-17T17:53:53.579314] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-17T17:53:53.579768] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-17T17:53:53.579844] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-17T17:53:53.979900] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:54.358068] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-17T17:53:54.872631] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T17:53:55.158019] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-17T17:53:55.457540] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:53:55.673838] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T17:53:55.958063] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-17T17:53:56.758059] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-17T17:53:57.191772] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-17T17:53:57.558105] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-17T17:53:57.839412] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T17:53:58.358011] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-17T17:53:58.536577] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T17:53:59.158093] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-17T17:53:59.528129] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:53:59.944810] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:53:59.958011] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-17T17:54:00.222773] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:54:00.758064] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-17T17:54:01.558063] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-17T17:54:02.140114] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T17:54:02.358137] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-17T17:54:02.406941] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:54:02.719720] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:54:03.158070] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-17T17:54:03.958078] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-17T17:54:04.141840] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T17:54:04.692514] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T17:54:04.758066] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-17T17:54:05.398379] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:54:05.558093] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-17T17:54:05.577335] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T17:54:06.358059] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-17T17:54:06.958207] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T17:54:07.158018] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-17T17:54:07.616765] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T17:54:07.630325] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-17T17:54:07.630625] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-17T17:54:07.963157] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-17T17:54:08.060534] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-17T17:54:08.060694] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-17T17:54:08.062159] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-17T17:54:08.062241] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-17T17:54:08.064511] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 54382 (keeping 200 days of data) [2025-10-17T17:54:08.426533] [DEBUG] [LOCAL ] CARR: Primary data saved (54382 records). [2025-10-17T17:54:08.426811] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-17T17:54:08.426988] [INFO ] [MAIN ] Update Progress: 394/2368 symbols completed. CARR took 45.1s. Estimated remaining: 4h 30m 55s. Rate: 7.3 symbols/min [2025-10-17T17:54:08.610019] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:08.673536] [DEBUG] [LOCAL ] CAVA: Loaded 53956 existing records from primary storage. [2025-10-17T17:54:08.674020] [INFO ] [MAIN ] CAVA: Loaded 53956 existing records. [2025-10-17T17:54:08.758416] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-17T17:54:08.786484] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:54:08.888526] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:08.888901] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-17T17:54:08.888957] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-17T17:54:08.889239] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-17T17:54:08.889281] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-17T17:54:09.284969] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:09.319352] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-17T17:54:09.558056] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-17T17:54:10.364487] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-17T17:54:10.371669] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:54:10.378997] [INFO ] [REMOTE ] CARS: Full fetch complete (56338 records). [2025-10-17T17:54:10.379182] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-17T17:54:10.779014] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-17T17:54:10.779143] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-17T17:54:10.780224] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-17T17:54:10.780295] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-17T17:54:10.782103] [DEBUG] [LOCAL ] CARS: Trimmed 56338 records to 40383 (keeping 200 days of data) [2025-10-17T17:54:11.044140] [DEBUG] [LOCAL ] CARS: Primary data saved (40383 records). [2025-10-17T17:54:11.044320] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-17T17:54:11.045033] [INFO ] [MAIN ] Update Progress: 395/2368 symbols completed. CARS took 36.7s. Estimated remaining: 4h 30m 19s. Rate: 7.3 symbols/min [2025-10-17T17:54:11.163211] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-17T17:54:11.240465] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:11.309291] [DEBUG] [LOCAL ] CB: Loaded 50327 existing records from primary storage. [2025-10-17T17:54:11.309866] [INFO ] [MAIN ] CB: Loaded 50327 existing records. [2025-10-17T17:54:11.518218] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:11.518785] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-17T17:54:11.518902] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-17T17:54:11.519353] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-17T17:54:11.519434] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-17T17:54:11.671317] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T17:54:11.898261] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T17:54:11.958739] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-17T17:54:11.988468] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:12.663063] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-17T17:54:12.758100] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-17T17:54:13.558056] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-17T17:54:14.209891] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-17T17:54:14.234506] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-17T17:54:14.311571] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:54:14.358051] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-17T17:54:15.158082] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-17T17:54:15.958044] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-17T17:54:16.087564] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:54:16.421236] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T17:54:16.758068] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-17T17:54:17.558051] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-17T17:54:17.791303] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T17:54:18.358062] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-17T17:54:18.695814] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:54:19.081752] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T17:54:19.083698] [INFO ] [REMOTE ] CATO: Full fetch complete (10862 records). [2025-10-17T17:54:19.083872] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-17T17:54:19.163167] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-17T17:54:19.486470] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-17T17:54:19.486574] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-17T17:54:19.487066] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-17T17:54:19.487131] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-17T17:54:19.487863] [DEBUG] [LOCAL ] CATO: Trimmed 10862 records to 6799 (keeping 200 days of data) [2025-10-17T17:54:19.531975] [DEBUG] [LOCAL ] CATO: Primary data saved (6799 records). [2025-10-17T17:54:19.532199] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-17T17:54:19.532332] [INFO ] [MAIN ] Update Progress: 396/2368 symbols completed. CATO took 26.3s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-17T17:54:19.713690] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:19.730226] [DEBUG] [LOCAL ] CBAN: Loaded 10553 existing records from primary storage. [2025-10-17T17:54:19.730540] [INFO ] [MAIN ] CBAN: Loaded 10553 existing records. [2025-10-17T17:54:19.939960] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:19.940441] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-17T17:54:19.940535] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-17T17:54:19.940825] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-17T17:54:19.940912] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-17T17:54:19.964144] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-17T17:54:20.169000] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-17T17:54:20.285084] [INFO ] [REMOTE ] CAT: Full fetch complete (76882 records). [2025-10-17T17:54:20.288352] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-17T17:54:20.493545] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:20.763247] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-17T17:54:20.829214] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-17T17:54:20.829350] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-17T17:54:20.830804] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-17T17:54:20.830878] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-17T17:54:20.833998] [DEBUG] [LOCAL ] CAT: Trimmed 76882 records to 53736 (keeping 200 days of data) [2025-10-17T17:54:21.213952] [DEBUG] [LOCAL ] CAT: Primary data saved (53736 records). [2025-10-17T17:54:21.214243] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-17T17:54:21.214385] [INFO ] [MAIN ] Update Progress: 397/2368 symbols completed. CAT took 37.7s. Estimated remaining: 4h 29m 32s. Rate: 7.3 symbols/min [2025-10-17T17:54:21.247022] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T17:54:21.558083] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-17T17:54:21.654768] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:54:21.860483] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:54:22.358050] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-17T17:54:23.158064] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-17T17:54:23.195710] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T17:54:23.802861] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T17:54:23.958091] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-17T17:54:24.758078] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-17T17:54:25.072153] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T17:54:25.562857] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-17T17:54:25.570923] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T17:54:25.621994] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:54:26.358054] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-17T17:54:27.158058] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-17T17:54:27.536054] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T17:54:27.958211] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-17T17:54:28.124094] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:54:28.555664] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-17T17:54:28.758099] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-17T17:54:29.558161] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-17T17:54:29.736987] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:54:30.172064] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:54:30.358128] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-17T17:54:30.732561] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:54:31.158054] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-17T17:54:31.243777] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T17:54:31.958081] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-17T17:54:32.758147] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-17T17:54:33.267886] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T17:54:33.558061] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-17T17:54:33.719710] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:54:33.751481] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T17:54:34.358100] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-17T17:54:35.158121] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-17T17:54:35.245430] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:54:35.672255] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T17:54:35.958056] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-17T17:54:36.758068] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-17T17:54:37.196095] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:54:37.525307] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T17:54:37.558027] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-17T17:54:38.063261] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T17:54:38.334471] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T17:54:38.358051] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-17T17:54:39.158038] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-17T17:54:39.213107] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T17:54:39.215445] [INFO ] [REMOTE ] CBAN: Full fetch complete (16231 records). [2025-10-17T17:54:39.215538] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-17T17:54:39.645492] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-17T17:54:39.645601] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-17T17:54:39.646232] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-17T17:54:39.646334] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-17T17:54:39.647202] [DEBUG] [LOCAL ] CBAN: Trimmed 16231 records to 10619 (keeping 200 days of data) [2025-10-17T17:54:39.714550] [DEBUG] [LOCAL ] CBAN: Primary data saved (10619 records). [2025-10-17T17:54:39.714771] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-17T17:54:39.714887] [INFO ] [MAIN ] Update Progress: 398/2368 symbols completed. CBAN took 20.2s. Estimated remaining: 4h 30m 14s. Rate: 7.3 symbols/min [2025-10-17T17:54:39.958101] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-17T17:54:40.063855] [DEBUG] [REMOTE ] CAVA: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-17T17:54:40.064326] [WARN ] [REMOTE ] CAVA: No data returned for month 2025-10 [2025-10-17T17:54:40.064430] [FATAL] [REMOTE ] CAVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:54:40.064545] [FATAL] [MAIN ] CAVA: Failed to fetch primary data. [2025-10-17T17:54:40.064629] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:54:40.064734] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-17T17:54:40.064812] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-17T17:54:40.064905] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-10-17T17:54:40.065117] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-10-17T17:54:40.065216] [INFO ] [MAIN ] Update Progress: 399/2368 symbols completed. CAVA took 31.6s. Estimated remaining: 4h 29m 27s. Rate: 7.3 symbols/min [2025-10-17T17:54:40.854390] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T17:54:40.871103] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-17T17:54:42.566744] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T17:54:42.579231] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-17T17:54:44.373305] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T17:54:44.381134] [INFO ] [REMOTE ] CB: Full fetch complete (72839 records). [2025-10-17T17:54:44.381309] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-17T17:54:44.806534] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-17T17:54:44.806632] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-17T17:54:44.807589] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-17T17:54:44.807686] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-17T17:54:44.809257] [DEBUG] [LOCAL ] CB: Trimmed 72839 records to 50716 (keeping 200 days of data) [2025-10-17T17:54:45.160878] [DEBUG] [LOCAL ] CB: Primary data saved (50716 records). [2025-10-17T17:54:45.161121] [INFO ] [MAIN ] CB: Full history saved. [2025-10-17T17:54:45.161770] [INFO ] [MAIN ] Update Progress: 400/2368 symbols completed. CB took 34.1s. Estimated remaining: 4h 29m 4s. Rate: 7.3 symbols/min [2025-10-17T17:54:45.861809] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.849959] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.904024] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.966216] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.971244] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-17T17:54:45.971908] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-17T17:54:45.972291] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-17T17:54:45.972347] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-17T17:54:45.972445] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-17T17:54:45.972493] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-17T17:54:45.971588] [DEBUG] [LOCAL ] CBNA: Loaded 2936 existing records from primary storage. [2025-10-17T17:54:45.984789] [INFO ] [MAIN ] CBNA: Loaded 2936 existing records. [2025-10-17T17:54:46.180150] [DEBUG] [LOCAL ] CBL: Loaded 16377 existing records from primary storage. [2025-10-17T17:54:46.241378] [INFO ] [MAIN ] CBL: Loaded 16377 existing records. [2025-10-17T17:54:46.484908] [DEBUG] [LOCAL ] CBRE: Loaded 50735 existing records from primary storage. [2025-10-17T17:54:46.520870] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:46.553493] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-17T17:54:46.547987] [INFO ] [MAIN ] CBRE: Loaded 50735 existing records. [2025-10-17T17:54:46.646961] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-17T17:54:46.756701] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-17T17:54:46.834821] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-17T17:54:46.961972] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:47.014066] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-17T17:54:47.056538] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-17T17:54:47.146803] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:47.212230] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-17T17:54:47.212168] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:47.213247] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-17T17:54:47.224444] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-17T17:54:47.230083] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-17T17:54:47.229976] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-17T17:54:47.283179] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-17T17:54:47.326504] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-17T17:54:47.564371] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:54:47.654421] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-17T17:54:47.698091] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:54:47.823842] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-17T17:54:47.916384] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:54:47.933780] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:47.957717] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-17T17:54:47.949555] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-17T17:54:47.987594] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-17T17:54:48.059954] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-17T17:54:48.097370] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-17T17:54:48.103637] [INFO ] [MAIN ] Update Progress: 401/2368 symbols completed. CBO took 2.9s. Estimated remaining: 4h 28m 30s. Rate: 7.3 symbols/min [2025-10-17T17:54:48.397526] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:48.414927] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-17T17:54:48.470702] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:48.526384] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-17T17:54:48.533070] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:48.569775] [DEBUG] [LOCAL ] CBT: Loaded 31366 existing records from primary storage. [2025-10-17T17:54:48.570169] [INFO ] [MAIN ] CBT: Loaded 31366 existing records. [2025-10-17T17:54:48.788904] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:48.790497] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-17T17:54:48.790379] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T17:54:48.792932] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-17T17:54:48.790664] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-17T17:54:48.794135] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-17T17:54:48.794195] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-17T17:54:49.188553] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:49.189026] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-17T17:54:49.415354] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T17:54:49.417580] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-17T17:54:49.498887] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:54:49.504062] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-17T17:54:49.886430] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:54:49.888204] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-17T17:54:50.292076] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:54:50.304036] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-17T17:54:50.310043] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T17:54:50.358076] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-17T17:54:50.546375] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T17:54:50.644804] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T17:54:50.826212] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T17:54:51.158114] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-17T17:54:51.732019] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T17:54:51.958022] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-17T17:54:52.052034] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T17:54:52.758001] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-17T17:54:53.230556] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:54:53.558079] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-17T17:54:53.778885] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T17:54:54.358101] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-17T17:54:55.133216] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:54:55.157989] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-17T17:54:55.593482] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:54:55.958087] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-17T17:54:56.523282] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T17:54:56.758087] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-17T17:54:56.878978] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:54:57.215155] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T17:54:57.558047] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-17T17:54:58.358019] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-17T17:54:58.621579] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:54:58.917807] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:54:59.158059] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-17T17:54:59.601720] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T17:54:59.958044] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-17T17:55:00.458433] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T17:55:00.459488] [INFO ] [REMOTE ] CBNA: Full fetch complete (4351 records). [2025-10-17T17:55:00.459559] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-17T17:55:00.763054] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-17T17:55:00.847690] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-17T17:55:00.847799] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-17T17:55:00.848001] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-17T17:55:00.848043] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-17T17:55:00.848433] [DEBUG] [LOCAL ] CBNA: Trimmed 4351 records to 2942 (keeping 200 days of data) [2025-10-17T17:55:00.866980] [DEBUG] [LOCAL ] CBNA: Primary data saved (2942 records). [2025-10-17T17:55:00.867119] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-17T17:55:00.867216] [INFO ] [MAIN ] Update Progress: 402/2368 symbols completed. CBNA took 15.7s. Estimated remaining: 4h 28m 44s. Rate: 7.3 symbols/min [2025-10-17T17:55:01.116796] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:01.197036] [DEBUG] [LOCAL ] CBU: Loaded 22932 existing records from primary storage. [2025-10-17T17:55:01.197549] [INFO ] [MAIN ] CBU: Loaded 22932 existing records. [2025-10-17T17:55:01.402188] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:01.402430] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-17T17:55:01.402484] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-17T17:55:01.403216] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-17T17:55:01.403487] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-17T17:55:01.563260] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-17T17:55:01.802266] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:02.358134] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-17T17:55:02.660781] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T17:55:03.158089] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-17T17:55:03.536804] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:55:03.839599] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-17T17:55:03.958025] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-17T17:55:04.553876] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T17:55:04.758070] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-17T17:55:05.558041] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-17T17:55:05.697956] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:55:06.158327] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:55:06.254800] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T17:55:06.358057] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-17T17:55:07.158081] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-17T17:55:07.691692] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T17:55:07.958034] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-17T17:55:08.155037] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T17:55:08.758099] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-17T17:55:09.491354] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:55:09.558029] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-17T17:55:10.368700] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-17T17:55:10.393150] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T17:55:10.803233] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:55:11.158002] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-17T17:55:11.527681] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T17:55:11.746745] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T17:55:11.958000] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-17T17:55:12.758109] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-17T17:55:12.968541] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T17:55:13.558071] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-17T17:55:13.994998] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T17:55:14.358099] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-17T17:55:14.960280] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T17:55:15.158019] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-17T17:55:15.477618] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T17:55:15.958054] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-17T17:55:16.506783] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:55:16.758064] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-17T17:55:16.868090] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T17:55:17.558030] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-17T17:55:18.061399] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:55:18.358037] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-17T17:55:19.158003] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-17T17:55:19.295048] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:55:19.463480] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:55:19.958021] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-17T17:55:20.329613] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T17:55:20.334674] [INFO ] [REMOTE ] CBT: Full fetch complete (45866 records). [2025-10-17T17:55:20.334787] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-17T17:55:20.707799] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-17T17:55:20.707879] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-17T17:55:20.708489] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-17T17:55:20.708530] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-17T17:55:20.709791] [DEBUG] [LOCAL ] CBT: Trimmed 45866 records to 31588 (keeping 200 days of data) [2025-10-17T17:55:20.763594] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-17T17:55:20.903631] [DEBUG] [LOCAL ] CBT: Primary data saved (31588 records). [2025-10-17T17:55:20.903817] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-17T17:55:20.903981] [INFO ] [MAIN ] Update Progress: 403/2368 symbols completed. CBT took 32.8s. Estimated remaining: 4h 29m 33s. Rate: 7.3 symbols/min [2025-10-17T17:55:21.013945] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T17:55:21.090385] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:21.090578] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-17T17:55:21.090616] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-17T17:55:21.090757] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-17T17:55:21.090799] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-17T17:55:21.090840] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-17T17:55:21.090873] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-17T17:55:21.435786] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:21.558018] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-17T17:55:21.621695] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T17:55:21.624254] [INFO ] [REMOTE ] CBL: Full fetch complete (25070 records). [2025-10-17T17:55:21.624341] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-17T17:55:21.770339] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:55:21.801797] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-17T17:55:21.848922] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:55:21.894481] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-17T17:55:21.910608] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:55:21.921029] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-17T17:55:21.921131] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-17T17:55:21.921195] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-17T17:55:21.932051] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-17T17:55:21.942384] [INFO ] [MAIN ] Update Progress: 404/2368 symbols completed. CBX took 1.0s. Estimated remaining: 4h 28m 50s. Rate: 7.3 symbols/min [2025-10-17T17:55:22.111229] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-17T17:55:22.113738] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-17T17:55:22.114565] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-17T17:55:22.120025] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-17T17:55:22.168602] [DEBUG] [LOCAL ] CBL: Trimmed 25070 records to 16467 (keeping 200 days of data) [2025-10-17T17:55:22.186910] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:22.296366] [DEBUG] [LOCAL ] CBL: Primary data saved (16467 records). [2025-10-17T17:55:22.296521] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-17T17:55:22.296607] [INFO ] [MAIN ] Update Progress: 405/2368 symbols completed. CBL took 37.1s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-17T17:55:22.362010] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-17T17:55:22.438044] [DEBUG] [LOCAL ] CBZ: Loaded 34513 existing records from primary storage. [2025-10-17T17:55:22.463528] [INFO ] [MAIN ] CBZ: Loaded 34513 existing records. [2025-10-17T17:55:22.483183] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:22.660858] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:22.661132] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-17T17:55:22.661186] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-17T17:55:22.661405] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-17T17:55:22.661462] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-17T17:55:22.856056] [DEBUG] [LOCAL ] CC: Loaded 53400 existing records from primary storage. [2025-10-17T17:55:22.874006] [INFO ] [MAIN ] CC: Loaded 53400 existing records. [2025-10-17T17:55:23.161163] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-17T17:55:23.194439] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:23.237906] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:23.238247] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-17T17:55:23.238309] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-17T17:55:23.238793] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-17T17:55:23.238894] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-17T17:55:23.591113] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:23.606883] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:55:23.958034] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-17T17:55:24.758049] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-17T17:55:24.956074] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T17:55:24.995119] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T17:55:25.558018] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-17T17:55:26.358052] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-17T17:55:26.614390] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T17:55:27.158039] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-17T17:55:27.224330] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T17:55:27.469267] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:55:27.958063] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-17T17:55:28.758085] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-17T17:55:28.811364] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T17:55:29.558035] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-17T17:55:29.943343] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T17:55:29.950522] [INFO ] [REMOTE ] CBRE: Full fetch complete (73806 records). [2025-10-17T17:55:29.950737] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-17T17:55:30.244797] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T17:55:30.359615] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-17T17:55:30.378474] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-17T17:55:30.378531] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-17T17:55:30.379337] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-17T17:55:30.379501] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-17T17:55:30.380935] [DEBUG] [LOCAL ] CBRE: Trimmed 73806 records to 51089 (keeping 200 days of data) [2025-10-17T17:55:30.684514] [DEBUG] [LOCAL ] CBRE: Primary data saved (51089 records). [2025-10-17T17:55:30.684660] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-17T17:55:30.685711] [INFO ] [MAIN ] Update Progress: 406/2368 symbols completed. CBRE took 45.5s. Estimated remaining: 4h 27m 57s. Rate: 7.3 symbols/min [2025-10-17T17:55:30.852502] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:30.906959] [DEBUG] [LOCAL ] CCI: Loaded 53506 existing records from primary storage. [2025-10-17T17:55:30.907310] [INFO ] [MAIN ] CCI: Loaded 53506 existing records. [2025-10-17T17:55:31.084312] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:31.084588] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-17T17:55:31.084695] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-17T17:55:31.085179] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-17T17:55:31.085230] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-17T17:55:31.159499] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-17T17:55:31.354590] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T17:55:31.487695] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:31.547066] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T17:55:31.958046] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-17T17:55:32.328453] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:55:32.758038] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-17T17:55:32.935543] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T17:55:32.939253] [INFO ] [REMOTE ] CBU: Full fetch complete (32664 records). [2025-10-17T17:55:32.939341] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-17T17:55:33.303026] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-17T17:55:33.303095] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-17T17:55:33.303619] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-17T17:55:33.303706] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-17T17:55:33.304522] [DEBUG] [LOCAL ] CBU: Trimmed 32664 records to 23143 (keeping 200 days of data) [2025-10-17T17:55:33.439354] [DEBUG] [LOCAL ] CBU: Primary data saved (23143 records). [2025-10-17T17:55:33.439484] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-17T17:55:33.439567] [INFO ] [MAIN ] Update Progress: 407/2368 symbols completed. CBU took 32.6s. Estimated remaining: 4h 27m 22s. Rate: 7.3 symbols/min [2025-10-17T17:55:33.563110] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-17T17:55:33.610565] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:33.610730] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-17T17:55:33.610820] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-17T17:55:33.610948] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-17T17:55:33.610999] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-17T17:55:33.611043] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-17T17:55:33.611076] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-17T17:55:33.972738] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:34.358104] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-17T17:55:34.619775] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:55:34.650601] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:55:35.158074] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-17T17:55:35.704200] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-17T17:55:35.958024] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-17T17:55:36.388333] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T17:55:36.758104] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-17T17:55:37.187173] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T17:55:37.425671] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T17:55:37.558077] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-17T17:55:38.358040] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-17T17:55:39.158035] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-17T17:55:39.410034] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T17:55:39.664190] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T17:55:39.958023] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-17T17:55:40.726314] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:55:40.757987] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-17T17:55:41.557992] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-17T17:55:41.748831] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T17:55:42.358211] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-17T17:55:42.532689] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:55:42.800296] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T17:55:42.824173] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T17:55:43.158096] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-17T17:55:43.958029] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-17T17:55:44.758130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-17T17:55:44.808869] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:55:45.183383] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:55:45.558043] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-17T17:55:45.942447] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T17:55:46.118610] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:55:46.358090] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-17T17:55:47.158080] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-17T17:55:47.918997] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:55:47.958033] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-17T17:55:48.411875] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:55:48.758109] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-17T17:55:49.267720] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T17:55:49.558058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-17T17:55:50.358094] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-17T17:55:50.553742] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:55:50.963519] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T17:55:51.158085] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-17T17:55:51.958062] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-17T17:55:52.271300] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:55:52.284905] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T17:55:52.577131] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T17:55:52.758094] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-17T17:55:53.110907] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T17:55:53.558065] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-17T17:55:54.358108] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-17T17:55:55.158044] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-17T17:55:55.318199] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:55:55.590423] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T17:55:55.780232] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:55:55.957987] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-17T17:55:56.758084] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-17T17:55:57.198927] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T17:55:57.558022] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-17T17:55:57.827945] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:55:58.358054] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-17T17:55:59.054051] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T17:55:59.059448] [INFO ] [REMOTE ] CBZ: Full fetch complete (46216 records). [2025-10-17T17:55:59.059581] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-17T17:55:59.158107] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-17T17:55:59.437941] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-17T17:55:59.438023] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-17T17:55:59.438671] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-17T17:55:59.438734] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-17T17:55:59.439726] [DEBUG] [LOCAL ] CBZ: Trimmed 46216 records to 34777 (keeping 200 days of data) [2025-10-17T17:55:59.637327] [DEBUG] [LOCAL ] CBZ: Primary data saved (34777 records). [2025-10-17T17:55:59.637496] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-17T17:55:59.637607] [INFO ] [MAIN ] Update Progress: 408/2368 symbols completed. CBZ took 37.7s. Estimated remaining: 4h 28m 41s. Rate: 7.3 symbols/min [2025-10-17T17:55:59.807038] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:59.822729] [DEBUG] [LOCAL ] CCIF: Loaded 15625 existing records from primary storage. [2025-10-17T17:55:59.823107] [INFO ] [MAIN ] CCIF: Loaded 15625 existing records. [2025-10-17T17:55:59.974827] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-17T17:56:00.005106] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:00.006444] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-17T17:56:00.006636] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-17T17:56:00.007111] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-17T17:56:00.007206] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-17T17:56:00.418727] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:00.420693] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T17:56:00.758054] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-17T17:56:00.811128] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:56:00.811999] [INFO ] [REMOTE ] CCIA: Full fetch complete (2156 records). [2025-10-17T17:56:00.812067] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-17T17:56:00.991439] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T17:56:00.991615] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:56:00.991703] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:56:00.991779] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-17T17:56:00.991843] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-17T17:56:00.991880] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-17T17:56:00.991919] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-17T17:56:00.991975] [INFO ] [MAIN ] Update Progress: 409/2368 symbols completed. CCIA took 27.6s. Estimated remaining: 4h 27m 59s. Rate: 7.3 symbols/min [2025-10-17T17:56:01.158931] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:01.213625] [DEBUG] [LOCAL ] CCJ: Loaded 54078 existing records from primary storage. [2025-10-17T17:56:01.213981] [INFO ] [MAIN ] CCJ: Loaded 54078 existing records. [2025-10-17T17:56:01.398715] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:01.398932] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-17T17:56:01.399009] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-17T17:56:01.410217] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-17T17:56:01.410429] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-17T17:56:01.528318] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T17:56:01.575089] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-17T17:56:01.615711] [INFO ] [REMOTE ] CC: Full fetch complete (76109 records). [2025-10-17T17:56:01.637690] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-17T17:56:01.782534] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T17:56:01.973384] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:02.211164] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-17T17:56:02.211251] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-17T17:56:02.212214] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-17T17:56:02.212278] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-17T17:56:02.213764] [DEBUG] [LOCAL ] CC: Trimmed 76109 records to 53789 (keeping 200 days of data) [2025-10-17T17:56:02.391394] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-17T17:56:02.544728] [DEBUG] [LOCAL ] CC: Primary data saved (53789 records). [2025-10-17T17:56:02.544867] [INFO ] [MAIN ] CC: Full history saved. [2025-10-17T17:56:02.544965] [INFO ] [MAIN ] Update Progress: 410/2368 symbols completed. CC took 40.2s. Estimated remaining: 4h 27m 19s. Rate: 7.3 symbols/min [2025-10-17T17:56:02.716213] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:02.759116] [DEBUG] [LOCAL ] CCK: Loaded 46797 existing records from primary storage. [2025-10-17T17:56:02.759458] [INFO ] [MAIN ] CCK: Loaded 46797 existing records. [2025-10-17T17:56:02.950746] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:02.950943] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-17T17:56:02.950990] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-17T17:56:02.951420] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-17T17:56:02.951466] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-17T17:56:03.168292] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-17T17:56:03.322356] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:03.352546] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T17:56:03.430687] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T17:56:03.958042] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-17T17:56:04.758004] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-17T17:56:04.798161] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T17:56:05.244484] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:56:05.557997] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-17T17:56:06.358069] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-17T17:56:06.731453] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:56:07.158105] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-17T17:56:07.401560] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:56:07.591412] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-17T17:56:07.958052] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-17T17:56:08.473812] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:56:08.758048] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-17T17:56:09.041726] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T17:56:09.558045] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-17T17:56:10.358019] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-17T17:56:10.771418] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T17:56:11.158136] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-17T17:56:11.354275] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T17:56:11.707989] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-17T17:56:11.715466] [INFO ] [REMOTE ] CCI: Full fetch complete (77102 records). [2025-10-17T17:56:11.715698] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-17T17:56:11.969181] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-17T17:56:12.163634] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-17T17:56:12.163746] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-17T17:56:12.164555] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-17T17:56:12.164602] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-17T17:56:12.166154] [DEBUG] [LOCAL ] CCI: Trimmed 77102 records to 53890 (keeping 200 days of data) [2025-10-17T17:56:12.498199] [DEBUG] [LOCAL ] CCI: Primary data saved (53890 records). [2025-10-17T17:56:12.498341] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-17T17:56:12.499082] [INFO ] [MAIN ] Update Progress: 411/2368 symbols completed. CCI took 41.8s. Estimated remaining: 4h 27m 20s. Rate: 7.3 symbols/min [2025-10-17T17:56:12.677275] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:12.732907] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-17T17:56:12.733249] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-10-17T17:56:12.764256] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-17T17:56:12.916563] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:12.917224] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-17T17:56:12.917343] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-17T17:56:12.925895] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-17T17:56:12.926251] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-17T17:56:12.926179] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T17:56:13.305712] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:13.325890] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-17T17:56:13.557995] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-17T17:56:14.358048] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-17T17:56:14.454869] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:56:15.158037] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-17T17:56:15.326993] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T17:56:15.618038] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:56:15.958038] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-17T17:56:16.758035] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-17T17:56:17.006038] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T17:56:17.527624] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-17T17:56:17.557991] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-17T17:56:18.218009] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T17:56:18.358023] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-17T17:56:18.562020] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T17:56:19.158079] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-17T17:56:19.958027] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-17T17:56:20.505019] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-17T17:56:20.758071] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-17T17:56:21.268891] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:56:21.273000] [INFO ] [REMOTE ] CCIF: Full fetch complete (21861 records). [2025-10-17T17:56:21.273279] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-17T17:56:21.561864] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-17T17:56:21.660623] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-17T17:56:21.660735] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-17T17:56:21.661286] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-17T17:56:21.661469] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-17T17:56:21.673513] [DEBUG] [LOCAL ] CCIF: Trimmed 21861 records to 15711 (keeping 200 days of data) [2025-10-17T17:56:21.694138] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-17T17:56:21.796454] [DEBUG] [LOCAL ] CCIF: Primary data saved (15711 records). [2025-10-17T17:56:21.796588] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-17T17:56:21.796687] [INFO ] [MAIN ] Update Progress: 412/2368 symbols completed. CCIF took 22.2s. Estimated remaining: 4h 27m 17s. Rate: 7.3 symbols/min [2025-10-17T17:56:21.963936] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:22.005898] [DEBUG] [LOCAL ] CCO: Loaded 48741 existing records from primary storage. [2025-10-17T17:56:22.006234] [INFO ] [MAIN ] CCO: Loaded 48741 existing records. [2025-10-17T17:56:22.178275] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:22.178476] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-17T17:56:22.178523] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-17T17:56:22.178775] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-17T17:56:22.178831] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-17T17:56:22.361235] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-17T17:56:22.536563] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:22.564227] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:56:23.158108] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-17T17:56:23.838088] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-17T17:56:23.958057] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-17T17:56:24.626079] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-17T17:56:24.763173] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-17T17:56:24.782440] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:56:25.558061] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-17T17:56:25.978285] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T17:56:26.358092] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-17T17:56:27.158103] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-17T17:56:27.244900] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:56:27.311120] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-17T17:56:27.958062] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-17T17:56:28.405591] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:56:28.663810] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-17T17:56:28.757999] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-17T17:56:29.558107] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-17T17:56:30.329100] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-17T17:56:30.357979] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-17T17:56:30.946097] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T17:56:31.158006] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-17T17:56:31.240873] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T17:56:31.958044] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-17T17:56:32.627262] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T17:56:32.726008] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T17:56:32.758001] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-17T17:56:33.535959] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T17:56:33.557999] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-17T17:56:34.358086] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-17T17:56:34.994874] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-17T17:56:35.158088] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-17T17:56:35.194137] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:56:35.958047] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-17T17:56:36.691400] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T17:56:36.758633] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-17T17:56:36.758798] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-17T17:56:36.773269] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-17T17:56:36.773529] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-17T17:56:37.185623] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-17T17:56:37.185747] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-17T17:56:37.186624] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-17T17:56:37.186713] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-17T17:56:37.188367] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 54468 (keeping 200 days of data) [2025-10-17T17:56:37.514396] [DEBUG] [LOCAL ] CCJ: Primary data saved (54468 records). [2025-10-17T17:56:37.514706] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-17T17:56:37.515591] [INFO ] [MAIN ] Update Progress: 413/2368 symbols completed. CCJ took 36.5s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-17T17:56:37.563126] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-17T17:56:37.601667] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:56:37.726545] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:37.738687] [DEBUG] [LOCAL ] CCRD: Loaded 9580 existing records from primary storage. [2025-10-17T17:56:37.738927] [INFO ] [MAIN ] CCRD: Loaded 9580 existing records. [2025-10-17T17:56:37.911519] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:37.911766] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-17T17:56:37.911821] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-17T17:56:37.912001] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-17T17:56:37.912039] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-17T17:56:38.265316] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:38.363126] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-17T17:56:38.381200] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:56:39.158043] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-17T17:56:39.958043] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-17T17:56:39.992377] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T17:56:40.116408] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-17T17:56:40.416452] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T17:56:40.758036] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-17T17:56:40.867004] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T17:56:41.558030] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-17T17:56:42.358040] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-17T17:56:42.968078] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T17:56:43.085392] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-17T17:56:43.163122] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-17T17:56:43.180306] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:56:43.875185] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T17:56:43.958028] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-17T17:56:44.758089] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-17T17:56:45.331720] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T17:56:45.558034] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-17T17:56:46.049582] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T17:56:46.358090] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-17T17:56:47.158078] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-17T17:56:47.235948] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:56:47.761839] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T17:56:47.958031] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-17T17:56:48.553226] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T17:56:48.561194] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-17T17:56:48.561384] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-17T17:56:48.763187] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-17T17:56:48.964594] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-17T17:56:48.964705] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-17T17:56:48.965691] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-17T17:56:48.965758] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-17T17:56:48.967242] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54580 (keeping 200 days of data) [2025-10-17T17:56:49.235896] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T17:56:49.346336] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-17T17:56:49.346548] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-17T17:56:49.347143] [INFO ] [MAIN ] Update Progress: 414/2368 symbols completed. CCL took 36.8s. Estimated remaining: 4h 27m 53s. Rate: 7.3 symbols/min [2025-10-17T17:56:49.512376] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:49.543631] [DEBUG] [LOCAL ] CCS: Loaded 30488 existing records from primary storage. [2025-10-17T17:56:49.543926] [INFO ] [MAIN ] CCS: Loaded 30488 existing records. [2025-10-17T17:56:49.564196] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-17T17:56:49.724285] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:49.724496] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-17T17:56:49.724546] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-17T17:56:49.724771] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-17T17:56:49.724830] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-17T17:56:50.077211] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:50.293660] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T17:56:50.358015] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-17T17:56:50.696774] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T17:56:50.703634] [INFO ] [REMOTE ] CCK: Full fetch complete (67887 records). [2025-10-17T17:56:50.703790] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-17T17:56:51.143570] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-17T17:56:51.143705] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-17T17:56:51.144665] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-17T17:56:51.144746] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-17T17:56:51.146274] [DEBUG] [LOCAL ] CCK: Trimmed 67887 records to 47154 (keeping 200 days of data) [2025-10-17T17:56:51.203589] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-17T17:56:51.391950] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:56:51.470899] [DEBUG] [LOCAL ] CCK: Primary data saved (47154 records). [2025-10-17T17:56:51.471043] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-17T17:56:51.471127] [INFO ] [MAIN ] Update Progress: 415/2368 symbols completed. CCK took 48.9s. Estimated remaining: 4h 27m 16s. Rate: 7.3 symbols/min [2025-10-17T17:56:51.657202] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:51.681407] [DEBUG] [LOCAL ] CCU: Loaded 22447 existing records from primary storage. [2025-10-17T17:56:51.681686] [INFO ] [MAIN ] CCU: Loaded 22447 existing records. [2025-10-17T17:56:51.869168] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:51.869414] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-17T17:56:51.869467] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-17T17:56:51.869744] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-17T17:56:51.869802] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-17T17:56:51.965367] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-17T17:56:52.230723] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:52.629689] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T17:56:52.758071] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-17T17:56:52.993175] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T17:56:53.558056] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-17T17:56:53.904693] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T17:56:54.358086] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-17T17:56:55.158010] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-17T17:56:55.201464] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T17:56:55.208260] [INFO ] [REMOTE ] CCO: Full fetch complete (67103 records). [2025-10-17T17:56:55.208379] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-17T17:56:55.594925] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-17T17:56:55.595062] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-17T17:56:55.595878] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-17T17:56:55.595944] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-17T17:56:55.597271] [DEBUG] [LOCAL ] CCO: Trimmed 67103 records to 49089 (keeping 200 days of data) [2025-10-17T17:56:55.825079] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:56:55.888500] [DEBUG] [LOCAL ] CCO: Primary data saved (49089 records). [2025-10-17T17:56:55.888668] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-17T17:56:55.888776] [INFO ] [MAIN ] Update Progress: 416/2368 symbols completed. CCO took 34.1s. Estimated remaining: 4h 26m 50s. Rate: 7.3 symbols/min [2025-10-17T17:56:55.963125] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-17T17:56:56.057703] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:56.057880] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-17T17:56:56.057919] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-17T17:56:56.058030] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-17T17:56:56.058071] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-17T17:56:56.058113] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-17T17:56:56.058145] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-17T17:56:56.343296] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:56:56.425194] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:56.758012] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-17T17:56:57.387731] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:56:57.558019] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-17T17:56:57.722453] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:56:58.358080] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-17T17:56:58.577868] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T17:56:59.152559] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T17:56:59.157971] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-17T17:56:59.400558] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-17T17:56:59.958020] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-17T17:57:00.758025] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-17T17:57:01.558039] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-17T17:57:01.688480] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:57:01.899043] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T17:57:02.358086] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-17T17:57:03.096842] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:57:03.158027] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-17T17:57:03.231714] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T17:57:03.958007] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-17T17:57:04.750937] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:57:04.757984] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-17T17:57:05.319862] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T17:57:05.558008] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-17T17:57:05.576996] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T17:57:05.578692] [INFO ] [REMOTE ] CCRD: Full fetch complete (11900 records). [2025-10-17T17:57:05.578763] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-17T17:57:05.928440] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-17T17:57:05.928519] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-17T17:57:05.928818] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-17T17:57:05.928880] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-17T17:57:05.929368] [DEBUG] [LOCAL ] CCRD: Trimmed 11900 records to 9647 (keeping 200 days of data) [2025-10-17T17:57:05.993261] [DEBUG] [LOCAL ] CCRD: Primary data saved (9647 records). [2025-10-17T17:57:05.993380] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-17T17:57:05.993461] [INFO ] [MAIN ] Update Progress: 417/2368 symbols completed. CCRD took 28.5s. Estimated remaining: 4h 26m 51s. Rate: 7.3 symbols/min [2025-10-17T17:57:06.163637] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:06.215751] [DEBUG] [LOCAL ] CDE: Loaded 54033 existing records from primary storage. [2025-10-17T17:57:06.216093] [INFO ] [MAIN ] CDE: Loaded 54033 existing records. [2025-10-17T17:57:06.365567] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-17T17:57:06.396624] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:06.397878] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-17T17:57:06.397986] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-17T17:57:06.398220] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-17T17:57:06.398277] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-17T17:57:06.734237] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T17:57:06.759111] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:07.129329] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:57:07.157986] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-17T17:57:07.479502] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-17T17:57:07.958026] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-17T17:57:08.243279] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-17T17:57:08.758079] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-17T17:57:09.558078] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-17T17:57:10.358018] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-17T17:57:10.639217] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T17:57:10.740988] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:57:10.741495] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-17T17:57:10.741597] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:57:10.741717] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-17T17:57:10.741791] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:57:10.741868] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-17T17:57:10.741941] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-17T17:57:10.741981] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-17T17:57:10.742022] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-17T17:57:10.742077] [INFO ] [MAIN ] Update Progress: 418/2368 symbols completed. CCZ took 14.9s. Estimated remaining: 4h 26m 26s. Rate: 7.3 symbols/min [2025-10-17T17:57:10.948936] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:10.947113] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T17:57:10.966468] [DEBUG] [LOCAL ] CDLR: Loaded 10199 existing records from primary storage. [2025-10-17T17:57:10.966726] [INFO ] [MAIN ] CDLR: Loaded 10199 existing records. [2025-10-17T17:57:11.155339] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:11.155616] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-17T17:57:11.155698] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-17T17:57:11.156005] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-17T17:57:11.156073] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-17T17:57:11.167233] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-17T17:57:11.541707] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:11.958058] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-17T17:57:12.296057] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T17:57:12.758064] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-17T17:57:13.071278] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:57:13.558021] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-17T17:57:14.358074] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-17T17:57:14.924500] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T17:57:15.046089] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:57:15.158012] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-17T17:57:15.252363] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:57:15.958087] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-17T17:57:16.758020] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-17T17:57:17.134937] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T17:57:17.365918] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:57:17.515475] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T17:57:17.557978] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-17T17:57:18.149617] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:57:18.358094] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-17T17:57:19.158062] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-17T17:57:19.673830] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T17:57:19.751437] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T17:57:19.958091] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-17T17:57:20.758047] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-17T17:57:20.902074] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T17:57:21.558098] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-17T17:57:21.665338] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:57:22.358097] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-17T17:57:22.854538] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:57:23.162783] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-17T17:57:23.163598] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:57:23.958061] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-17T17:57:24.758086] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-17T17:57:24.938084] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T17:57:25.119472] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T17:57:25.558067] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-17T17:57:25.602967] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T17:57:26.358041] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-17T17:57:27.158050] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-17T17:57:27.495494] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:57:27.848167] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:57:27.852744] [INFO ] [REMOTE ] CCS: Full fetch complete (44812 records). [2025-10-17T17:57:27.852880] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-17T17:57:27.963134] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-17T17:57:28.184418] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:57:28.276192] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-17T17:57:28.276298] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-17T17:57:28.277175] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-17T17:57:28.277246] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-17T17:57:28.278624] [DEBUG] [LOCAL ] CCS: Trimmed 44812 records to 30600 (keeping 200 days of data) [2025-10-17T17:57:28.485718] [DEBUG] [LOCAL ] CCS: Primary data saved (30600 records). [2025-10-17T17:57:28.485906] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-17T17:57:28.486427] [INFO ] [MAIN ] Update Progress: 419/2368 symbols completed. CCS took 39.1s. Estimated remaining: 4h 27m 3s. Rate: 7.3 symbols/min [2025-10-17T17:57:28.656525] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:28.697594] [DEBUG] [LOCAL ] CDP: Loaded 42851 existing records from primary storage. [2025-10-17T17:57:28.697948] [INFO ] [MAIN ] CDP: Loaded 42851 existing records. [2025-10-17T17:57:28.763311] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-17T17:57:28.882449] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:28.882694] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-17T17:57:28.882754] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-17T17:57:28.883021] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-17T17:57:28.883076] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-17T17:57:29.002058] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:57:29.053639] [INFO ] [REMOTE ] CCU: Full fetch complete (32567 records). [2025-10-17T17:57:29.078169] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-17T17:57:29.416401] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:29.563118] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-17T17:57:29.651530] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-17T17:57:29.651624] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-17T17:57:29.652344] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-17T17:57:29.652410] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-17T17:57:29.653255] [DEBUG] [LOCAL ] CCU: Trimmed 32567 records to 22640 (keeping 200 days of data) [2025-10-17T17:57:29.793203] [DEBUG] [LOCAL ] CCU: Primary data saved (22640 records). [2025-10-17T17:57:29.793352] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-17T17:57:29.793470] [INFO ] [MAIN ] Update Progress: 420/2368 symbols completed. CCU took 38.3s. Estimated remaining: 4h 26m 22s. Rate: 7.3 symbols/min [2025-10-17T17:57:29.985790] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:30.011517] [DEBUG] [LOCAL ] CDRE: Loaded 25091 existing records from primary storage. [2025-10-17T17:57:30.011836] [INFO ] [MAIN ] CDRE: Loaded 25091 existing records. [2025-10-17T17:57:30.210246] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:30.210442] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-17T17:57:30.210497] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-17T17:57:30.210909] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-17T17:57:30.210967] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-17T17:57:30.365394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-17T17:57:30.602849] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:30.636562] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T17:57:31.158046] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-17T17:57:31.275835] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T17:57:31.328244] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:57:31.958075] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-17T17:57:32.461242] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:57:32.740016] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T17:57:32.758057] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-17T17:57:33.558077] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-17T17:57:34.358020] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-17T17:57:34.650228] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T17:57:35.110198] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:57:35.157987] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-17T17:57:35.550345] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:57:35.958128] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-17T17:57:36.758125] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-17T17:57:37.142354] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T17:57:37.487986] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:57:37.560099] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-17T17:57:37.564482] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T17:57:38.358089] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-17T17:57:39.139281] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T17:57:39.158021] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-17T17:57:39.958089] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-17T17:57:40.091443] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:57:40.407056] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T17:57:40.758014] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-17T17:57:41.047852] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T17:57:41.050396] [INFO ] [REMOTE ] CDLR: Full fetch complete (13995 records). [2025-10-17T17:57:41.050468] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-17T17:57:41.398524] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-17T17:57:41.398601] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-17T17:57:41.398943] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-17T17:57:41.399004] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-17T17:57:41.399468] [DEBUG] [LOCAL ] CDLR: Trimmed 13995 records to 10294 (keeping 200 days of data) [2025-10-17T17:57:41.457020] [DEBUG] [LOCAL ] CDLR: Primary data saved (10294 records). [2025-10-17T17:57:41.457151] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-17T17:57:41.457230] [INFO ] [MAIN ] Update Progress: 421/2368 symbols completed. CDLR took 30.7s. Estimated remaining: 4h 26m 30s. Rate: 7.3 symbols/min [2025-10-17T17:57:41.563170] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-17T17:57:41.624846] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:41.672187] [DEBUG] [LOCAL ] CE: Loaded 51713 existing records from primary storage. [2025-10-17T17:57:41.672566] [INFO ] [MAIN ] CE: Loaded 51713 existing records. [2025-10-17T17:57:41.872534] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:41.872821] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-17T17:57:41.872871] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-17T17:57:41.873220] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-17T17:57:41.873278] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-17T17:57:42.213994] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:42.358038] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-17T17:57:42.978512] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T17:57:43.158047] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-17T17:57:43.384371] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:57:43.958002] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-17T17:57:44.433898] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:57:44.758047] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-17T17:57:45.210211] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T17:57:45.558459] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-17T17:57:45.559521] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-17T17:57:45.569365] [INFO ] [REMOTE ] CDE: Full fetch complete (77783 records). [2025-10-17T17:57:45.569560] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-17T17:57:45.986062] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-17T17:57:45.986198] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-17T17:57:45.987296] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-17T17:57:45.987364] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-17T17:57:45.989595] [DEBUG] [LOCAL ] CDE: Trimmed 77783 records to 54423 (keeping 200 days of data) [2025-10-17T17:57:46.328089] [DEBUG] [LOCAL ] CDE: Primary data saved (54423 records). [2025-10-17T17:57:46.328293] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-17T17:57:46.328879] [INFO ] [MAIN ] Update Progress: 422/2368 symbols completed. CDE took 40.3s. Estimated remaining: 4h 26m 6s. Rate: 7.3 symbols/min [2025-10-17T17:57:46.361631] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-17T17:57:46.518043] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:46.550335] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T17:57:46.564398] [DEBUG] [LOCAL ] CEE: Loaded 5411 existing records from primary storage. [2025-10-17T17:57:46.565615] [INFO ] [MAIN ] CEE: Loaded 5411 existing records. [2025-10-17T17:57:46.755773] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:46.756079] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-17T17:57:46.756129] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-17T17:57:46.756327] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-17T17:57:46.756384] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-17T17:57:47.143616] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:47.158011] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-17T17:57:47.217856] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T17:57:47.535514] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:57:47.958048] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-17T17:57:48.758056] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-17T17:57:48.818195] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T17:57:49.447001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:57:49.558077] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-17T17:57:49.965228] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:57:50.266519] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T17:57:50.358087] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-17T17:57:51.158007] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-17T17:57:51.513876] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T17:57:51.958040] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-17T17:57:52.545468] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:57:52.758020] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-17T17:57:52.902558] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:57:53.558080] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-17T17:57:53.863223] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:57:54.358023] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-17T17:57:55.158037] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-17T17:57:55.159541] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T17:57:55.678277] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T17:57:55.958035] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-17T17:57:56.758030] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-17T17:57:56.793161] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T17:57:57.083875] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:57:57.558098] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-17T17:57:58.204130] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:57:58.358029] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-17T17:57:58.981974] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T17:57:59.158043] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-17T17:57:59.867813] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T17:57:59.958075] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-17T17:58:00.153241] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:58:00.758077] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-17T17:58:01.558031] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-17T17:58:01.766818] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:58:01.773078] [INFO ] [REMOTE ] CDP: Full fetch complete (61989 records). [2025-10-17T17:58:01.773257] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-17T17:58:02.092317] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:58:02.182572] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-17T17:58:02.182693] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-17T17:58:02.183433] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-17T17:58:02.183482] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-17T17:58:02.184838] [DEBUG] [LOCAL ] CDP: Trimmed 61989 records to 43123 (keeping 200 days of data) [2025-10-17T17:58:02.360423] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-17T17:58:02.449310] [DEBUG] [LOCAL ] CDP: Primary data saved (43123 records). [2025-10-17T17:58:02.449445] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-17T17:58:02.450049] [INFO ] [MAIN ] Update Progress: 423/2368 symbols completed. CDP took 34.0s. Estimated remaining: 4h 26m 35s. Rate: 7.3 symbols/min [2025-10-17T17:58:02.620068] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:02.620261] [DEBUG] [LOCAL ] CEPU: No existing data file found in primary storage. [2025-10-17T17:58:02.620309] [WARN ] [MAIN ] CEPU: No existing data found, performing full refresh instead. [2025-10-17T17:58:02.620421] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-17T17:58:02.620463] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-17T17:58:02.620505] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-17T17:58:02.620538] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-17T17:58:02.967845] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:03.145093] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T17:58:03.157977] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-17T17:58:03.277808] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T17:58:03.837219] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T17:58:03.958031] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-17T17:58:04.758043] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-17T17:58:05.495516] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T17:58:05.558071] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-17T17:58:06.358066] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-17T17:58:06.446874] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T17:58:06.908066] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T17:58:07.012201] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:58:07.158043] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-17T17:58:07.741518] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T17:58:07.958071] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-17T17:58:08.665804] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:58:08.758082] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-17T17:58:09.558068] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-17T17:58:10.233754] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:58:10.237992] [INFO ] [REMOTE ] CDRE: Full fetch complete (35116 records). [2025-10-17T17:58:10.238110] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-17T17:58:10.327832] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:58:10.363120] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-17T17:58:10.640664] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-17T17:58:10.640758] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-17T17:58:10.641295] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-17T17:58:10.641339] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-17T17:58:10.642177] [DEBUG] [LOCAL ] CDRE: Trimmed 35116 records to 25250 (keeping 200 days of data) [2025-10-17T17:58:10.793168] [DEBUG] [LOCAL ] CDRE: Primary data saved (25250 records). [2025-10-17T17:58:10.793326] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-17T17:58:10.793523] [INFO ] [MAIN ] Update Progress: 424/2368 symbols completed. CDRE took 41.0s. Estimated remaining: 4h 26m 27s. Rate: 7.3 symbols/min [2025-10-17T17:58:10.958483] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:11.007562] [DEBUG] [LOCAL ] CF: Loaded 52532 existing records from primary storage. [2025-10-17T17:58:11.007920] [INFO ] [MAIN ] CF: Loaded 52532 existing records. [2025-10-17T17:58:11.159393] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-17T17:58:11.181771] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:11.182976] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-17T17:58:11.183034] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-17T17:58:11.183487] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-17T17:58:11.183601] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-17T17:58:11.554753] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:11.946719] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:58:11.948105] [INFO ] [REMOTE ] CEE: Full fetch complete (10169 records). [2025-10-17T17:58:11.948204] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-17T17:58:11.963349] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-17T17:58:12.356615] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-17T17:58:12.356827] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-17T17:58:12.357519] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-17T17:58:12.357602] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-17T17:58:12.358493] [DEBUG] [LOCAL ] CEE: Trimmed 10169 records to 5462 (keeping 200 days of data) [2025-10-17T17:58:12.424514] [DEBUG] [LOCAL ] CEE: Primary data saved (5462 records). [2025-10-17T17:58:12.428298] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-17T17:58:12.428161] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:58:12.428570] [INFO ] [MAIN ] Update Progress: 425/2368 symbols completed. CEE took 26.1s. Estimated remaining: 4h 25m 49s. Rate: 7.3 symbols/min [2025-10-17T17:58:12.679387] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:12.739201] [DEBUG] [LOCAL ] CFG: Loaded 54013 existing records from primary storage. [2025-10-17T17:58:12.739636] [INFO ] [MAIN ] CFG: Loaded 54013 existing records. [2025-10-17T17:58:12.763272] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-17T17:58:12.940927] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:12.941301] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-17T17:58:12.941365] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-17T17:58:12.941755] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-17T17:58:12.941813] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-17T17:58:13.268916] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:58:13.346879] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:13.558033] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-17T17:58:14.358085] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-17T17:58:14.609695] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T17:58:14.707674] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T17:58:15.158099] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-17T17:58:15.958056] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-17T17:58:16.132706] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T17:58:16.540608] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T17:58:16.758075] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-17T17:58:17.255172] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:58:17.558025] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-17T17:58:18.358081] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-17T17:58:18.401558] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:58:19.158036] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-17T17:58:19.425882] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:58:19.433066] [INFO ] [REMOTE ] CE: Full fetch complete (74836 records). [2025-10-17T17:58:19.433206] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-17T17:58:19.768868] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T17:58:19.852459] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-17T17:58:19.852541] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-17T17:58:19.853509] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-17T17:58:19.853577] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-17T17:58:19.855018] [DEBUG] [LOCAL ] CE: Trimmed 74836 records to 52065 (keeping 200 days of data) [2025-10-17T17:58:19.958219] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-17T17:58:20.167041] [DEBUG] [LOCAL ] CE: Primary data saved (52065 records). [2025-10-17T17:58:20.167184] [INFO ] [MAIN ] CE: Full history saved. [2025-10-17T17:58:20.167278] [INFO ] [MAIN ] Update Progress: 426/2368 symbols completed. CE took 38.7s. Estimated remaining: 4h 25m 38s. Rate: 7.3 symbols/min [2025-10-17T17:58:20.331767] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:20.331930] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-17T17:58:20.331968] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-17T17:58:20.332079] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-17T17:58:20.332138] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-17T17:58:20.332206] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-17T17:58:20.332253] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-17T17:58:20.682714] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:20.757997] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-17T17:58:20.970433] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:58:20.981199] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:58:20.981601] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-17T17:58:20.981958] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:58:20.982434] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-17T17:58:20.982932] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:58:20.983091] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-17T17:58:20.983183] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-17T17:58:20.983319] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-17T17:58:20.983397] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-17T17:58:20.995134] [INFO ] [MAIN ] Update Progress: 427/2368 symbols completed. CFND took 0.8s. Estimated remaining: 4h 24m 57s. Rate: 7.3 symbols/min [2025-10-17T17:58:20.996353] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T17:58:21.176837] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:21.212057] [DEBUG] [LOCAL ] CFR: Loaded 32885 existing records from primary storage. [2025-10-17T17:58:21.212338] [INFO ] [MAIN ] CFR: Loaded 32885 existing records. [2025-10-17T17:58:21.398786] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:21.399043] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-17T17:58:21.399092] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-17T17:58:21.399448] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-17T17:58:21.399508] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-17T17:58:21.565315] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-17T17:58:21.793325] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:22.358073] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-17T17:58:23.157998] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-17T17:58:23.220096] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:58:23.512465] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T17:58:23.958070] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-17T17:58:24.757995] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-17T17:58:25.056027] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T17:58:25.120396] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:58:25.558022] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-17T17:58:26.146693] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T17:58:26.358049] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-17T17:58:27.158005] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-17T17:58:27.321802] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T17:58:27.386134] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T17:58:27.958101] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-17T17:58:28.317282] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T17:58:28.758056] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-17T17:58:29.557995] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-17T17:58:29.761881] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T17:58:29.936998] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T17:58:30.358043] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-17T17:58:31.158077] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-17T17:58:31.292705] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T17:58:31.558323] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T17:58:31.958074] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-17T17:58:32.285563] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T17:58:32.291212] [INFO ] [REMOTE ] CEPU: Full fetch complete (39785 records). [2025-10-17T17:58:32.291411] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-17T17:58:32.719470] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-17T17:58:32.719591] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-17T17:58:32.720536] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-17T17:58:32.720606] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-17T17:58:32.722312] [DEBUG] [LOCAL ] CEPU: Trimmed 39785 records to 27225 (keeping 200 days of data) [2025-10-17T17:58:32.773725] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-17T17:58:32.895279] [DEBUG] [LOCAL ] CEPU: Primary data saved (27225 records). [2025-10-17T17:58:32.895426] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-17T17:58:32.895502] [INFO ] [MAIN ] Update Progress: 428/2368 symbols completed. CEPU took 30.4s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-17T17:58:33.075201] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:33.128217] [DEBUG] [LOCAL ] CGAU: Loaded 43931 existing records from primary storage. [2025-10-17T17:58:33.128611] [INFO ] [MAIN ] CGAU: Loaded 43931 existing records. [2025-10-17T17:58:33.307273] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:33.307961] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-17T17:58:33.308079] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-17T17:58:33.308449] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-17T17:58:33.308519] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-17T17:58:33.567593] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-17T17:58:33.707069] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:58:33.712343] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:34.358093] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-17T17:58:34.783566] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T17:58:34.982411] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:58:35.158095] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-17T17:58:35.958099] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-17T17:58:36.231888] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:58:36.758166] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-17T17:58:36.887962] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:58:37.558078] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-17T17:58:37.775639] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:58:38.100926] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:58:38.358103] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-17T17:58:39.163151] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-17T17:58:39.177363] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T17:58:39.766296] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:58:39.958033] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-17T17:58:40.758068] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-17T17:58:40.992203] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T17:58:41.558021] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-17T17:58:41.731814] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:58:41.940929] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T17:58:42.358079] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-17T17:58:42.876942] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T17:58:43.158043] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-17T17:58:43.532900] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T17:58:43.958049] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-17T17:58:44.758148] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-17T17:58:44.862944] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T17:58:44.870413] [INFO ] [REMOTE ] CF: Full fetch complete (75600 records). [2025-10-17T17:58:44.870589] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-17T17:58:45.268341] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-17T17:58:45.268451] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-17T17:58:45.269300] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-17T17:58:45.269369] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-17T17:58:45.270963] [DEBUG] [LOCAL ] CF: Trimmed 75600 records to 52902 (keeping 200 days of data) [2025-10-17T17:58:45.566242] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-17T17:58:45.590015] [DEBUG] [LOCAL ] CF: Primary data saved (52902 records). [2025-10-17T17:58:45.590154] [INFO ] [MAIN ] CF: Full history saved. [2025-10-17T17:58:45.590236] [INFO ] [MAIN ] Update Progress: 429/2368 symbols completed. CF took 34.8s. Estimated remaining: 4h 25m 17s. Rate: 7.3 symbols/min [2025-10-17T17:58:45.758836] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:45.762568] [DEBUG] [LOCAL ] CGV: Loaded 1404 existing records from primary storage. [2025-10-17T17:58:45.762842] [INFO ] [MAIN ] CGV: Loaded 1404 existing records. [2025-10-17T17:58:45.915556] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T17:58:45.989439] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:45.989898] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-17T17:58:45.990513] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-17T17:58:45.990703] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-17T17:58:45.990760] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-17T17:58:46.352662] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:46.363117] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-17T17:58:46.378764] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:58:46.925937] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T17:58:46.977253] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T17:58:47.158027] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-17T17:58:47.958067] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-17T17:58:48.677160] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:58:48.758018] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-17T17:58:49.558067] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-17T17:58:49.812747] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:58:50.031772] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T17:58:50.220079] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T17:58:50.358101] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-17T17:58:51.158111] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-17T17:58:51.919572] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:58:51.958049] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-17T17:58:52.458434] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T17:58:52.528198] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:58:52.533038] [INFO ] [REMOTE ] CFR: Full fetch complete (48518 records). [2025-10-17T17:58:52.533187] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-17T17:58:52.763291] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-17T17:58:52.946128] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-17T17:58:52.946248] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-17T17:58:52.947132] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-17T17:58:52.947206] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-17T17:58:52.948860] [DEBUG] [LOCAL ] CFR: Trimmed 48518 records to 33178 (keeping 200 days of data) [2025-10-17T17:58:53.173440] [DEBUG] [LOCAL ] CFR: Primary data saved (33178 records). [2025-10-17T17:58:53.173700] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-17T17:58:53.173834] [INFO ] [MAIN ] Update Progress: 430/2368 symbols completed. CFR took 32.2s. Estimated remaining: 4h 25m 6s. Rate: 7.3 symbols/min [2025-10-17T17:58:53.342843] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:53.369370] [DEBUG] [LOCAL ] CHCT: Loaded 24391 existing records from primary storage. [2025-10-17T17:58:53.369752] [INFO ] [MAIN ] CHCT: Loaded 24391 existing records. [2025-10-17T17:58:53.555687] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:53.555990] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-17T17:58:53.556044] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-17T17:58:53.556310] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-17T17:58:53.556352] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-17T17:58:53.568030] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-17T17:58:53.960132] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:54.353121] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:58:54.364960] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-17T17:58:54.791458] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:58:55.158008] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-17T17:58:55.353995] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T17:58:55.958075] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-17T17:58:56.424495] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T17:58:56.758048] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-17T17:58:57.558080] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-17T17:58:57.883080] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T17:58:58.077785] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T17:58:58.110863] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:58:58.358055] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-17T17:58:59.158068] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-17T17:58:59.614272] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:58:59.958068] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-17T17:59:00.758061] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-17T17:59:01.169927] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-17T17:59:01.259062] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:59:01.476992] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-17T17:59:01.484318] [INFO ] [REMOTE ] CFG: Full fetch complete (77759 records). [2025-10-17T17:59:01.484435] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-17T17:59:01.563315] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-17T17:59:01.946388] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-17T17:59:01.946501] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-17T17:59:01.947550] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-17T17:59:01.947665] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-17T17:59:01.949723] [DEBUG] [LOCAL ] CFG: Trimmed 77759 records to 54403 (keeping 200 days of data) [2025-10-17T17:59:02.308917] [DEBUG] [LOCAL ] CFG: Primary data saved (54403 records). [2025-10-17T17:59:02.309113] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-17T17:59:02.309696] [INFO ] [MAIN ] Update Progress: 431/2368 symbols completed. CFG took 49.9s. Estimated remaining: 4h 25m 2s. Rate: 7.3 symbols/min [2025-10-17T17:59:02.363244] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-17T17:59:02.493141] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:02.552857] [DEBUG] [LOCAL ] CHD: Loaded 52698 existing records from primary storage. [2025-10-17T17:59:02.553280] [INFO ] [MAIN ] CHD: Loaded 52698 existing records. [2025-10-17T17:59:02.753721] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:02.770332] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-17T17:59:02.771141] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-17T17:59:02.771731] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T17:59:02.778379] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-17T17:59:02.778543] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-17T17:59:03.169291] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-17T17:59:03.177098] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:03.616919] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T17:59:03.950169] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:59:03.960171] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-17T17:59:04.418812] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T17:59:04.758034] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-17T17:59:05.558033] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-17T17:59:05.851835] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:59:05.967541] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-17T17:59:06.358018] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-17T17:59:07.158023] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-17T17:59:07.958033] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-17T17:59:08.136452] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T17:59:08.484044] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T17:59:08.758053] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-17T17:59:09.060108] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:59:09.067605] [INFO ] [REMOTE ] CGAU: Full fetch complete (61787 records). [2025-10-17T17:59:09.067833] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-17T17:59:09.247960] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T17:59:09.299734] [INFO ] [REMOTE ] CGV: Full fetch complete (2275 records). [2025-10-17T17:59:09.344419] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-17T17:59:09.559687] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-17T17:59:09.686794] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-17T17:59:09.744930] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-17T17:59:09.756813] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-17T17:59:09.772541] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-17T17:59:09.844162] [DEBUG] [LOCAL ] CGAU: Trimmed 61787 records to 44311 (keeping 200 days of data) [2025-10-17T17:59:09.867058] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-17T17:59:09.867130] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-17T17:59:09.867202] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-17T17:59:09.867241] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-17T17:59:09.867688] [DEBUG] [LOCAL ] CGV: Trimmed 2275 records to 1418 (keeping 200 days of data) [2025-10-17T17:59:09.877502] [DEBUG] [LOCAL ] CGV: Primary data saved (1418 records). [2025-10-17T17:59:09.877602] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-17T17:59:09.877712] [INFO ] [MAIN ] Update Progress: 432/2368 symbols completed. CGV took 24.3s. Estimated remaining: 4h 24m 51s. Rate: 7.3 symbols/min [2025-10-17T17:59:10.146162] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:10.176574] [DEBUG] [LOCAL ] CHE: Loaded 15454 existing records from primary storage. [2025-10-17T17:59:10.182630] [INFO ] [MAIN ] CHE: Loaded 15454 existing records. [2025-10-17T17:59:10.368151] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-17T17:59:10.460221] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:10.464682] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-17T17:59:10.464978] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-17T17:59:10.465856] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-17T17:59:10.465928] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-17T17:59:10.661908] [DEBUG] [LOCAL ] CGAU: Primary data saved (44311 records). [2025-10-17T17:59:10.723310] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-17T17:59:10.747949] [INFO ] [MAIN ] Update Progress: 433/2368 symbols completed. CGAU took 37.9s. Estimated remaining: 4h 24m 10s. Rate: 7.3 symbols/min [2025-10-17T17:59:11.006586] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:11.050566] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:11.067166] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:59:11.112162] [DEBUG] [LOCAL ] CHGG: Loaded 48094 existing records from primary storage. [2025-10-17T17:59:11.112470] [INFO ] [MAIN ] CHGG: Loaded 48094 existing records. [2025-10-17T17:59:11.165597] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-17T17:59:11.287921] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:11.288130] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-17T17:59:11.288202] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-17T17:59:11.288962] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-17T17:59:11.289019] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-17T17:59:11.675202] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:11.831145] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:59:11.958026] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-17T17:59:12.137212] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T17:59:12.758077] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-17T17:59:13.539195] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:59:13.558003] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-17T17:59:13.919452] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T17:59:14.358040] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-17T17:59:14.423245] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T17:59:15.158071] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-17T17:59:15.958005] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-17T17:59:15.996254] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T17:59:16.393087] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:59:16.758078] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-17T17:59:17.030189] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T17:59:17.558023] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-17T17:59:18.357990] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-17T17:59:18.559335] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T17:59:18.594714] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:59:19.158067] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-17T17:59:19.958016] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-17T17:59:20.041354] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:59:20.057763] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T17:59:20.758073] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-17T17:59:21.532707] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:59:21.557978] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-17T17:59:22.358532] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-17T17:59:22.374717] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:59:22.460674] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T17:59:23.158107] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-17T17:59:23.419959] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:59:23.958098] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-17T17:59:24.008543] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T17:59:24.758044] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-17T17:59:25.558019] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-17T17:59:25.594923] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T17:59:25.630949] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T17:59:25.634847] [INFO ] [REMOTE ] CHCT: Full fetch complete (34725 records). [2025-10-17T17:59:25.634950] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-17T17:59:26.042805] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-17T17:59:26.042914] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-17T17:59:26.043800] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-17T17:59:26.043868] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-17T17:59:26.044861] [DEBUG] [LOCAL ] CHCT: Trimmed 34725 records to 24518 (keeping 200 days of data) [2025-10-17T17:59:26.198060] [DEBUG] [LOCAL ] CHCT: Primary data saved (24518 records). [2025-10-17T17:59:26.198270] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-17T17:59:26.198376] [INFO ] [MAIN ] Update Progress: 434/2368 symbols completed. CHCT took 33.0s. Estimated remaining: 4h 24m 34s. Rate: 7.3 symbols/min [2025-10-17T17:59:26.361996] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-17T17:59:26.386506] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:26.426814] [DEBUG] [LOCAL ] CHH: Loaded 32689 existing records from primary storage. [2025-10-17T17:59:26.427188] [INFO ] [MAIN ] CHH: Loaded 32689 existing records. [2025-10-17T17:59:26.627249] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:26.627577] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-17T17:59:26.627667] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-17T17:59:26.628486] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-17T17:59:26.628614] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-17T17:59:27.014620] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:27.158018] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-17T17:59:27.424699] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T17:59:27.785589] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T17:59:27.958034] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-17T17:59:28.114924] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T17:59:28.758086] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-17T17:59:29.552484] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T17:59:29.557974] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-17T17:59:29.810861] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:59:30.358074] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-17T17:59:30.517337] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:59:31.158085] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-17T17:59:31.958097] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-17T17:59:32.058007] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:59:32.508141] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T17:59:32.758105] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-17T17:59:33.558078] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-17T17:59:33.731678] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:59:34.156976] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:59:34.358133] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-17T17:59:34.996237] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T17:59:35.158058] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-17T17:59:35.522553] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:59:35.958047] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-17T17:59:36.758045] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-17T17:59:36.795674] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:59:37.390372] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:59:37.558048] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-17T17:59:38.358031] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-17T17:59:38.838779] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T17:59:38.949809] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T17:59:39.158032] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-17T17:59:39.824832] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:59:39.957992] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-17T17:59:40.758040] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-17T17:59:41.001028] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:59:41.115563] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T17:59:41.118310] [INFO ] [REMOTE ] CHE: Full fetch complete (20399 records). [2025-10-17T17:59:41.118384] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-17T17:59:41.502035] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-17T17:59:41.502135] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-17T17:59:41.502770] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-17T17:59:41.502836] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-17T17:59:41.503634] [DEBUG] [LOCAL ] CHE: Trimmed 20399 records to 15548 (keeping 200 days of data) [2025-10-17T17:59:41.576704] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-17T17:59:41.613268] [DEBUG] [LOCAL ] CHE: Primary data saved (15548 records). [2025-10-17T17:59:41.613487] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-17T17:59:41.613597] [INFO ] [MAIN ] Update Progress: 435/2368 symbols completed. CHE took 31.7s. Estimated remaining: 4h 24m 58s. Rate: 7.3 symbols/min [2025-10-17T17:59:41.786886] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:41.787167] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-17T17:59:41.787208] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-17T17:59:41.787343] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-17T17:59:41.787387] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-17T17:59:41.787463] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-17T17:59:41.787516] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-17T17:59:42.167212] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:42.358084] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-17T17:59:42.546885] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T17:59:42.554729] [INFO ] [REMOTE ] CHD: Full fetch complete (74884 records). [2025-10-17T17:59:42.554906] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-17T17:59:42.997320] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-17T17:59:42.997501] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-17T17:59:42.998908] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-17T17:59:42.999004] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-17T17:59:43.001162] [DEBUG] [LOCAL ] CHD: Trimmed 74884 records to 53066 (keeping 200 days of data) [2025-10-17T17:59:43.163338] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-17T17:59:43.221028] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:59:43.385070] [DEBUG] [LOCAL ] CHD: Primary data saved (53066 records). [2025-10-17T17:59:43.385247] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-17T17:59:43.385778] [INFO ] [MAIN ] Update Progress: 436/2368 symbols completed. CHD took 41.1s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-17T17:59:43.597203] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:43.602862] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T17:59:43.616991] [DEBUG] [LOCAL ] CHN: Loaded 5044 existing records from primary storage. [2025-10-17T17:59:43.617262] [INFO ] [MAIN ] CHN: Loaded 5044 existing records. [2025-10-17T17:59:43.806703] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:43.806976] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-17T17:59:43.807026] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-17T17:59:43.807288] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-17T17:59:43.807345] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-17T17:59:43.963340] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-17T17:59:44.198416] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:44.758132] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-17T17:59:44.997000] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T17:59:45.474386] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T17:59:45.525897] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:59:45.558042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-17T17:59:46.358022] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-17T17:59:46.631684] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:59:47.089660] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T17:59:47.158086] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-17T17:59:47.844083] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T17:59:47.958083] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-17T17:59:48.758068] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-17T17:59:49.558041] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-17T17:59:49.828604] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:59:49.894368] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:59:50.358017] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-17T17:59:50.659111] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:59:51.158035] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-17T17:59:51.363142] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T17:59:51.958052] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-17T17:59:52.327616] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T17:59:52.758027] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-17T17:59:53.558008] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-17T17:59:53.829937] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:59:53.836627] [INFO ] [REMOTE ] CHGG: Full fetch complete (70248 records). [2025-10-17T17:59:53.836776] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-17T17:59:54.238189] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-17T17:59:54.238431] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-17T17:59:54.239306] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-17T17:59:54.239382] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-17T17:59:54.258272] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:59:54.265161] [DEBUG] [LOCAL ] CHGG: Trimmed 70248 records to 48419 (keeping 200 days of data) [2025-10-17T17:59:54.359530] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-17T17:59:54.564430] [DEBUG] [LOCAL ] CHGG: Primary data saved (48419 records). [2025-10-17T17:59:54.564596] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-17T17:59:54.564714] [INFO ] [MAIN ] Update Progress: 437/2368 symbols completed. CHGG took 43.8s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-17T17:59:54.688866] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T17:59:54.946169] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T17:59:55.158001] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-17T17:59:55.958031] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-17T17:59:56.470510] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T17:59:56.470859] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:59:56.758034] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-17T17:59:57.558037] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-17T17:59:58.099436] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T17:59:58.105104] [INFO ] [REMOTE ] CHH: Full fetch complete (47528 records). [2025-10-17T17:59:58.105259] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-17T17:59:58.222790] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T17:59:58.365321] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-17T17:59:58.500842] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-17T17:59:58.500940] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-17T17:59:58.501619] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-17T17:59:58.501705] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-17T17:59:58.502889] [DEBUG] [LOCAL ] CHH: Trimmed 47528 records to 32905 (keeping 200 days of data) [2025-10-17T17:59:58.706153] [DEBUG] [LOCAL ] CHH: Primary data saved (32905 records). [2025-10-17T17:59:58.706306] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-17T17:59:58.706406] [INFO ] [MAIN ] Update Progress: 438/2368 symbols completed. CHH took 32.5s. Estimated remaining: 4h 24m 0s. Rate: 7.3 symbols/min [2025-10-17T17:59:59.018754] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:59:59.157983] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-17T17:59:59.726447] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T17:59:59.958027] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-17T18:00:00.685367] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T18:00:00.757998] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-17T18:00:01.558022] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-17T18:00:02.067413] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T18:00:02.358034] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-17T18:00:02.580897] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T18:00:03.158090] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-17T18:00:03.871284] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:00:03.958079] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-17T18:00:04.445329] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:00:04.446705] [INFO ] [REMOTE ] CHN: Full fetch complete (7543 records). [2025-10-17T18:00:04.446777] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-17T18:00:04.817011] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-17T18:00:04.817176] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-17T18:00:04.817399] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-17T18:00:04.817475] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-17T18:00:04.817913] [DEBUG] [LOCAL ] CHN: Trimmed 7543 records to 5065 (keeping 200 days of data) [2025-10-17T18:00:04.847944] [DEBUG] [LOCAL ] CHN: Primary data saved (5065 records). [2025-10-17T18:00:04.848066] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-17T18:00:04.848151] [INFO ] [MAIN ] Update Progress: 439/2368 symbols completed. CHN took 21.5s. Estimated remaining: 4h 23m 43s. Rate: 7.3 symbols/min [2025-10-17T18:00:05.286737] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T18:00:05.293582] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-17T18:00:06.548084] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:00:06.555181] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-17T18:00:07.718856] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T18:00:07.724270] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-17T18:00:09.191688] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T18:00:09.195023] [INFO ] [REMOTE ] CHMI: Full fetch complete (31705 records). [2025-10-17T18:00:09.195115] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-17T18:00:09.581139] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-17T18:00:09.581219] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-17T18:00:09.581774] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-17T18:00:09.581838] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-17T18:00:09.582692] [DEBUG] [LOCAL ] CHMI: Trimmed 31705 records to 21855 (keeping 200 days of data) [2025-10-17T18:00:09.707166] [DEBUG] [LOCAL ] CHMI: Primary data saved (21855 records). [2025-10-17T18:00:09.707299] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-17T18:00:09.707370] [INFO ] [MAIN ] Update Progress: 440/2368 symbols completed. CHMI took 28.1s. Estimated remaining: 4h 23m 20s. Rate: 7.3 symbols/min [2025-10-17T18:00:10.382607] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.339442] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.414930] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.415431] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-17T18:00:10.418287] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-17T18:00:10.418956] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-17T18:00:10.419013] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-17T18:00:10.439332] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-17T18:00:10.443472] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.443866] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-17T18:00:10.586861] [DEBUG] [LOCAL ] CHT: Loaded 19654 existing records from primary storage. [2025-10-17T18:00:10.620743] [INFO ] [MAIN ] CHT: Loaded 19654 existing records. [2025-10-17T18:00:10.899696] [DEBUG] [LOCAL ] CHWY: Loaded 54045 existing records from primary storage. [2025-10-17T18:00:10.963378] [INFO ] [MAIN ] CHWY: Loaded 54045 existing records. [2025-10-17T18:00:10.994905] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:11.000680] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-17T18:00:11.067820] [DEBUG] [LOCAL ] CI: Loaded 50066 existing records from primary storage. [2025-10-17T18:00:11.097331] [INFO ] [MAIN ] CI: Loaded 50066 existing records. [2025-10-17T18:00:11.312253] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:11.371117] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-17T18:00:11.376485] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-17T18:00:11.419209] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-17T18:00:11.430497] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-17T18:00:11.425194] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:11.459171] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-17T18:00:11.504225] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-17T18:00:11.533792] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:11.569734] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-17T18:00:11.569992] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-17T18:00:11.569801] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-17T18:00:11.581008] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-17T18:00:11.597170] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-17T18:00:11.604610] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-17T18:00:12.534623] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:12.573834] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-17T18:00:12.608533] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:12.619024] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-17T18:00:12.709150] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:12.710206] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-17T18:00:13.838960] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:00:13.843075] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-17T18:00:14.842507] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (3.84 seconds). [2025-10-17T18:00:14.856087] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-17T18:00:14.906610] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T18:00:14.918063] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-17T18:00:14.929900] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:00:14.934706] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-17T18:00:15.090395] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-17T18:00:15.107758] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-17T18:00:15.764453] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T18:00:15.770889] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-17T18:00:16.767817] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T18:00:16.779233] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-17T18:00:16.884060] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:00:16.894890] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-17T18:00:16.930108] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:00:16.935468] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-17T18:00:17.149035] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T18:00:17.558023] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-17T18:00:18.495308] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:00:18.500820] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-17T18:00:18.702554] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T18:00:18.898417] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-17T18:00:19.158076] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-17T18:00:19.457636] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T18:00:19.845272] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-17T18:00:19.958036] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-17T18:00:20.758011] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-17T18:00:21.089174] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:00:21.558048] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-17T18:00:22.204822] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T18:00:22.358001] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-17T18:00:22.461701] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T18:00:22.797689] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T18:00:23.158066] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-17T18:00:23.842414] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T18:00:23.958062] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-17T18:00:24.758107] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-17T18:00:25.162210] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T18:00:25.558125] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-17T18:00:25.813739] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:00:25.892821] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:00:26.358036] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-17T18:00:27.158088] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-17T18:00:27.203638] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:00:27.958046] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-17T18:00:28.644359] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-17T18:00:28.758083] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-17T18:00:29.022099] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:00:29.550861] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-17T18:00:29.561094] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-17T18:00:30.358259] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-17T18:00:30.665188] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:00:30.862094] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T18:00:31.158043] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-17T18:00:31.958052] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-17T18:00:32.367128] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T18:00:32.758094] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-17T18:00:33.163012] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T18:00:33.166081] [INFO ] [REMOTE ] CHT: Full fetch complete (27646 records). [2025-10-17T18:00:33.166224] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-17T18:00:33.558467] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-17T18:00:33.569597] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-17T18:00:33.569711] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-17T18:00:33.570213] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-17T18:00:33.570366] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-17T18:00:33.604024] [DEBUG] [LOCAL ] CHT: Trimmed 27646 records to 19756 (keeping 200 days of data) [2025-10-17T18:00:33.606533] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T18:00:33.733469] [DEBUG] [LOCAL ] CHT: Primary data saved (19756 records). [2025-10-17T18:00:33.733630] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-17T18:00:33.733755] [INFO ] [MAIN ] Update Progress: 441/2368 symbols completed. CHT took 24.0s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-17T18:00:33.921965] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:33.941511] [DEBUG] [LOCAL ] CIA: Loaded 16720 existing records from primary storage. [2025-10-17T18:00:33.941786] [INFO ] [MAIN ] CIA: Loaded 16720 existing records. [2025-10-17T18:00:34.136927] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:34.137986] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-17T18:00:34.138178] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-17T18:00:34.138483] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-17T18:00:34.138596] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-17T18:00:34.362353] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-17T18:00:34.511576] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:34.541382] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T18:00:35.158054] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-17T18:00:35.365735] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T18:00:35.958003] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-17T18:00:36.185965] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T18:00:36.303163] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:00:36.758112] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-17T18:00:37.558046] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-17T18:00:37.934797] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T18:00:38.114960] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:00:38.358087] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-17T18:00:39.158037] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-17T18:00:39.236255] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:00:39.958087] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-17T18:00:40.079782] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T18:00:40.511752] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-17T18:00:40.758043] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-17T18:00:41.558047] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-17T18:00:41.766215] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T18:00:41.859190] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T18:00:41.865069] [INFO ] [REMOTE ] CHPT: Full fetch complete (71556 records). [2025-10-17T18:00:41.865222] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-17T18:00:42.243286] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-17T18:00:42.243374] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-17T18:00:42.244314] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-17T18:00:42.244378] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-17T18:00:42.245764] [DEBUG] [LOCAL ] CHPT: Trimmed 71556 records to 48210 (keeping 200 days of data) [2025-10-17T18:00:42.361104] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-17T18:00:42.524987] [DEBUG] [LOCAL ] CHPT: Primary data saved (48210 records). [2025-10-17T18:00:42.525125] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-17T18:00:42.525213] [INFO ] [MAIN ] Update Progress: 442/2368 symbols completed. CHPT took 32.8s. Estimated remaining: 4h 24m 15s. Rate: 7.3 symbols/min [2025-10-17T18:00:42.692438] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:42.720322] [DEBUG] [LOCAL ] CIB: Loaded 30684 existing records from primary storage. [2025-10-17T18:00:42.720608] [INFO ] [MAIN ] CIB: Loaded 30684 existing records. [2025-10-17T18:00:42.896155] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:42.896395] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-17T18:00:42.896442] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-17T18:00:42.896988] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-17T18:00:42.897046] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-17T18:00:43.167514] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-17T18:00:43.258925] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:43.407204] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:00:43.686465] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T18:00:43.694119] [INFO ] [REMOTE ] CHWY: Full fetch complete (77780 records). [2025-10-17T18:00:43.694265] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-17T18:00:43.963601] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-17T18:00:44.102313] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-17T18:00:44.102409] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-17T18:00:44.103386] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-17T18:00:44.103455] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-17T18:00:44.105038] [DEBUG] [LOCAL ] CHWY: Trimmed 77780 records to 54435 (keeping 200 days of data) [2025-10-17T18:00:44.425474] [DEBUG] [LOCAL ] CHWY: Primary data saved (54435 records). [2025-10-17T18:00:44.425611] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-17T18:00:44.425718] [INFO ] [MAIN ] Update Progress: 443/2368 symbols completed. CHWY took 34.7s. Estimated remaining: 4h 23m 39s. Rate: 7.3 symbols/min [2025-10-17T18:00:44.596421] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:44.596632] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-17T18:00:44.596711] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-17T18:00:44.596837] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-17T18:00:44.596881] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-17T18:00:44.596924] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-17T18:00:44.596958] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-17T18:00:44.763694] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-17T18:00:44.973037] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:45.005852] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:00:45.231253] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:00:45.558001] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-17T18:00:45.889451] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T18:00:46.358032] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-17T18:00:47.158049] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-17T18:00:47.279248] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T18:00:47.381577] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T18:00:47.958062] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-17T18:00:48.383525] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T18:00:48.720830] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T18:00:48.757988] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-17T18:00:49.558011] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-17T18:00:50.103220] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T18:00:50.358041] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-17T18:00:50.611082] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T18:00:50.807774] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-17T18:00:51.158040] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-17T18:00:51.958051] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-17T18:00:52.758006] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-17T18:00:52.909390] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T18:00:52.965233] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:00:52.971824] [INFO ] [REMOTE ] CI: Full fetch complete (72106 records). [2025-10-17T18:00:52.971943] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-17T18:00:53.247939] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:00:53.366402] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-17T18:00:53.366538] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-17T18:00:53.367426] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-17T18:00:53.367491] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-17T18:00:53.369079] [DEBUG] [LOCAL ] CI: Trimmed 72106 records to 50399 (keeping 200 days of data) [2025-10-17T18:00:53.582755] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-17T18:00:53.685567] [DEBUG] [LOCAL ] CI: Primary data saved (50399 records). [2025-10-17T18:00:53.685791] [INFO ] [MAIN ] CI: Full history saved. [2025-10-17T18:00:53.685907] [INFO ] [MAIN ] Update Progress: 444/2368 symbols completed. CI took 43.9s. Estimated remaining: 4h 23m 36s. Rate: 7.3 symbols/min [2025-10-17T18:00:53.856776] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:53.906295] [DEBUG] [LOCAL ] CIEN: Loaded 52535 existing records from primary storage. [2025-10-17T18:00:53.906636] [INFO ] [MAIN ] CIEN: Loaded 52535 existing records. [2025-10-17T18:00:54.088212] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:54.082354] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T18:00:54.088466] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-17T18:00:54.089599] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-17T18:00:54.089934] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-17T18:00:54.089988] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-17T18:00:54.363197] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-17T18:00:54.444086] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:55.158032] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-17T18:00:55.918957] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T18:00:55.958033] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-17T18:00:56.135745] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T18:00:56.758023] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-17T18:00:57.409478] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T18:00:57.558040] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-17T18:00:58.357993] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-17T18:00:58.626609] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:00:58.628736] [INFO ] [REMOTE ] CIA: Full fetch complete (23374 records). [2025-10-17T18:00:58.628808] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-17T18:00:58.987669] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-17T18:00:59.031903] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-17T18:00:59.031974] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-17T18:00:59.032399] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-17T18:00:59.032438] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-17T18:00:59.033064] [DEBUG] [LOCAL ] CIA: Trimmed 23374 records to 16820 (keeping 200 days of data) [2025-10-17T18:00:59.122458] [DEBUG] [LOCAL ] CIA: Primary data saved (16820 records). [2025-10-17T18:00:59.122600] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-17T18:00:59.122704] [INFO ] [MAIN ] Update Progress: 445/2368 symbols completed. CIA took 25.4s. Estimated remaining: 4h 23m 15s. Rate: 7.3 symbols/min [2025-10-17T18:00:59.165288] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-17T18:00:59.294116] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:59.299917] [DEBUG] [LOCAL ] CIF: Loaded 4057 existing records from primary storage. [2025-10-17T18:00:59.300112] [INFO ] [MAIN ] CIF: Loaded 4057 existing records. [2025-10-17T18:00:59.479839] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:59.480177] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-17T18:00:59.480264] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-17T18:00:59.480577] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-17T18:00:59.480788] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-17T18:00:59.617874] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T18:00:59.860705] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:59.958051] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-17T18:01:00.758040] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-17T18:01:01.393427] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T18:01:01.407570] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T18:01:01.450748] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:01:01.558045] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-17T18:01:02.358040] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-17T18:01:02.532753] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:01:03.158057] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-17T18:01:03.510923] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T18:01:03.580227] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T18:01:03.958082] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-17T18:01:04.758022] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-17T18:01:04.825983] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:01:05.174921] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:01:05.558029] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-17T18:01:06.358013] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-17T18:01:06.798278] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T18:01:07.159309] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:01:07.158389] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-17T18:01:07.878045] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T18:01:07.958138] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-17T18:01:08.758099] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-17T18:01:09.107283] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T18:01:09.359716] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:01:09.558062] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-17T18:01:09.930577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-17T18:01:10.358065] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-17T18:01:10.799595] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T18:01:10.800367] [INFO ] [REMOTE ] CICB: Full fetch complete (1982 records). [2025-10-17T18:01:10.800437] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-17T18:01:10.985945] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T18:01:10.986148] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:01:10.986227] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:01:10.986280] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-17T18:01:10.986339] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-17T18:01:10.986419] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-17T18:01:10.986472] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-17T18:01:10.986530] [INFO ] [MAIN ] Update Progress: 446/2368 symbols completed. CICB took 26.6s. Estimated remaining: 4h 23m 23s. Rate: 7.3 symbols/min [2025-10-17T18:01:11.161249] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-17T18:01:11.161146] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:11.161896] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-17T18:01:11.162613] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-17T18:01:11.162767] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-17T18:01:11.162810] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-17T18:01:11.162854] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-17T18:01:11.162889] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-17T18:01:11.525856] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:11.958031] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-17T18:01:12.590380] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:01:12.758019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-17T18:01:13.558023] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-17T18:01:13.849810] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T18:01:14.358055] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-17T18:01:14.427533] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:01:15.011474] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:01:15.016000] [INFO ] [REMOTE ] CIB: Full fetch complete (45236 records). [2025-10-17T18:01:15.016109] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-17T18:01:15.168563] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-17T18:01:15.410671] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-17T18:01:15.410790] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-17T18:01:15.411463] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-17T18:01:15.411546] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-17T18:01:15.412680] [DEBUG] [LOCAL ] CIB: Trimmed 45236 records to 30952 (keeping 200 days of data) [2025-10-17T18:01:15.601617] [DEBUG] [LOCAL ] CIB: Primary data saved (30952 records). [2025-10-17T18:01:15.601804] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-17T18:01:15.602370] [INFO ] [MAIN ] Update Progress: 447/2368 symbols completed. CIB took 33.1s. Estimated remaining: 4h 22m 59s. Rate: 7.3 symbols/min [2025-10-17T18:01:15.784304] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:15.801126] [DEBUG] [LOCAL ] CII: Loaded 15443 existing records from primary storage. [2025-10-17T18:01:15.801447] [INFO ] [MAIN ] CII: Loaded 15443 existing records. [2025-10-17T18:01:15.972405] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-17T18:01:15.979932] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:15.981203] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-17T18:01:15.981289] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-17T18:01:15.981718] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-17T18:01:15.981797] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-17T18:01:16.274745] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T18:01:16.354455] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:16.384155] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T18:01:16.758006] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-17T18:01:17.443440] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T18:01:17.558060] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-17T18:01:17.559264] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:01:18.358028] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-17T18:01:18.986600] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T18:01:19.158012] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-17T18:01:19.235632] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:01:19.958007] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-17T18:01:20.283493] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T18:01:20.758044] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-17T18:01:21.384700] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T18:01:21.558008] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-17T18:01:21.742565] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T18:01:22.060306] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T18:01:22.358041] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-17T18:01:23.158046] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-17T18:01:23.294262] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T18:01:23.958010] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-17T18:01:24.696438] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:01:24.757996] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-17T18:01:24.922955] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T18:01:25.558030] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-17T18:01:26.356085] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:01:26.364587] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-17T18:01:26.630801] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:01:27.158078] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-17T18:01:27.905226] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:01:27.958039] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-17T18:01:28.326522] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T18:01:28.757994] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-17T18:01:29.165975] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T18:01:29.558049] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-17T18:01:30.278482] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T18:01:30.323863] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T18:01:30.358018] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-17T18:01:30.952778] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:01:31.158027] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-17T18:01:31.958051] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-17T18:01:32.758017] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-17T18:01:32.938903] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:01:33.497828] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T18:01:33.558030] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-17T18:01:33.667781] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T18:01:34.358142] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-17T18:01:35.158019] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-17T18:01:35.310296] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T18:01:35.505803] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:01:35.781733] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-17T18:01:35.958030] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-17T18:01:36.758019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-17T18:01:36.771637] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T18:01:36.772604] [INFO ] [REMOTE ] CIF: Full fetch complete (6572 records). [2025-10-17T18:01:36.772705] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-17T18:01:37.124822] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-17T18:01:37.124903] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-17T18:01:37.125080] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-17T18:01:37.125122] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-17T18:01:37.125538] [DEBUG] [LOCAL ] CIF: Trimmed 6572 records to 4087 (keeping 200 days of data) [2025-10-17T18:01:37.149063] [DEBUG] [LOCAL ] CIF: Primary data saved (4087 records). [2025-10-17T18:01:37.149187] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-17T18:01:37.149271] [INFO ] [MAIN ] Update Progress: 448/2368 symbols completed. CIF took 38.0s. Estimated remaining: 4h 23m 48s. Rate: 7.3 symbols/min [2025-10-17T18:01:37.316538] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:37.354008] [DEBUG] [LOCAL ] CIM: Loaded 37990 existing records from primary storage. [2025-10-17T18:01:37.354295] [INFO ] [MAIN ] CIM: Loaded 37990 existing records. [2025-10-17T18:01:37.526476] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:37.526715] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-17T18:01:37.526774] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-17T18:01:37.530528] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-17T18:01:37.531034] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-17T18:01:37.563134] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-17T18:01:37.879060] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:38.358037] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-17T18:01:38.459078] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T18:01:38.521310] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:01:39.158040] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-17T18:01:39.958043] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-17T18:01:40.563834] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T18:01:40.571908] [INFO ] [REMOTE ] CIEN: Full fetch complete (75830 records). [2025-10-17T18:01:40.572043] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-17T18:01:40.803522] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-17T18:01:40.894423] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:01:41.060759] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-17T18:01:41.060873] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-17T18:01:41.061787] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-17T18:01:41.061863] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-17T18:01:41.063613] [DEBUG] [LOCAL ] CIEN: Trimmed 75830 records to 52910 (keeping 200 days of data) [2025-10-17T18:01:41.182165] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:01:41.403660] [DEBUG] [LOCAL ] CIEN: Primary data saved (52910 records). [2025-10-17T18:01:41.403808] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-17T18:01:41.403887] [INFO ] [MAIN ] Update Progress: 449/2368 symbols completed. CIEN took 47.7s. Estimated remaining: 4h 23m 23s. Rate: 7.3 symbols/min [2025-10-17T18:01:41.570931] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-17T18:01:41.574380] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:41.579375] [DEBUG] [LOCAL ] CIMN: Loaded 2780 existing records from primary storage. [2025-10-17T18:01:41.579727] [INFO ] [MAIN ] CIMN: Loaded 2780 existing records. [2025-10-17T18:01:41.762137] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:41.762374] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-17T18:01:41.762427] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-17T18:01:41.762634] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-17T18:01:41.762730] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-17T18:01:42.090189] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:01:42.155597] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:42.357994] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-17T18:01:42.995478] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:01:43.157993] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-17T18:01:43.257564] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:01:43.647975] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:01:43.958071] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-17T18:01:44.470594] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T18:01:44.758036] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-17T18:01:45.558072] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-17T18:01:46.358042] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-17T18:01:46.386008] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T18:01:46.614519] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T18:01:46.618740] [INFO ] [REMOTE ] CII: Full fetch complete (22903 records). [2025-10-17T18:01:46.618863] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-17T18:01:46.923041] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T18:01:47.011022] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-17T18:01:47.011101] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-17T18:01:47.011566] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-17T18:01:47.011612] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-17T18:01:47.012277] [DEBUG] [LOCAL ] CII: Trimmed 22903 records to 15546 (keeping 200 days of data) [2025-10-17T18:01:47.107153] [DEBUG] [LOCAL ] CII: Primary data saved (15546 records). [2025-10-17T18:01:47.107293] [INFO ] [MAIN ] CII: Full history saved. [2025-10-17T18:01:47.107373] [INFO ] [MAIN ] Update Progress: 450/2368 symbols completed. CII took 31.5s. Estimated remaining: 4h 23m 4s. Rate: 7.3 symbols/min [2025-10-17T18:01:47.163151] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-17T18:01:47.289158] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:47.289330] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-17T18:01:47.289370] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-17T18:01:47.289489] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-17T18:01:47.289532] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-17T18:01:47.289576] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-17T18:01:47.289618] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-17T18:01:47.659228] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:47.958043] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-17T18:01:48.718321] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T18:01:48.758005] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-17T18:01:48.831160] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:01:49.320999] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T18:01:49.558034] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-17T18:01:50.109092] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T18:01:50.358045] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-17T18:01:51.158044] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-17T18:01:51.601686] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T18:01:51.958068] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-17T18:01:52.495608] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T18:01:52.758027] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-17T18:01:52.820186] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-17T18:01:52.826917] [INFO ] [REMOTE ] CIG: Full fetch complete (62316 records). [2025-10-17T18:01:52.827040] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-17T18:01:53.215922] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-17T18:01:53.216003] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-17T18:01:53.216801] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-17T18:01:53.216866] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-17T18:01:53.218144] [DEBUG] [LOCAL ] CIG: Trimmed 62316 records to 45005 (keeping 200 days of data) [2025-10-17T18:01:53.323824] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T18:01:53.496896] [DEBUG] [LOCAL ] CIG: Primary data saved (45005 records). [2025-10-17T18:01:53.497173] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-17T18:01:53.497283] [INFO ] [MAIN ] Update Progress: 451/2368 symbols completed. CIG took 42.5s. Estimated remaining: 4h 22m 48s. Rate: 7.3 symbols/min [2025-10-17T18:01:53.563106] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-17T18:01:53.678675] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:53.678823] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-17T18:01:53.678860] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-17T18:01:53.679011] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-17T18:01:53.679052] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-17T18:01:53.679093] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-17T18:01:53.679126] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-17T18:01:54.027951] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:54.358284] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-17T18:01:54.562738] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:01:54.563093] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-17T18:01:54.563199] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:01:54.563289] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-17T18:01:54.563369] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:01:54.563459] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-17T18:01:54.563541] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-17T18:01:54.563584] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-17T18:01:54.563628] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-17T18:01:54.563720] [INFO ] [MAIN ] Update Progress: 452/2368 symbols completed. CIMP took 1.1s. Estimated remaining: 4h 22m 9s. Rate: 7.3 symbols/min [2025-10-17T18:01:54.739784] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:54.757961] [DEBUG] [LOCAL ] CINT: Loaded 20157 existing records from primary storage. [2025-10-17T18:01:54.758222] [INFO ] [MAIN ] CINT: Loaded 20157 existing records. [2025-10-17T18:01:54.937092] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:54.937406] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-17T18:01:54.937508] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-17T18:01:54.938024] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-17T18:01:54.938087] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-17T18:01:55.160302] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-17T18:01:55.304571] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T18:01:55.325967] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:55.756213] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T18:01:55.958053] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-17T18:01:56.416898] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T18:01:56.758055] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-17T18:01:57.508178] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T18:01:57.557988] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-17T18:01:57.983703] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T18:01:58.358037] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-17T18:01:58.802267] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T18:01:59.158055] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-17T18:01:59.608512] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:01:59.958038] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-17T18:02:00.409486] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:02:00.758046] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-17T18:02:01.558060] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-17T18:02:02.091821] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T18:02:02.358092] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-17T18:02:02.628940] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:02:02.920846] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T18:02:03.158084] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-17T18:02:03.958058] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-17T18:02:04.164688] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T18:02:04.338869] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-17T18:02:04.758059] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-17T18:02:05.558031] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-17T18:02:06.172442] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T18:02:06.173507] [INFO ] [REMOTE ] CIMO: Full fetch complete (4801 records). [2025-10-17T18:02:06.173578] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-17T18:02:06.365818] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-17T18:02:06.373396] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:02:06.374372] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:02:06.374463] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:02:06.374563] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-17T18:02:06.374637] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-17T18:02:06.374737] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-17T18:02:06.374805] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-17T18:02:06.374872] [INFO ] [MAIN ] Update Progress: 453/2368 symbols completed. CIMO took 19.3s. Estimated remaining: 4h 22m 16s. Rate: 7.3 symbols/min [2025-10-17T18:02:06.560199] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:06.560518] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-10-17T18:02:06.560690] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-10-17T18:02:06.560980] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-17T18:02:06.561066] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-17T18:02:06.561162] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-17T18:02:06.561363] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-17T18:02:06.845736] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T18:02:07.005997] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:07.017160] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T18:02:07.158043] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-17T18:02:07.958088] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-17T18:02:08.704041] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:02:08.758063] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-17T18:02:09.021822] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:02:09.558030] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-17T18:02:10.191796] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:02:10.358088] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-17T18:02:11.158008] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-17T18:02:11.215753] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:02:11.559410] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T18:02:11.958070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-17T18:02:12.758108] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-17T18:02:13.019040] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:02:13.348168] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T18:02:13.558043] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-17T18:02:13.749471] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T18:02:14.194082] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T18:02:14.358034] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-17T18:02:15.066774] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T18:02:15.067922] [INFO ] [REMOTE ] CIMN: Full fetch complete (3926 records). [2025-10-17T18:02:15.068015] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-17T18:02:15.068412] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:02:15.068501] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:02:15.068544] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:02:15.068609] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-17T18:02:15.068714] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-17T18:02:15.068765] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-17T18:02:15.068960] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-17T18:02:15.069059] [INFO ] [MAIN ] Update Progress: 454/2368 symbols completed. CIMN took 33.7s. Estimated remaining: 4h 22m 10s. Rate: 7.3 symbols/min [2025-10-17T18:02:15.163158] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-17T18:02:15.264403] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:15.264627] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-17T18:02:15.264711] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-17T18:02:15.264869] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-17T18:02:15.264932] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-17T18:02:15.265043] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-17T18:02:15.265099] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-17T18:02:15.633136] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:15.958068] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-17T18:02:16.487264] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T18:02:16.758042] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-17T18:02:17.377076] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:02:17.558021] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-17T18:02:18.364036] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-17T18:02:18.378195] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:02:19.158000] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-17T18:02:19.530955] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:02:19.885165] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:02:19.958008] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-17T18:02:20.724334] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T18:02:20.758108] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-17T18:02:21.076462] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:02:21.558059] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-17T18:02:21.854000] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T18:02:22.358033] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-17T18:02:23.141785] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T18:02:23.148406] [INFO ] [REMOTE ] CIM: Full fetch complete (54965 records). [2025-10-17T18:02:23.148591] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-17T18:02:23.164187] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-17T18:02:23.326969] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T18:02:23.591768] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-17T18:02:23.591896] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-17T18:02:23.592829] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-17T18:02:23.592909] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-17T18:02:23.594528] [DEBUG] [LOCAL ] CIM: Trimmed 54965 records to 38246 (keeping 200 days of data) [2025-10-17T18:02:23.908707] [DEBUG] [LOCAL ] CIM: Primary data saved (38246 records). [2025-10-17T18:02:23.909181] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-17T18:02:23.909301] [INFO ] [MAIN ] Update Progress: 455/2368 symbols completed. CIM took 46.8s. Estimated remaining: 4h 22m 4s. Rate: 7.3 symbols/min [2025-10-17T18:02:23.966636] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-17T18:02:24.107867] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:24.157666] [DEBUG] [LOCAL ] CIVI: Loaded 53088 existing records from primary storage. [2025-10-17T18:02:24.158050] [INFO ] [MAIN ] CIVI: Loaded 53088 existing records. [2025-10-17T18:02:24.313530] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:02:24.400662] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:24.400890] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-17T18:02:24.400938] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-17T18:02:24.402185] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-17T18:02:24.402245] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-17T18:02:24.781586] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-17T18:02:24.787888] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:25.206719] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T18:02:25.558011] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-17T18:02:25.576589] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:02:26.358035] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-17T18:02:26.692068] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:02:27.158062] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-17T18:02:27.958042] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-17T18:02:28.254730] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T18:02:28.312827] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T18:02:28.758083] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-17T18:02:29.099564] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:02:29.558062] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-17T18:02:29.854922] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:02:30.358006] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-17T18:02:30.605192] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T18:02:31.158056] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-17T18:02:31.647560] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:02:31.652200] [INFO ] [REMOTE ] CIO: Full fetch complete (29707 records). [2025-10-17T18:02:31.652345] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-17T18:02:31.963214] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-17T18:02:32.031126] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-17T18:02:32.031220] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-17T18:02:32.031762] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-17T18:02:32.031825] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-17T18:02:32.032535] [DEBUG] [LOCAL ] CIO: Trimmed 29707 records to 21338 (keeping 200 days of data) [2025-10-17T18:02:32.148510] [DEBUG] [LOCAL ] CIO: Primary data saved (21338 records). [2025-10-17T18:02:32.148669] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-17T18:02:32.148763] [INFO ] [MAIN ] Update Progress: 456/2368 symbols completed. CIO took 25.8s. Estimated remaining: 4h 21m 56s. Rate: 7.3 symbols/min [2025-10-17T18:02:32.319388] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:32.368450] [DEBUG] [LOCAL ] CL: Loaded 54039 existing records from primary storage. [2025-10-17T18:02:32.368826] [INFO ] [MAIN ] CL: Loaded 54039 existing records. [2025-10-17T18:02:32.557454] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:32.557742] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-17T18:02:32.557802] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-17T18:02:32.558607] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-17T18:02:32.558703] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-17T18:02:32.763157] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-17T18:02:32.883486] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T18:02:32.974698] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:33.557991] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-17T18:02:33.855664] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T18:02:33.922206] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T18:02:34.358071] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-17T18:02:34.396385] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T18:02:35.158057] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-17T18:02:35.958042] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-17T18:02:36.758081] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-17T18:02:36.789265] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-17T18:02:37.558039] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-17T18:02:37.792479] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-17T18:02:38.184560] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-17T18:02:38.358035] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-17T18:02:38.980013] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T18:02:38.984787] [INFO ] [REMOTE ] CINT: Full fetch complete (28211 records). [2025-10-17T18:02:38.984915] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-17T18:02:39.163170] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-17T18:02:39.371912] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-17T18:02:39.372022] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-17T18:02:39.372508] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-17T18:02:39.372584] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-17T18:02:39.373553] [DEBUG] [LOCAL ] CINT: Trimmed 28211 records to 20304 (keeping 200 days of data) [2025-10-17T18:02:39.495558] [DEBUG] [LOCAL ] CINT: Primary data saved (20304 records). [2025-10-17T18:02:39.495778] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-17T18:02:39.496080] [INFO ] [MAIN ] Update Progress: 457/2368 symbols completed. CINT took 44.9s. Estimated remaining: 4h 21m 44s. Rate: 7.3 symbols/min [2025-10-17T18:02:39.657659] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T18:02:39.714551] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:39.747935] [DEBUG] [LOCAL ] CLB: Loaded 33709 existing records from primary storage. [2025-10-17T18:02:39.748207] [INFO ] [MAIN ] CLB: Loaded 33709 existing records. [2025-10-17T18:02:39.925607] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:39.926125] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-17T18:02:39.926272] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-17T18:02:39.926879] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-17T18:02:39.926952] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-17T18:02:39.969435] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-17T18:02:40.286327] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T18:02:40.372916] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:40.405620] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T18:02:40.758092] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-17T18:02:41.558009] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-17T18:02:41.855051] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T18:02:42.028831] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T18:02:42.358052] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-17T18:02:43.165262] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-17T18:02:43.187401] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:02:43.958020] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-17T18:02:44.186822] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T18:02:44.431957] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:02:44.758026] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-17T18:02:44.955263] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T18:02:45.558016] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-17T18:02:46.046146] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T18:02:46.358010] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-17T18:02:47.158005] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-17T18:02:47.338704] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T18:02:47.958044] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-17T18:02:48.208211] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T18:02:48.462698] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:02:48.466938] [INFO ] [REMOTE ] CION: Full fetch complete (40666 records). [2025-10-17T18:02:48.467068] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-17T18:02:48.760914] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-17T18:02:48.848683] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-17T18:02:48.848769] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-17T18:02:48.849345] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-17T18:02:48.849398] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-17T18:02:48.850301] [DEBUG] [LOCAL ] CION: Trimmed 40666 records to 28822 (keeping 200 days of data) [2025-10-17T18:02:49.018133] [DEBUG] [LOCAL ] CION: Primary data saved (28822 records). [2025-10-17T18:02:49.018304] [INFO ] [MAIN ] CION: Full history saved. [2025-10-17T18:02:49.018413] [INFO ] [MAIN ] Update Progress: 458/2368 symbols completed. CION took 33.9s. Estimated remaining: 4h 21m 42s. Rate: 7.3 symbols/min [2025-10-17T18:02:49.183226] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:49.183398] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-10-17T18:02:49.183436] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-10-17T18:02:49.183547] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-17T18:02:49.183596] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-17T18:02:49.183688] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-17T18:02:49.183748] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-17T18:02:49.550591] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:49.557994] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-17T18:02:49.597731] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T18:02:49.921477] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T18:02:50.358008] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-17T18:02:50.766005] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T18:02:51.158043] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-17T18:02:51.958022] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-17T18:02:52.333341] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T18:02:52.597011] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T18:02:52.757972] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-17T18:02:52.955074] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T18:02:53.558051] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-17T18:02:53.816114] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:02:54.358083] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-17T18:02:55.158066] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-17T18:02:55.543886] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:02:55.958054] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-17T18:02:56.529186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T18:02:56.758043] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-17T18:02:56.985025] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:02:57.558046] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-17T18:02:58.051104] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-17T18:02:58.243306] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T18:02:58.253354] [INFO ] [REMOTE ] CIVI: Full fetch complete (76010 records). [2025-10-17T18:02:58.253566] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-17T18:02:58.363168] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-17T18:02:58.686807] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-17T18:02:58.692596] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-17T18:02:58.703486] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T18:02:58.702759] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-17T18:02:58.709564] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-17T18:02:58.711806] [DEBUG] [LOCAL ] CIVI: Trimmed 76010 records to 53478 (keeping 200 days of data) [2025-10-17T18:02:59.034509] [DEBUG] [LOCAL ] CIVI: Primary data saved (53478 records). [2025-10-17T18:02:59.034702] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-17T18:02:59.034821] [INFO ] [MAIN ] Update Progress: 459/2368 symbols completed. CIVI took 35.1s. Estimated remaining: 4h 21m 41s. Rate: 7.3 symbols/min [2025-10-17T18:02:59.163267] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-17T18:02:59.212282] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:59.236727] [DEBUG] [LOCAL ] CLDT: Loaded 25627 existing records from primary storage. [2025-10-17T18:02:59.237015] [INFO ] [MAIN ] CLDT: Loaded 25627 existing records. [2025-10-17T18:02:59.413820] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:59.414096] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-17T18:02:59.414154] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-17T18:02:59.414725] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-17T18:02:59.414782] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-17T18:02:59.758545] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:59.958059] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-17T18:03:00.605812] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-17T18:03:00.744097] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:03:00.757993] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-17T18:03:01.463325] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:03:01.558036] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-17T18:03:02.358030] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-17T18:03:02.425370] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T18:03:02.746336] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T18:03:03.157999] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-17T18:03:03.482435] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:03:03.958051] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-17T18:03:04.758048] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-17T18:03:05.134858] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:03:05.330993] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T18:03:05.558006] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-17T18:03:05.658050] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T18:03:06.358099] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-17T18:03:06.865509] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:03:07.158039] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-17T18:03:07.958146] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-17T18:03:08.269056] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:03:08.411929] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T18:03:08.420296] [INFO ] [REMOTE ] CL: Full fetch complete (77811 records). [2025-10-17T18:03:08.420943] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-17T18:03:08.763229] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-17T18:03:08.864380] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-17T18:03:08.864677] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-17T18:03:08.866639] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-17T18:03:08.867379] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T18:03:08.867688] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-17T18:03:08.873447] [DEBUG] [LOCAL ] CL: Trimmed 77811 records to 54429 (keeping 200 days of data) [2025-10-17T18:03:09.259867] [DEBUG] [LOCAL ] CL: Primary data saved (54429 records). [2025-10-17T18:03:09.260070] [INFO ] [MAIN ] CL: Full history saved. [2025-10-17T18:03:09.260601] [INFO ] [MAIN ] Update Progress: 460/2368 symbols completed. CL took 37.1s. Estimated remaining: 4h 21m 41s. Rate: 7.3 symbols/min [2025-10-17T18:03:09.459938] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:09.516331] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-17T18:03:09.516898] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-10-17T18:03:09.563183] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-17T18:03:09.775238] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:09.775565] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-17T18:03:09.775672] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-17T18:03:09.776424] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-17T18:03:09.776502] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-17T18:03:10.285122] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:10.309049] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:03:10.358089] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-17T18:03:10.390552] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T18:03:11.158081] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-17T18:03:11.651274] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T18:03:11.958131] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-17T18:03:12.481110] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T18:03:12.758019] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-17T18:03:13.558055] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-17T18:03:14.110052] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T18:03:14.141486] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T18:03:14.358062] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-17T18:03:14.653170] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T18:03:15.158063] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-17T18:03:15.917693] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:03:15.958044] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-17T18:03:16.275033] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T18:03:16.758084] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-17T18:03:17.558069] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-17T18:03:17.782754] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:03:17.963063] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:03:18.358012] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-17T18:03:18.548132] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T18:03:19.158097] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-17T18:03:19.958001] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-17T18:03:20.272503] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T18:03:20.434098] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T18:03:20.758012] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-17T18:03:20.857724] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T18:03:21.558032] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-17T18:03:22.206070] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:03:22.210550] [INFO ] [REMOTE ] CLDT: Full fetch complete (37484 records). [2025-10-17T18:03:22.210691] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-17T18:03:22.363126] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-17T18:03:22.612091] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-17T18:03:22.612169] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-17T18:03:22.612745] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-17T18:03:22.612806] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-17T18:03:22.613665] [DEBUG] [LOCAL ] CLDT: Trimmed 37484 records to 25824 (keeping 200 days of data) [2025-10-17T18:03:22.758569] [DEBUG] [LOCAL ] CLDT: Primary data saved (25824 records). [2025-10-17T18:03:22.758764] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-17T18:03:22.758867] [INFO ] [MAIN ] Update Progress: 461/2368 symbols completed. CLDT took 23.7s. Estimated remaining: 4h 21m 55s. Rate: 7.3 symbols/min [2025-10-17T18:03:22.926845] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:22.954522] [DEBUG] [LOCAL ] CLH: Loaded 28054 existing records from primary storage. [2025-10-17T18:03:22.954833] [INFO ] [MAIN ] CLH: Loaded 28054 existing records. [2025-10-17T18:03:23.132141] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:23.132396] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-17T18:03:23.132456] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-17T18:03:23.132820] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-17T18:03:23.132879] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-17T18:03:23.163321] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-17T18:03:23.493214] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:23.716082] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-17T18:03:23.757041] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T18:03:23.761782] [INFO ] [REMOTE ] CLCO: Full fetch complete (22951 records). [2025-10-17T18:03:23.761919] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-17T18:03:23.963121] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-17T18:03:24.198248] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-17T18:03:24.198370] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-17T18:03:24.199162] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-17T18:03:24.199250] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-17T18:03:24.200143] [DEBUG] [LOCAL ] CLCO: Trimmed 22951 records to 13484 (keeping 200 days of data) [2025-10-17T18:03:24.295393] [DEBUG] [LOCAL ] CLCO: Primary data saved (13484 records). [2025-10-17T18:03:24.295578] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-17T18:03:24.295719] [INFO ] [MAIN ] Update Progress: 462/2368 symbols completed. CLCO took 35.3s. Estimated remaining: 4h 21m 19s. Rate: 7.3 symbols/min [2025-10-17T18:03:24.477734] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:24.478167] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-17T18:03:24.478272] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-17T18:03:24.478485] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-17T18:03:24.478635] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-17T18:03:24.478850] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-17T18:03:24.478971] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-17T18:03:24.604678] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:03:24.764779] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-17T18:03:24.874068] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:25.405104] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:03:25.558000] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-17T18:03:26.358032] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-17T18:03:26.853691] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T18:03:27.094877] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T18:03:27.157997] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-17T18:03:27.765395] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T18:03:27.770777] [INFO ] [REMOTE ] CLB: Full fetch complete (47223 records). [2025-10-17T18:03:27.770959] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-17T18:03:27.964454] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-17T18:03:28.165462] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-17T18:03:28.165543] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-17T18:03:28.166253] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-17T18:03:28.166320] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-17T18:03:28.167442] [DEBUG] [LOCAL ] CLB: Trimmed 47223 records to 33985 (keeping 200 days of data) [2025-10-17T18:03:28.373712] [DEBUG] [LOCAL ] CLB: Primary data saved (33985 records). [2025-10-17T18:03:28.373943] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-17T18:03:28.374067] [INFO ] [MAIN ] Update Progress: 463/2368 symbols completed. CLB took 48.9s. Estimated remaining: 4h 20m 53s. Rate: 7.3 symbols/min [2025-10-17T18:03:28.549523] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:28.603101] [DEBUG] [LOCAL ] CLS: Loaded 53972 existing records from primary storage. [2025-10-17T18:03:28.603469] [INFO ] [MAIN ] CLS: Loaded 53972 existing records. [2025-10-17T18:03:28.783239] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-17T18:03:28.789596] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:28.790876] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-17T18:03:28.790940] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-17T18:03:28.791369] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-17T18:03:28.791411] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-17T18:03:29.175188] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:29.368600] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:03:29.408225] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-17T18:03:29.558044] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-17T18:03:29.704054] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T18:03:30.358054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-17T18:03:31.158007] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-17T18:03:31.624202] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-17T18:03:31.675576] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T18:03:31.958081] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-17T18:03:32.757999] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-17T18:03:33.232375] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T18:03:33.435136] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T18:03:33.558024] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-17T18:03:34.364962] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-17T18:03:34.365933] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:03:35.073948] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-17T18:03:35.158007] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-17T18:03:35.674487] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T18:03:35.958035] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-17T18:03:36.758030] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-17T18:03:37.378675] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T18:03:37.558008] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-17T18:03:37.849884] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:03:38.015563] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T18:03:38.344750] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T18:03:38.357987] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-17T18:03:39.158092] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-17T18:03:39.575463] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T18:03:39.958027] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-17T18:03:40.758033] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-17T18:03:41.208749] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T18:03:41.511567] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-17T18:03:41.557982] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-17T18:03:41.825517] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T18:03:42.358027] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-17T18:03:43.130369] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T18:03:43.157982] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-17T18:03:43.615695] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:03:43.920142] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T18:03:43.957994] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-17T18:03:44.758054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-17T18:03:44.786057] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T18:03:45.558052] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-17T18:03:46.207477] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T18:03:46.358042] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-17T18:03:47.158039] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-17T18:03:47.498210] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T18:03:47.676203] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T18:03:47.927754] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T18:03:47.958028] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-17T18:03:48.758032] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-17T18:03:49.558033] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-17T18:03:50.046755] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T18:03:50.054974] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-17T18:03:50.055269] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-17T18:03:50.141403] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:03:50.186111] [INFO ] [REMOTE ] CLH: Full fetch complete (42169 records). [2025-10-17T18:03:50.186358] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-17T18:03:50.370582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-17T18:03:50.812103] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-17T18:03:50.817323] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-17T18:03:50.828624] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-17T18:03:50.828741] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-17T18:03:50.890246] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54521 (keeping 200 days of data) [2025-10-17T18:03:51.015365] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-17T18:03:51.019756] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-17T18:03:51.024566] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-17T18:03:51.028602] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-17T18:03:51.039738] [DEBUG] [LOCAL ] CLH: Trimmed 42169 records to 28288 (keeping 200 days of data) [2025-10-17T18:03:51.275811] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T18:03:51.284906] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-17T18:03:51.358441] [DEBUG] [LOCAL ] CLH: Primary data saved (28288 records). [2025-10-17T18:03:51.363073] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-17T18:03:51.363207] [INFO ] [MAIN ] Update Progress: 464/2368 symbols completed. CLH took 28.6s. Estimated remaining: 4h 21m 46s. Rate: 7.3 symbols/min [2025-10-17T18:03:51.635791] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:51.656852] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-10-17T18:03:51.656981] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-17T18:03:51.657638] [INFO ] [MAIN ] Update Progress: 465/2368 symbols completed. CLF took 42.4s. Estimated remaining: 4h 21m 5s. Rate: 7.3 symbols/min [2025-10-17T18:03:51.830421] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:51.878451] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-17T18:03:51.904995] [DEBUG] [LOCAL ] CLVT: Loaded 52319 existing records from primary storage. [2025-10-17T18:03:51.909771] [INFO ] [MAIN ] CLVT: Loaded 52319 existing records. [2025-10-17T18:03:51.964455] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-17T18:03:52.023345] [DEBUG] [LOCAL ] CLW: Loaded 21658 existing records from primary storage. [2025-10-17T18:03:52.044743] [INFO ] [MAIN ] CLW: Loaded 21658 existing records. [2025-10-17T18:03:52.166234] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:52.210057] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-17T18:03:52.210283] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-17T18:03:52.211417] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:03:52.211893] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-17T18:03:52.234499] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-17T18:03:52.274461] [INFO ] [REMOTE ] CLPR: Full fetch complete (16053 records). [2025-10-17T18:03:52.349209] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-17T18:03:52.337149] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:52.369830] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-17T18:03:52.380832] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-17T18:03:52.370437] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:03:52.393715] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:03:52.396894] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:03:52.397004] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-17T18:03:52.397079] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-17T18:03:52.397196] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-17T18:03:52.397275] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-17T18:03:52.428430] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-17T18:03:52.473843] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-17T18:03:52.504476] [INFO ] [MAIN ] Update Progress: 466/2368 symbols completed. CLPR took 28.2s. Estimated remaining: 4h 20m 27s. Rate: 7.3 symbols/min [2025-10-17T18:03:53.044813] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:53.051012] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:53.079891] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-17T18:03:53.080038] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-10-17T18:03:53.086284] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-10-17T18:03:53.092870] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-17T18:03:53.092964] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-17T18:03:53.098294] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-17T18:03:53.098363] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-17T18:03:53.337950] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:53.548721] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:53.557979] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-17T18:03:54.358021] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-17T18:03:54.393040] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-17T18:03:54.902334] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:03:55.158113] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-17T18:03:55.216312] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:03:55.579455] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:03:55.958022] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-17T18:03:56.763519] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-17T18:03:56.781549] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:03:57.557994] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-17T18:03:57.740132] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:03:57.995142] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T18:03:58.358033] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-17T18:03:59.160782] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-17T18:03:59.167404] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:03:59.234663] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:03:59.958009] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-17T18:04:00.758035] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-17T18:04:01.323237] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-17T18:04:01.441926] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T18:04:01.558041] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-17T18:04:02.358142] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-17T18:04:02.523430] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:04:03.158055] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-17T18:04:03.717677] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-17T18:04:03.958023] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-17T18:04:04.186897] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:04:04.352820] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T18:04:04.758048] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-17T18:04:05.558006] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-17T18:04:05.859775] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:04:06.277513] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:04:06.358054] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-17T18:04:07.127062] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T18:04:07.157983] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-17T18:04:07.958020] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-17T18:04:08.248700] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T18:04:08.758030] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-17T18:04:09.538386] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T18:04:09.557986] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-17T18:04:09.830527] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T18:04:09.947282] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:04:10.358136] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-17T18:04:11.158061] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-17T18:04:11.602904] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T18:04:11.657984] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:04:11.958070] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-17T18:04:12.248142] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:04:12.758105] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-17T18:04:13.558052] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-17T18:04:14.269038] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T18:04:14.276015] [INFO ] [REMOTE ] CLS: Full fetch complete (77311 records). [2025-10-17T18:04:14.276158] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-17T18:04:14.276874] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:04:14.276971] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:04:14.277045] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:04:14.277132] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-17T18:04:14.277235] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-17T18:04:14.277292] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-17T18:04:14.277456] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-10-17T18:04:14.278026] [INFO ] [MAIN ] Update Progress: 467/2368 symbols completed. CLS took 45.9s. Estimated remaining: 4h 21m 14s. Rate: 7.3 symbols/min [2025-10-17T18:04:14.359112] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-17T18:04:14.455438] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:14.527640] [DEBUG] [LOCAL ] CM: Loaded 49077 existing records from primary storage. [2025-10-17T18:04:14.526451] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:04:14.541609] [INFO ] [MAIN ] CM: Loaded 49077 existing records. [2025-10-17T18:04:14.720549] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:14.720899] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-17T18:04:14.720981] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-17T18:04:14.721481] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-17T18:04:14.721538] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-17T18:04:14.919528] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:04:15.104757] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:15.158042] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-17T18:04:15.958045] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-17T18:04:16.398463] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T18:04:16.422263] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T18:04:16.758030] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-17T18:04:17.374168] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:04:17.558032] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-17T18:04:17.914077] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T18:04:17.917468] [INFO ] [REMOTE ] CLW: Full fetch complete (33827 records). [2025-10-17T18:04:17.917554] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-17T18:04:18.292484] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-17T18:04:18.292561] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-17T18:04:18.293112] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-17T18:04:18.293174] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-17T18:04:18.293943] [DEBUG] [LOCAL ] CLW: Trimmed 33827 records to 21809 (keeping 200 days of data) [2025-10-17T18:04:18.374081] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-17T18:04:18.422208] [DEBUG] [LOCAL ] CLW: Primary data saved (21809 records). [2025-10-17T18:04:18.422348] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-17T18:04:18.422432] [INFO ] [MAIN ] Update Progress: 468/2368 symbols completed. CLW took 26.8s. Estimated remaining: 4h 20m 49s. Rate: 7.3 symbols/min [2025-10-17T18:04:18.591025] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:18.641241] [DEBUG] [LOCAL ] CMA: Loaded 50512 existing records from primary storage. [2025-10-17T18:04:18.641606] [INFO ] [MAIN ] CMA: Loaded 50512 existing records. [2025-10-17T18:04:18.821478] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:18.821743] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-17T18:04:18.821799] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-17T18:04:18.822194] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-17T18:04:18.822251] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-17T18:04:19.168003] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-17T18:04:19.173896] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:19.275199] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:04:19.958003] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-17T18:04:20.010753] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T18:04:20.446427] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T18:04:20.758055] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-17T18:04:21.558043] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-17T18:04:21.807238] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T18:04:21.965930] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:04:22.358033] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-17T18:04:23.158044] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-17T18:04:23.439221] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:04:23.958140] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-17T18:04:24.031853] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:04:24.763119] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-17T18:04:24.776536] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T18:04:25.558009] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-17T18:04:25.587544] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T18:04:25.594192] [INFO ] [REMOTE ] CLVT: Full fetch complete (75034 records). [2025-10-17T18:04:25.594331] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-17T18:04:25.595146] [FATAL] [VALIDATOR ] CLVT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:04:25.595234] [FATAL] [MAIN ] CLVT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:04:25.595277] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:04:25.595329] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-17T18:04:25.595412] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-17T18:04:25.595462] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-10-17T18:04:25.595693] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-10-17T18:04:25.595816] [INFO ] [MAIN ] Update Progress: 469/2368 symbols completed. CLVT took 34.2s. Estimated remaining: 4h 20m 36s. Rate: 7.3 symbols/min [2025-10-17T18:04:25.765639] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:25.790972] [DEBUG] [LOCAL ] CMBT: Loaded 26529 existing records from primary storage. [2025-10-17T18:04:25.791214] [INFO ] [MAIN ] CMBT: Loaded 26529 existing records. [2025-10-17T18:04:25.967719] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:25.967950] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-17T18:04:25.968021] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-17T18:04:25.968253] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-17T18:04:25.968312] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-17T18:04:26.322987] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:26.357989] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-17T18:04:26.715957] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T18:04:27.158052] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-17T18:04:27.297596] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T18:04:27.543611] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T18:04:27.958100] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-17T18:04:28.624768] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:04:28.758027] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-17T18:04:29.558077] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-17T18:04:29.620806] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:04:29.944429] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:04:30.358104] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-17T18:04:30.557295] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T18:04:31.158079] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-17T18:04:31.958080] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-17T18:04:32.177528] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T18:04:32.758093] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-17T18:04:32.901700] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:04:33.260837] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:04:33.558020] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-17T18:04:33.710009] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:04:34.358089] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-17T18:04:35.158087] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-17T18:04:35.448940] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T18:04:35.505768] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-17T18:04:35.514216] [INFO ] [REMOTE ] CLX: Full fetch complete (73651 records). [2025-10-17T18:04:35.514476] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-17T18:04:35.922158] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-17T18:04:35.922253] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-17T18:04:35.923154] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-17T18:04:35.923221] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-17T18:04:35.924711] [DEBUG] [LOCAL ] CLX: Trimmed 73651 records to 52408 (keeping 200 days of data) [2025-10-17T18:04:35.979988] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-17T18:04:36.262201] [DEBUG] [LOCAL ] CLX: Primary data saved (52408 records). [2025-10-17T18:04:36.262348] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-17T18:04:36.262424] [INFO ] [MAIN ] Update Progress: 470/2368 symbols completed. CLX took 43.7s. Estimated remaining: 4h 20m 38s. Rate: 7.3 symbols/min [2025-10-17T18:04:36.432036] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:36.478090] [DEBUG] [LOCAL ] CMC: Loaded 45871 existing records from primary storage. [2025-10-17T18:04:36.478637] [INFO ] [MAIN ] CMC: Loaded 45871 existing records. [2025-10-17T18:04:36.665556] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:36.666001] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-17T18:04:36.666159] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-17T18:04:36.666771] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-17T18:04:36.666883] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-17T18:04:36.758512] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-17T18:04:36.948027] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:04:37.122062] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:37.123286] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:04:37.558036] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-17T18:04:38.358093] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-17T18:04:38.704080] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T18:04:38.775507] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T18:04:39.158026] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-17T18:04:39.745577] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:04:39.958002] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-17T18:04:40.115816] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:04:40.758025] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-17T18:04:41.558022] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-17T18:04:41.630735] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:04:41.676955] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T18:04:42.358017] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-17T18:04:43.158026] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-17T18:04:43.226358] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T18:04:43.815379] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:04:43.958023] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-17T18:04:44.758002] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-17T18:04:45.100825] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:04:45.522015] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:04:45.558002] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-17T18:04:46.358006] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-17T18:04:46.418615] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:04:46.945233] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T18:04:47.158022] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-17T18:04:47.958028] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-17T18:04:48.046685] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:04:48.738361] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:04:48.757990] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-17T18:04:49.558026] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-17T18:04:49.943333] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T18:04:49.950201] [INFO ] [REMOTE ] CMBT: Full fetch complete (33107 records). [2025-10-17T18:04:49.950307] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-17T18:04:50.347445] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-17T18:04:50.347621] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-17T18:04:50.348345] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-17T18:04:50.348423] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-17T18:04:50.349540] [DEBUG] [LOCAL ] CMBT: Trimmed 33107 records to 26862 (keeping 200 days of data) [2025-10-17T18:04:50.402803] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-17T18:04:50.488913] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:04:50.559070] [DEBUG] [LOCAL ] CMBT: Primary data saved (26862 records). [2025-10-17T18:04:50.559232] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-17T18:04:50.559375] [INFO ] [MAIN ] Update Progress: 471/2368 symbols completed. CMBT took 25.0s. Estimated remaining: 4h 20m 54s. Rate: 7.3 symbols/min [2025-10-17T18:04:50.733005] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:50.733172] [DEBUG] [LOCAL ] CMCM: No existing data file found in primary storage. [2025-10-17T18:04:50.733209] [WARN ] [MAIN ] CMCM: No existing data found, performing full refresh instead. [2025-10-17T18:04:50.733321] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-17T18:04:50.733362] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-17T18:04:50.733402] [DEBUG] [LOCAL ] CMCM: No primary data file found to delete. [2025-10-17T18:04:50.733434] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-17T18:04:51.107989] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:51.158002] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-17T18:04:51.302737] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T18:04:51.958042] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-17T18:04:52.029395] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:04:52.431065] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:04:52.438604] [INFO ] [REMOTE ] CM: Full fetch complete (69877 records). [2025-10-17T18:04:52.438943] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-17T18:04:52.763324] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-17T18:04:52.854752] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-17T18:04:52.855166] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-17T18:04:52.856413] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-17T18:04:52.856489] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-17T18:04:52.858684] [DEBUG] [LOCAL ] CM: Trimmed 69877 records to 49434 (keeping 200 days of data) [2025-10-17T18:04:53.184899] [DEBUG] [LOCAL ] CM: Primary data saved (49434 records). [2025-10-17T18:04:53.185208] [INFO ] [MAIN ] CM: Full history saved. [2025-10-17T18:04:53.186053] [INFO ] [MAIN ] Update Progress: 472/2368 symbols completed. CM took 38.9s. Estimated remaining: 4h 20m 23s. Rate: 7.3 symbols/min [2025-10-17T18:04:53.362833] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:53.363220] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-17T18:04:53.363364] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-17T18:04:53.363639] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-17T18:04:53.363811] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-17T18:04:53.363902] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-17T18:04:53.364033] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-17T18:04:53.501320] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:04:53.563131] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-17T18:04:53.853371] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:54.358065] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-17T18:04:54.435053] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:04:54.847563] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:04:55.158100] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-17T18:04:55.317609] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:04:55.371512] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:04:55.372189] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-17T18:04:55.372318] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:04:55.372397] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-17T18:04:55.372459] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:04:55.372551] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-17T18:04:55.372686] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-17T18:04:55.372765] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-17T18:04:55.372837] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-17T18:04:55.372920] [INFO ] [MAIN ] Update Progress: 473/2368 symbols completed. CMDB took 2.2s. Estimated remaining: 4h 19m 50s. Rate: 7.3 symbols/min [2025-10-17T18:04:55.539761] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:55.592159] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-17T18:04:55.592484] [INFO ] [MAIN ] CMG: Loaded 54111 existing records. [2025-10-17T18:04:55.768440] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:55.768708] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-17T18:04:55.768766] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-17T18:04:55.769290] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-17T18:04:55.769348] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-17T18:04:55.966480] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-17T18:04:56.126134] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:56.758038] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-17T18:04:57.558017] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-17T18:04:57.786467] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:04:57.796721] [INFO ] [REMOTE ] CMA: Full fetch complete (73462 records). [2025-10-17T18:04:57.796847] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-17T18:04:58.222884] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-17T18:04:58.223063] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-17T18:04:58.224133] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-17T18:04:58.224341] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-17T18:04:58.226002] [DEBUG] [LOCAL ] CMA: Trimmed 73462 records to 50902 (keeping 200 days of data) [2025-10-17T18:04:58.356119] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T18:04:58.369459] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-17T18:04:58.588306] [DEBUG] [LOCAL ] CMA: Primary data saved (50902 records). [2025-10-17T18:04:58.588460] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-17T18:04:58.589001] [INFO ] [MAIN ] Update Progress: 474/2368 symbols completed. CMA took 40.2s. Estimated remaining: 4h 19m 22s. Rate: 7.3 symbols/min [2025-10-17T18:04:58.774100] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:58.820258] [DEBUG] [LOCAL ] CMI: Loaded 42011 existing records from primary storage. [2025-10-17T18:04:58.820605] [INFO ] [MAIN ] CMI: Loaded 42011 existing records. [2025-10-17T18:04:59.006547] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:59.006782] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-17T18:04:59.006871] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-17T18:04:59.007301] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-17T18:04:59.007358] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-17T18:04:59.128147] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:04:59.163102] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-17T18:04:59.397854] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:59.737734] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T18:04:59.816629] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T18:04:59.958047] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-17T18:05:00.477453] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T18:05:00.758040] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-17T18:05:01.558049] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-17T18:05:02.358061] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-17T18:05:02.391427] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T18:05:02.854176] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T18:05:03.158081] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-17T18:05:03.958066] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-17T18:05:04.051670] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:05:04.630184] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T18:05:04.692100] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T18:05:04.757985] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-17T18:05:05.558027] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-17T18:05:06.172327] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T18:05:06.282769] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:05:06.357997] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-17T18:05:06.847373] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T18:05:07.158015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-17T18:05:07.958030] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-17T18:05:08.758096] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-17T18:05:09.301718] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T18:05:09.558031] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-17T18:05:09.761035] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T18:05:10.358039] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-17T18:05:10.476457] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:05:11.158037] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-17T18:05:11.794062] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-17T18:05:11.958019] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-17T18:05:11.982349] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T18:05:12.190328] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:05:12.758040] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-17T18:05:13.558014] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-17T18:05:13.608598] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:05:13.609988] [INFO ] [REMOTE ] CMCM: Full fetch complete (7009 records). [2025-10-17T18:05:13.610117] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-17T18:05:13.970988] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-17T18:05:13.971136] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-17T18:05:13.971347] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-17T18:05:13.971389] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-17T18:05:13.971843] [DEBUG] [LOCAL ] CMCM: Trimmed 7009 records to 4894 (keeping 200 days of data) [2025-10-17T18:05:13.998529] [DEBUG] [LOCAL ] CMCM: Primary data saved (4894 records). [2025-10-17T18:05:13.998608] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-17T18:05:13.998705] [INFO ] [MAIN ] Update Progress: 475/2368 symbols completed. CMCM took 23.4s. Estimated remaining: 4h 19m 43s. Rate: 7.3 symbols/min [2025-10-17T18:05:14.177183] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:14.211730] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T18:05:14.250842] [DEBUG] [LOCAL ] CMP: Loaded 36020 existing records from primary storage. [2025-10-17T18:05:14.251118] [INFO ] [MAIN ] CMP: Loaded 36020 existing records. [2025-10-17T18:05:14.363189] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-17T18:05:14.431556] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:14.431787] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-17T18:05:14.431844] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-17T18:05:14.432110] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-17T18:05:14.432179] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-17T18:05:14.787086] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:15.126869] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T18:05:15.158011] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-17T18:05:15.958015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-17T18:05:16.198867] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T18:05:16.758015] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-17T18:05:17.047364] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:05:17.055182] [INFO ] [REMOTE ] CMC: Full fetch complete (67206 records). [2025-10-17T18:05:17.055360] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-17T18:05:17.444385] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-17T18:05:17.444506] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-17T18:05:17.445340] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-17T18:05:17.445423] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-17T18:05:17.446910] [DEBUG] [LOCAL ] CMC: Trimmed 67206 records to 46259 (keeping 200 days of data) [2025-10-17T18:05:17.558516] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-17T18:05:17.723563] [DEBUG] [LOCAL ] CMC: Primary data saved (46259 records). [2025-10-17T18:05:17.723716] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-17T18:05:17.723814] [INFO ] [MAIN ] Update Progress: 476/2368 symbols completed. CMC took 41.5s. Estimated remaining: 4h 19m 17s. Rate: 7.3 symbols/min [2025-10-17T18:05:17.895047] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:17.939618] [DEBUG] [LOCAL ] CMPO: Loaded 39076 existing records from primary storage. [2025-10-17T18:05:17.940031] [INFO ] [MAIN ] CMPO: Loaded 39076 existing records. [2025-10-17T18:05:18.129605] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:18.129946] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-17T18:05:18.130035] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-17T18:05:18.130431] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-17T18:05:18.130548] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-17T18:05:18.420768] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-17T18:05:18.459195] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-17T18:05:18.533342] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:18.558456] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:05:19.058265] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T18:05:19.158033] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-17T18:05:19.958045] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-17T18:05:20.531317] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-17T18:05:20.605539] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T18:05:20.758046] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-17T18:05:21.504222] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:05:21.558006] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-17T18:05:22.358082] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-17T18:05:22.841036] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T18:05:22.984603] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T18:05:23.158040] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-17T18:05:23.732458] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:05:23.958046] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-17T18:05:24.758065] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-17T18:05:25.357568] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:05:25.435903] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-17T18:05:25.557999] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-17T18:05:26.358012] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-17T18:05:26.541706] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:05:27.158060] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-17T18:05:27.711271] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T18:05:27.831502] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-17T18:05:27.958038] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-17T18:05:28.413151] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T18:05:28.758044] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-17T18:05:29.558030] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-17T18:05:30.079911] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T18:05:30.224052] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:05:30.358036] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-17T18:05:30.939350] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:05:30.945454] [INFO ] [REMOTE ] CMI: Full fetch complete (60910 records). [2025-10-17T18:05:30.945619] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-17T18:05:31.163232] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-17T18:05:31.322095] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-17T18:05:31.322182] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-17T18:05:31.322926] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-17T18:05:31.322989] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-17T18:05:31.324226] [DEBUG] [LOCAL ] CMI: Trimmed 60910 records to 42340 (keeping 200 days of data) [2025-10-17T18:05:31.589052] [DEBUG] [LOCAL ] CMI: Primary data saved (42340 records). [2025-10-17T18:05:31.589232] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-17T18:05:31.589879] [INFO ] [MAIN ] Update Progress: 477/2368 symbols completed. CMI took 33.0s. Estimated remaining: 4h 19m 31s. Rate: 7.3 symbols/min [2025-10-17T18:05:31.958117] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-17T18:05:32.787523] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-17T18:05:32.797312] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-17T18:05:32.797501] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-17T18:05:33.067034] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:05:33.135389] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-17T18:05:33.233437] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-17T18:05:33.233637] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-17T18:05:33.234677] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-17T18:05:33.234757] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-17T18:05:33.257858] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54501 (keeping 200 days of data) [2025-10-17T18:05:33.259033] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:05:33.562940] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-17T18:05:33.586684] [DEBUG] [LOCAL ] CMG: Primary data saved (54501 records). [2025-10-17T18:05:33.586834] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-17T18:05:33.587385] [INFO ] [MAIN ] Update Progress: 478/2368 symbols completed. CMG took 38.2s. Estimated remaining: 4h 18m 58s. Rate: 7.3 symbols/min [2025-10-17T18:05:34.302872] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:05:34.357986] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-17T18:05:34.669770] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:05:35.158074] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-17T18:05:36.084941] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:05:36.098004] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-17T18:05:36.647884] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:05:36.758027] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-17T18:05:37.517961] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:05:37.558002] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-17T18:05:38.240253] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:05:38.358026] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-17T18:05:38.961567] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:05:39.158048] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-17T18:05:39.646091] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:05:39.958050] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-17T18:05:40.241517] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T18:05:40.758027] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-17T18:05:40.902185] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:05:41.558036] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-17T18:05:42.168197] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:05:42.358028] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-17T18:05:42.879203] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T18:05:42.883428] [INFO ] [REMOTE ] CMP: Full fetch complete (51676 records). [2025-10-17T18:05:42.883520] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-17T18:05:43.255663] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-17T18:05:43.255749] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-17T18:05:43.256423] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-17T18:05:43.256465] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-17T18:05:43.257486] [DEBUG] [LOCAL ] CMP: Trimmed 51676 records to 36229 (keeping 200 days of data) [2025-10-17T18:05:43.458603] [DEBUG] [LOCAL ] CMP: Primary data saved (36229 records). [2025-10-17T18:05:43.458761] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-17T18:05:43.458846] [INFO ] [MAIN ] Update Progress: 479/2368 symbols completed. CMP took 29.5s. Estimated remaining: 4h 18m 56s. Rate: 7.3 symbols/min [2025-10-17T18:05:43.693201] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T18:05:43.697991] [INFO ] [REMOTE ] CMPO: Full fetch complete (58206 records). [2025-10-17T18:05:43.698111] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-17T18:05:43.698831] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:05:43.698932] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:05:43.699006] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:05:43.699097] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-17T18:05:43.699176] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-17T18:05:43.699216] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-10-17T18:05:43.699393] [DEBUG] [LOCAL ] CMPO: Deleted derivative data file. [2025-10-17T18:05:43.699482] [INFO ] [MAIN ] Update Progress: 480/2368 symbols completed. CMPO took 26.0s. Estimated remaining: 4h 18m 16s. Rate: 7.3 symbols/min [2025-10-17T18:05:44.279871] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.459346] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.485839] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.506059] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.513589] [DEBUG] [LOCAL ] CMSA: Loaded 3562 existing records from primary storage. [2025-10-17T18:05:44.514007] [INFO ] [MAIN ] CMSA: Loaded 3562 existing records. [2025-10-17T18:05:44.623157] [DEBUG] [LOCAL ] CMSC: Loaded 4906 existing records from primary storage. [2025-10-17T18:05:44.631211] [INFO ] [MAIN ] CMSC: Loaded 4906 existing records. [2025-10-17T18:05:44.720691] [DEBUG] [LOCAL ] CMRE: Loaded 36175 existing records from primary storage. [2025-10-17T18:05:44.746795] [INFO ] [MAIN ] CMRE: Loaded 36175 existing records. [2025-10-17T18:05:44.983874] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.009184] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.043455] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-17T18:05:45.029626] [DEBUG] [LOCAL ] CMS: Loaded 52994 existing records from primary storage. [2025-10-17T18:05:45.098220] [INFO ] [MAIN ] CMS: Loaded 52994 existing records. [2025-10-17T18:05:45.102216] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.110279] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-17T18:05:45.127709] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.152075] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-17T18:05:45.151968] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.112950] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-17T18:05:45.187932] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-17T18:05:45.206506] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-17T18:05:45.235090] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.288283] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-17T18:05:45.414031] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-17T18:05:45.424671] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-17T18:05:45.762384] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.831227] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.858262] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-17T18:05:45.907352] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-17T18:05:45.929548] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-17T18:05:46.277629] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.317813] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-17T18:05:46.535020] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.566626] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-17T18:05:46.760481] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.773897] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-17T18:05:46.853808] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.854112] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-17T18:05:47.096637] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T18:05:47.098485] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-17T18:05:47.378604] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T18:05:47.380370] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-17T18:05:47.706792] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T18:05:47.959758] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T18:05:47.958363] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-17T18:05:48.049332] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T18:05:48.507337] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T18:05:48.509416] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:05:48.758002] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-17T18:05:49.558098] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-17T18:05:50.075886] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T18:05:50.165560] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:05:50.358045] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-17T18:05:50.812516] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T18:05:51.158085] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-17T18:05:51.958112] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-17T18:05:52.444310] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T18:05:52.758068] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-17T18:05:52.791342] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:05:53.558045] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-17T18:05:54.041834] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T18:05:54.121610] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T18:05:54.358110] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-17T18:05:54.956921] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T18:05:55.158055] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-17T18:05:55.495374] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T18:05:55.958094] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-17T18:05:56.758036] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-17T18:05:57.332559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T18:05:57.558061] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-17T18:05:57.695174] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:05:58.280853] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:05:58.358091] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-17T18:05:58.934696] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:05:59.158135] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-17T18:05:59.722559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T18:05:59.958092] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-17T18:06:00.665448] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:06:00.758068] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-17T18:06:01.558044] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-17T18:06:02.358088] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-17T18:06:02.937843] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T18:06:02.938073] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T18:06:03.158061] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-17T18:06:03.419520] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:06:03.958047] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-17T18:06:04.563773] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T18:06:04.669550] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-17T18:06:04.758078] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-17T18:06:05.370400] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T18:06:05.371405] [INFO ] [REMOTE ] CMSA: Full fetch complete (4961 records). [2025-10-17T18:06:05.371473] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-17T18:06:05.565212] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-17T18:06:05.733262] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-17T18:06:05.733338] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-17T18:06:05.733500] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-17T18:06:05.733540] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-17T18:06:05.733947] [DEBUG] [LOCAL ] CMSA: Trimmed 4961 records to 3570 (keeping 200 days of data) [2025-10-17T18:06:05.756947] [DEBUG] [LOCAL ] CMSA: Primary data saved (3570 records). [2025-10-17T18:06:05.757055] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-17T18:06:05.757141] [INFO ] [MAIN ] Update Progress: 481/2368 symbols completed. CMSA took 22.0s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-17T18:06:05.923665] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:05.933362] [DEBUG] [LOCAL ] CMSD: Loaded 7871 existing records from primary storage. [2025-10-17T18:06:05.933549] [INFO ] [MAIN ] CMSD: Loaded 7871 existing records. [2025-10-17T18:06:06.107110] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:06.107398] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-17T18:06:06.107494] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-17T18:06:06.107760] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-17T18:06:06.107847] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-17T18:06:06.363119] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-17T18:06:06.465142] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:07.000491] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T18:06:07.122918] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:06:07.157993] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-17T18:06:07.725484] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T18:06:07.957999] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-17T18:06:08.658579] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:06:08.659843] [INFO ] [REMOTE ] CMSC: Full fetch complete (7038 records). [2025-10-17T18:06:08.659918] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-17T18:06:08.763140] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-17T18:06:09.025620] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-17T18:06:09.025728] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-17T18:06:09.025926] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-17T18:06:09.025972] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-17T18:06:09.026397] [DEBUG] [LOCAL ] CMSC: Trimmed 7038 records to 4946 (keeping 200 days of data) [2025-10-17T18:06:09.056389] [DEBUG] [LOCAL ] CMSC: Primary data saved (4946 records). [2025-10-17T18:06:09.056480] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-17T18:06:09.056564] [INFO ] [MAIN ] Update Progress: 482/2368 symbols completed. CMSC took 25.4s. Estimated remaining: 4h 18m 35s. Rate: 7.3 symbols/min [2025-10-17T18:06:09.235301] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:09.269002] [DEBUG] [LOCAL ] CMTG: Loaded 36073 existing records from primary storage. [2025-10-17T18:06:09.269282] [INFO ] [MAIN ] CMTG: Loaded 36073 existing records. [2025-10-17T18:06:09.454956] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:09.455199] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-17T18:06:09.455255] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-17T18:06:09.455636] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-17T18:06:09.455734] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-17T18:06:09.561834] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-17T18:06:09.815734] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:10.161715] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:06:10.358006] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-17T18:06:10.599341] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T18:06:11.158088] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-17T18:06:11.958079] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-17T18:06:12.156852] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T18:06:12.193087] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T18:06:12.445255] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:06:12.758005] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-17T18:06:13.433621] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T18:06:13.558003] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-17T18:06:14.308153] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T18:06:14.357998] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-17T18:06:15.158019] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-17T18:06:15.212305] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T18:06:15.958018] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-17T18:06:16.696241] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T18:06:16.757983] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-17T18:06:16.917720] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:06:17.481313] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T18:06:17.558027] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-17T18:06:18.299683] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T18:06:18.358063] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-17T18:06:19.158075] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-17T18:06:19.760002] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T18:06:19.958109] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-17T18:06:20.533626] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T18:06:20.758032] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-17T18:06:20.814312] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T18:06:21.558031] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-17T18:06:21.800698] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T18:06:22.338929] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T18:06:22.358000] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-17T18:06:23.057797] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:06:23.059356] [INFO ] [REMOTE ] CMSD: Full fetch complete (11679 records). [2025-10-17T18:06:23.059439] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-17T18:06:23.163292] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-17T18:06:23.426156] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-17T18:06:23.426242] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-17T18:06:23.426547] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-17T18:06:23.426588] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-17T18:06:23.427181] [DEBUG] [LOCAL ] CMSD: Trimmed 11679 records to 7921 (keeping 200 days of data) [2025-10-17T18:06:23.478261] [DEBUG] [LOCAL ] CMSD: Primary data saved (7921 records). [2025-10-17T18:06:23.478407] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-17T18:06:23.478503] [INFO ] [MAIN ] Update Progress: 483/2368 symbols completed. CMSD took 17.7s. Estimated remaining: 4h 18m 51s. Rate: 7.3 symbols/min [2025-10-17T18:06:23.644562] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:23.652833] [DEBUG] [LOCAL ] CMU: Loaded 6366 existing records from primary storage. [2025-10-17T18:06:23.653023] [INFO ] [MAIN ] CMU: Loaded 6366 existing records. [2025-10-17T18:06:23.827142] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:23.827379] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-17T18:06:23.827474] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-17T18:06:23.827729] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-17T18:06:23.827807] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-17T18:06:23.966228] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-17T18:06:24.185019] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:24.758089] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-17T18:06:24.791052] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T18:06:25.558005] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-17T18:06:26.078156] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:06:26.141782] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T18:06:26.358052] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-17T18:06:27.067629] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:06:27.157987] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-17T18:06:27.871630] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:06:27.957983] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-17T18:06:28.633555] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T18:06:28.757994] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-17T18:06:29.557995] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-17T18:06:29.754197] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:06:30.073437] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:06:30.218737] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T18:06:30.358072] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-17T18:06:31.047528] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-17T18:06:31.158020] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-17T18:06:31.662801] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T18:06:31.958063] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-17T18:06:32.758059] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-17T18:06:33.323109] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:06:33.558056] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-17T18:06:34.163149] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:06:34.352261] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T18:06:34.357985] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-17T18:06:35.154665] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T18:06:35.158192] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-17T18:06:35.958066] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-17T18:06:36.556550] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T18:06:36.758088] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-17T18:06:37.032225] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:06:37.039944] [INFO ] [REMOTE ] CMS: Full fetch complete (75844 records). [2025-10-17T18:06:37.040146] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-17T18:06:37.041267] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:06:37.041371] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:06:37.041418] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:06:37.041463] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-17T18:06:37.041536] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-17T18:06:37.041590] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-17T18:06:37.041987] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-17T18:06:37.042392] [INFO ] [MAIN ] Update Progress: 484/2368 symbols completed. CMS took 53.3s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-17T18:06:37.218888] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:37.251347] [DEBUG] [LOCAL ] CNA: Loaded 33156 existing records from primary storage. [2025-10-17T18:06:37.251636] [INFO ] [MAIN ] CNA: Loaded 33156 existing records. [2025-10-17T18:06:37.426311] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:37.426536] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-17T18:06:37.426583] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-17T18:06:37.427154] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-17T18:06:37.427212] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-17T18:06:37.568317] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-17T18:06:37.784163] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:38.345721] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:06:38.357982] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-17T18:06:39.155486] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:06:39.160482] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-17T18:06:39.162235] [INFO ] [REMOTE ] CMRE: Full fetch complete (51280 records). [2025-10-17T18:06:39.162355] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-17T18:06:39.541108] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-17T18:06:39.541265] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-17T18:06:39.542064] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-17T18:06:39.542141] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-17T18:06:39.558386] [DEBUG] [LOCAL ] CMRE: Trimmed 51280 records to 36418 (keeping 200 days of data) [2025-10-17T18:06:39.559628] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T18:06:39.779576] [DEBUG] [LOCAL ] CMRE: Primary data saved (36418 records). [2025-10-17T18:06:39.779757] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-17T18:06:39.779850] [INFO ] [MAIN ] Update Progress: 485/2368 symbols completed. CMRE took 56.1s. Estimated remaining: 4h 18m 34s. Rate: 7.3 symbols/min [2025-10-17T18:06:39.884977] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T18:06:39.956804] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:39.957992] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-17T18:06:40.006836] [DEBUG] [LOCAL ] CNC: Loaded 54160 existing records from primary storage. [2025-10-17T18:06:40.007159] [INFO ] [MAIN ] CNC: Loaded 54160 existing records. [2025-10-17T18:06:40.179857] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:40.180095] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-17T18:06:40.180145] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-17T18:06:40.180638] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-17T18:06:40.180730] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-17T18:06:40.531847] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:40.757997] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-17T18:06:41.230683] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T18:06:41.558042] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-17T18:06:42.357980] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-17T18:06:42.550901] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T18:06:42.648801] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:06:43.158018] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-17T18:06:43.294803] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T18:06:43.958022] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-17T18:06:44.226132] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:06:44.758051] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-17T18:06:45.558066] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-17T18:06:45.632708] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:06:46.161414] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:06:46.234669] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T18:06:46.358020] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-17T18:06:47.158086] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-17T18:06:47.727326] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:06:47.958026] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-17T18:06:48.552399] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T18:06:48.758079] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-17T18:06:48.795381] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:06:49.558039] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-17T18:06:49.878832] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T18:06:49.883782] [INFO ] [REMOTE ] CMTG: Full fetch complete (53357 records). [2025-10-17T18:06:49.883969] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-17T18:06:50.024765] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T18:06:50.059590] [INFO ] [REMOTE ] CMU: Full fetch complete (9468 records). [2025-10-17T18:06:50.083224] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-17T18:06:50.361014] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-17T18:06:50.527618] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-17T18:06:50.532929] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-17T18:06:50.546413] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-17T18:06:50.546514] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-17T18:06:50.610303] [DEBUG] [LOCAL ] CMTG: Trimmed 53357 records to 36246 (keeping 200 days of data) [2025-10-17T18:06:50.800815] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-17T18:06:50.800903] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-17T18:06:50.801049] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-17T18:06:50.801091] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-17T18:06:50.842913] [DEBUG] [LOCAL ] CMU: Trimmed 9468 records to 6381 (keeping 200 days of data) [2025-10-17T18:06:50.925958] [DEBUG] [LOCAL ] CMTG: Primary data saved (36246 records). [2025-10-17T18:06:50.930082] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-17T18:06:50.930214] [INFO ] [MAIN ] Update Progress: 486/2368 symbols completed. CMTG took 41.9s. Estimated remaining: 4h 18m 37s. Rate: 7.3 symbols/min [2025-10-17T18:06:50.934368] [DEBUG] [LOCAL ] CMU: Primary data saved (6381 records). [2025-10-17T18:06:50.939797] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-17T18:06:50.993562] [INFO ] [MAIN ] Update Progress: 487/2368 symbols completed. CMU took 27.5s. Estimated remaining: 4h 17m 57s. Rate: 7.3 symbols/min [2025-10-17T18:06:51.168333] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-17T18:06:51.247071] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:51.293251] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:51.293499] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-17T18:06:51.293560] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-17T18:06:51.293737] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-17T18:06:51.293786] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-17T18:06:51.293830] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-17T18:06:51.293863] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-17T18:06:51.401961] [DEBUG] [LOCAL ] CNF: Loaded 10646 existing records from primary storage. [2025-10-17T18:06:51.408074] [INFO ] [MAIN ] CNF: Loaded 10646 existing records. [2025-10-17T18:06:51.817851] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:51.834241] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-17T18:06:51.834767] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-17T18:06:51.851623] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-17T18:06:51.851794] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-17T18:06:51.886683] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:51.963132] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-17T18:06:52.210465] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:52.425071] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:06:52.467776] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:06:52.758076] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-17T18:06:53.558023] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-17T18:06:53.704061] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:06:54.010292] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T18:06:54.358062] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-17T18:06:55.158038] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-17T18:06:55.237534] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T18:06:55.763400] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:06:55.958117] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-17T18:06:56.064022] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:06:56.758067] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-17T18:06:57.557990] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-17T18:06:57.640007] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:06:58.361079] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-17T18:06:58.366737] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:06:58.977311] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:06:59.163103] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-17T18:06:59.179056] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:06:59.958036] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-17T18:07:00.553323] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:07:00.758036] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-17T18:07:01.450242] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:07:01.558026] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-17T18:07:02.160126] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T18:07:02.357996] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-17T18:07:03.158011] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-17T18:07:03.252477] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:07:03.958032] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-17T18:07:04.406602] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T18:07:04.425216] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T18:07:04.429593] [INFO ] [REMOTE ] CNA: Full fetch complete (46103 records). [2025-10-17T18:07:04.429700] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-17T18:07:04.763213] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-17T18:07:04.829572] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-17T18:07:04.829723] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-17T18:07:04.830349] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-17T18:07:04.830420] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-17T18:07:04.831483] [DEBUG] [LOCAL ] CNA: Trimmed 46103 records to 33357 (keeping 200 days of data) [2025-10-17T18:07:05.065830] [DEBUG] [LOCAL ] CNA: Primary data saved (33357 records). [2025-10-17T18:07:05.066535] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-17T18:07:05.067710] [INFO ] [MAIN ] Update Progress: 488/2368 symbols completed. CNA took 28.0s. Estimated remaining: 4h 18m 11s. Rate: 7.3 symbols/min [2025-10-17T18:07:05.067553] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-17T18:07:05.247462] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:05.298961] [DEBUG] [LOCAL ] CNI: Loaded 52078 existing records from primary storage. [2025-10-17T18:07:05.299301] [INFO ] [MAIN ] CNI: Loaded 52078 existing records. [2025-10-17T18:07:05.480270] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:05.481384] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-17T18:07:05.481445] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-17T18:07:05.482344] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-17T18:07:05.482404] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-17T18:07:05.563363] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-17T18:07:05.841073] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:06.358015] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-17T18:07:06.539771] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T18:07:06.690876] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:07:07.158029] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-17T18:07:07.958079] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-17T18:07:08.346691] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-17T18:07:08.598240] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:07:08.758084] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-17T18:07:08.986095] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T18:07:09.506166] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T18:07:09.558040] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-17T18:07:10.358013] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-17T18:07:10.510811] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T18:07:11.158172] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-17T18:07:11.958112] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-17T18:07:12.236937] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T18:07:12.726049] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T18:07:12.758065] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-17T18:07:13.249825] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T18:07:13.558030] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-17T18:07:13.756196] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T18:07:14.358090] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-17T18:07:15.158071] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-17T18:07:15.345431] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T18:07:15.753537] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T18:07:15.761359] [INFO ] [REMOTE ] CNC: Full fetch complete (77849 records). [2025-10-17T18:07:15.761530] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-17T18:07:15.964950] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-17T18:07:16.164624] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-17T18:07:16.164794] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-17T18:07:16.165747] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-17T18:07:16.165835] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-17T18:07:16.167475] [DEBUG] [LOCAL ] CNC: Trimmed 77849 records to 54550 (keeping 200 days of data) [2025-10-17T18:07:16.281460] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T18:07:16.529417] [DEBUG] [LOCAL ] CNC: Primary data saved (54550 records). [2025-10-17T18:07:16.529612] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-17T18:07:16.530240] [INFO ] [MAIN ] Update Progress: 489/2368 symbols completed. CNC took 36.8s. Estimated remaining: 4h 18m 15s. Rate: 7.3 symbols/min [2025-10-17T18:07:16.694664] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:16.745295] [DEBUG] [LOCAL ] CNK: Loaded 53289 existing records from primary storage. [2025-10-17T18:07:16.745598] [INFO ] [MAIN ] CNK: Loaded 53289 existing records. [2025-10-17T18:07:16.765676] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-17T18:07:16.925176] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:16.925364] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-17T18:07:16.925410] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-17T18:07:16.925812] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-17T18:07:16.925870] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-17T18:07:17.063992] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:07:17.337943] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:17.558073] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-17T18:07:18.358119] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-17T18:07:18.593289] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T18:07:19.158135] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-17T18:07:19.341234] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:07:19.958048] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-17T18:07:20.186409] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T18:07:20.758144] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-17T18:07:20.996174] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T18:07:21.558060] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-17T18:07:21.634413] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:07:22.225613] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:07:22.358153] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-17T18:07:22.358990] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T18:07:22.361404] [INFO ] [REMOTE ] CNF: Full fetch complete (13048 records). [2025-10-17T18:07:22.361480] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-17T18:07:22.715096] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-17T18:07:22.715171] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-17T18:07:22.715470] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-17T18:07:22.715509] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-17T18:07:22.716087] [DEBUG] [LOCAL ] CNF: Trimmed 13048 records to 10666 (keeping 200 days of data) [2025-10-17T18:07:22.771743] [DEBUG] [LOCAL ] CNF: Primary data saved (10666 records). [2025-10-17T18:07:22.771870] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-17T18:07:22.771951] [INFO ] [MAIN ] Update Progress: 490/2368 symbols completed. CNF took 31.8s. Estimated remaining: 4h 17m 60s. Rate: 7.3 symbols/min [2025-10-17T18:07:22.936625] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:22.982316] [DEBUG] [LOCAL ] CNM: Loaded 51414 existing records from primary storage. [2025-10-17T18:07:22.982619] [INFO ] [MAIN ] CNM: Loaded 51414 existing records. [2025-10-17T18:07:23.161031] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:23.161170] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-17T18:07:23.161704] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-17T18:07:23.162743] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-17T18:07:23.162947] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-17T18:07:23.162993] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-17T18:07:23.509002] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:23.958086] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-17T18:07:24.069952] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T18:07:24.758061] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-17T18:07:25.059472] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:07:25.558027] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-17T18:07:25.695528] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:07:26.203726] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T18:07:26.358029] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-17T18:07:27.158062] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-17T18:07:27.320069] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:07:27.718945] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T18:07:27.958068] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-17T18:07:28.758085] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-17T18:07:29.266466] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:07:29.459073] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:07:29.558001] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-17T18:07:30.358086] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-17T18:07:30.620765] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:07:31.158029] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-17T18:07:31.300862] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:07:31.958007] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-17T18:07:32.179043] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T18:07:32.744831] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:07:32.757981] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-17T18:07:33.557997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-17T18:07:34.021942] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T18:07:34.358041] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-17T18:07:34.524881] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:07:35.014513] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:07:35.158028] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-17T18:07:35.958070] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-17T18:07:36.489879] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T18:07:36.758015] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-17T18:07:37.019535] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:07:37.454879] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:07:37.558020] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-17T18:07:38.358013] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-17T18:07:38.456205] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:07:39.158002] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-17T18:07:39.314509] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:07:39.957997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-17T18:07:40.263369] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T18:07:40.270821] [INFO ] [REMOTE ] CNH: Full fetch complete (77706 records). [2025-10-17T18:07:40.270985] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-17T18:07:40.664152] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-17T18:07:40.664252] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-17T18:07:40.665215] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-17T18:07:40.665291] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-17T18:07:40.666749] [DEBUG] [LOCAL ] CNH: Trimmed 77706 records to 54332 (keeping 200 days of data) [2025-10-17T18:07:40.760223] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-17T18:07:40.918097] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:07:41.029378] [DEBUG] [LOCAL ] CNH: Primary data saved (54332 records). [2025-10-17T18:07:41.029512] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-17T18:07:41.029583] [INFO ] [MAIN ] Update Progress: 491/2368 symbols completed. CNH took 50.0s. Estimated remaining: 4h 18m 30s. Rate: 7.3 symbols/min [2025-10-17T18:07:41.196673] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:41.227551] [DEBUG] [LOCAL ] CNMD: Loaded 32319 existing records from primary storage. [2025-10-17T18:07:41.227985] [INFO ] [MAIN ] CNMD: Loaded 32319 existing records. [2025-10-17T18:07:41.408276] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:41.408510] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-17T18:07:41.408582] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-17T18:07:41.408854] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-17T18:07:41.408931] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-17T18:07:41.565290] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-17T18:07:41.771400] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:41.804418] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T18:07:42.358055] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-17T18:07:42.747224] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:07:43.158008] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-17T18:07:43.297491] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:07:43.958009] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-17T18:07:44.197628] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:07:44.204954] [INFO ] [REMOTE ] CNK: Full fetch complete (76183 records). [2025-10-17T18:07:44.205068] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-17T18:07:44.618194] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-17T18:07:44.618271] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-17T18:07:44.619104] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-17T18:07:44.619168] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-17T18:07:44.620535] [DEBUG] [LOCAL ] CNK: Trimmed 76183 records to 53677 (keeping 200 days of data) [2025-10-17T18:07:44.793891] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-17T18:07:44.943070] [DEBUG] [LOCAL ] CNK: Primary data saved (53677 records). [2025-10-17T18:07:44.943200] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-17T18:07:44.943730] [INFO ] [MAIN ] Update Progress: 492/2368 symbols completed. CNK took 28.4s. Estimated remaining: 4h 18m 5s. Rate: 7.3 symbols/min [2025-10-17T18:07:45.117303] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:45.138521] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T18:07:45.146585] [INFO ] [REMOTE ] CNI: Full fetch complete (74866 records). [2025-10-17T18:07:45.146917] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-17T18:07:45.307476] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:07:45.427323] [DEBUG] [LOCAL ] CNNE: Loaded 36234 existing records from primary storage. [2025-10-17T18:07:45.472488] [INFO ] [MAIN ] CNNE: Loaded 36234 existing records. [2025-10-17T18:07:45.562248] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-17T18:07:45.780591] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-17T18:07:45.780355] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:45.780823] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-17T18:07:45.781910] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-17T18:07:45.782060] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-17T18:07:45.781993] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-17T18:07:45.782357] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-17T18:07:45.782568] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-17T18:07:45.782623] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-17T18:07:45.873179] [DEBUG] [LOCAL ] CNI: Trimmed 74866 records to 52456 (keeping 200 days of data) [2025-10-17T18:07:46.247869] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:46.358282] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-17T18:07:46.465607] [DEBUG] [LOCAL ] CNI: Primary data saved (52456 records). [2025-10-17T18:07:46.465775] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-17T18:07:46.466632] [INFO ] [MAIN ] Update Progress: 493/2368 symbols completed. CNI took 41.4s. Estimated remaining: 4h 17m 31s. Rate: 7.3 symbols/min [2025-10-17T18:07:46.645381] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:46.695628] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:07:46.719498] [DEBUG] [LOCAL ] CNO: Loaded 40958 existing records from primary storage. [2025-10-17T18:07:46.719936] [INFO ] [MAIN ] CNO: Loaded 40958 existing records. [2025-10-17T18:07:46.902894] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:46.903217] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-17T18:07:46.903303] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-17T18:07:46.903750] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-17T18:07:46.903810] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-17T18:07:47.172255] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-17T18:07:47.201224] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:07:47.286595] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:47.550257] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T18:07:47.958053] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-17T18:07:48.758136] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-17T18:07:49.013833] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T18:07:49.084003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T18:07:49.558025] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-17T18:07:49.967555] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:07:50.358020] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-17T18:07:51.158007] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-17T18:07:51.496550] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T18:07:51.504285] [INFO ] [REMOTE ] CNM: Full fetch complete (73760 records). [2025-10-17T18:07:51.504603] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-17T18:07:51.824436] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:07:51.958690] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-17T18:07:51.959933] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-17T18:07:51.960029] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-17T18:07:51.961033] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-17T18:07:51.961203] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-17T18:07:51.963256] [DEBUG] [LOCAL ] CNM: Trimmed 73760 records to 51797 (keeping 200 days of data) [2025-10-17T18:07:52.103669] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:07:52.299600] [DEBUG] [LOCAL ] CNM: Primary data saved (51797 records). [2025-10-17T18:07:52.299791] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-17T18:07:52.299929] [INFO ] [MAIN ] Update Progress: 494/2368 symbols completed. CNM took 29.5s. Estimated remaining: 4h 17m 13s. Rate: 7.3 symbols/min [2025-10-17T18:07:52.477201] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:52.529158] [DEBUG] [LOCAL ] CNP: Loaded 53869 existing records from primary storage. [2025-10-17T18:07:52.529484] [INFO ] [MAIN ] CNP: Loaded 53869 existing records. [2025-10-17T18:07:52.716126] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:52.716333] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-17T18:07:52.716380] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-17T18:07:52.716795] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-17T18:07:52.716851] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-17T18:07:52.769573] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-17T18:07:53.077200] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:53.563175] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-17T18:07:53.581103] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:07:54.285485] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:07:54.357984] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-17T18:07:55.112786] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T18:07:55.157981] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-17T18:07:55.822300] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T18:07:55.958042] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-17T18:07:56.672024] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:07:56.758006] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-17T18:07:57.558049] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-17T18:07:57.747561] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T18:07:58.275123] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T18:07:58.358028] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-17T18:07:59.163377] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-17T18:07:59.165790] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T18:07:59.637192] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T18:07:59.958080] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-17T18:08:00.758091] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-17T18:08:00.997550] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:08:01.565187] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-17T18:08:01.587583] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:08:02.000777] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:08:02.358032] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-17T18:08:03.158056] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-17T18:08:03.432447] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T18:08:03.958075] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-17T18:08:04.001040] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:08:04.680033] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T18:08:04.758007] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-17T18:08:05.130187] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T18:08:05.558062] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-17T18:08:06.148812] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:08:06.358064] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-17T18:08:07.105957] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:08:07.158006] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-17T18:08:07.737305] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:08:07.958034] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-17T18:08:08.023131] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T18:08:08.758027] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-17T18:08:09.558007] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-17T18:08:09.851708] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:08:09.856429] [INFO ] [REMOTE ] CNNE: Full fetch complete (50317 records). [2025-10-17T18:08:09.856548] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-17T18:08:09.857374] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:08:09.857484] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:08:09.857548] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:08:09.857622] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-17T18:08:09.857732] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-17T18:08:09.857781] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-17T18:08:09.857914] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-10-17T18:08:09.858259] [INFO ] [MAIN ] Update Progress: 495/2368 symbols completed. CNNE took 24.9s. Estimated remaining: 4h 17m 41s. Rate: 7.3 symbols/min [2025-10-17T18:08:10.025701] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:10.075962] [DEBUG] [LOCAL ] CNQ: Loaded 53972 existing records from primary storage. [2025-10-17T18:08:10.076305] [INFO ] [MAIN ] CNQ: Loaded 53972 existing records. [2025-10-17T18:08:10.252449] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:10.252662] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-17T18:08:10.252722] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-17T18:08:10.253058] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-17T18:08:10.253097] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-17T18:08:10.361306] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-17T18:08:10.651131] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:10.692058] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:08:10.947179] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T18:08:11.158039] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-17T18:08:11.341995] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T18:08:11.346603] [INFO ] [REMOTE ] CNMD: Full fetch complete (47197 records). [2025-10-17T18:08:11.346727] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-17T18:08:11.755838] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-17T18:08:11.755923] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-17T18:08:11.756663] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-17T18:08:11.756748] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-17T18:08:11.757862] [DEBUG] [LOCAL ] CNMD: Trimmed 47197 records to 32497 (keeping 200 days of data) [2025-10-17T18:08:11.958518] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-17T18:08:11.969427] [DEBUG] [LOCAL ] CNMD: Primary data saved (32497 records). [2025-10-17T18:08:11.969584] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-17T18:08:11.969801] [INFO ] [MAIN ] Update Progress: 496/2368 symbols completed. CNMD took 30.9s. Estimated remaining: 4h 17m 9s. Rate: 7.3 symbols/min [2025-10-17T18:08:12.140414] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:12.140586] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-17T18:08:12.140625] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-17T18:08:12.140775] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-17T18:08:12.140845] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-17T18:08:12.140905] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-17T18:08:12.140950] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-17T18:08:12.508033] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:12.758014] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-17T18:08:12.939145] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:08:13.502606] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:08:13.558076] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-17T18:08:13.763575] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:08:13.764118] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-17T18:08:13.764221] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:08:13.764324] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-17T18:08:13.764393] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:08:13.764473] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-17T18:08:13.764549] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-17T18:08:13.764590] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-17T18:08:13.764629] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-17T18:08:13.764725] [INFO ] [MAIN ] Update Progress: 497/2368 symbols completed. CNR took 1.8s. Estimated remaining: 4h 16m 37s. Rate: 7.3 symbols/min [2025-10-17T18:08:13.959470] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:13.983160] [DEBUG] [LOCAL ] CNS: Loaded 21369 existing records from primary storage. [2025-10-17T18:08:13.983572] [INFO ] [MAIN ] CNS: Loaded 21369 existing records. [2025-10-17T18:08:14.178670] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:14.179012] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-17T18:08:14.179066] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-17T18:08:14.179294] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-17T18:08:14.179352] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-17T18:08:14.358481] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-17T18:08:14.581145] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:14.608484] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T18:08:15.158085] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-17T18:08:15.955669] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:08:15.965417] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-17T18:08:16.021443] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T18:08:16.758074] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-17T18:08:17.558048] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-17T18:08:17.843403] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T18:08:18.358092] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-17T18:08:18.490266] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:08:18.627168] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T18:08:19.158156] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-17T18:08:19.958003] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-17T18:08:20.081471] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:08:20.758011] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-17T18:08:21.036407] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T18:08:21.078618] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T18:08:21.558044] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-17T18:08:22.358102] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-17T18:08:22.774982] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:08:22.802502] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T18:08:23.158079] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-17T18:08:23.518156] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T18:08:23.958010] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-17T18:08:24.758041] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-17T18:08:24.985825] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T18:08:25.557999] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-17T18:08:25.658719] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:08:25.726889] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:08:26.358057] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-17T18:08:27.019852] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:08:27.158032] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-17T18:08:27.831216] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T18:08:27.958037] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-17T18:08:28.758005] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-17T18:08:28.929331] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T18:08:28.936921] [INFO ] [REMOTE ] CNP: Full fetch complete (77551 records). [2025-10-17T18:08:28.937102] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-17T18:08:29.327782] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-17T18:08:29.327861] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-17T18:08:29.328765] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-17T18:08:29.328829] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-17T18:08:29.330234] [DEBUG] [LOCAL ] CNP: Trimmed 77551 records to 54258 (keeping 200 days of data) [2025-10-17T18:08:29.558813] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-17T18:08:29.652717] [DEBUG] [LOCAL ] CNP: Primary data saved (54258 records). [2025-10-17T18:08:29.652856] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-17T18:08:29.652939] [INFO ] [MAIN ] Update Progress: 498/2368 symbols completed. CNP took 37.4s. Estimated remaining: 4h 16m 57s. Rate: 7.3 symbols/min [2025-10-17T18:08:29.821880] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:29.874598] [DEBUG] [LOCAL ] CNX: Loaded 51742 existing records from primary storage. [2025-10-17T18:08:29.875222] [INFO ] [MAIN ] CNX: Loaded 51742 existing records. [2025-10-17T18:08:30.056687] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:30.057277] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-17T18:08:30.057386] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-17T18:08:30.058118] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-17T18:08:30.058231] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-17T18:08:30.292936] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T18:08:30.297861] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-17T18:08:30.369810] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-17T18:08:30.500911] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:30.693067] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T18:08:31.158036] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-17T18:08:31.958023] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-17T18:08:32.058618] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:08:32.065275] [INFO ] [REMOTE ] CNO: Full fetch complete (60863 records). [2025-10-17T18:08:32.065481] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-17T18:08:32.362305] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:08:32.518857] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-17T18:08:32.518989] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-17T18:08:32.520104] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-17T18:08:32.520172] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-17T18:08:32.522030] [DEBUG] [LOCAL ] CNO: Trimmed 60863 records to 41237 (keeping 200 days of data) [2025-10-17T18:08:32.759904] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-17T18:08:32.799340] [DEBUG] [LOCAL ] CNO: Primary data saved (41237 records). [2025-10-17T18:08:32.799539] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-17T18:08:32.800529] [INFO ] [MAIN ] Update Progress: 499/2368 symbols completed. CNO took 46.3s. Estimated remaining: 4h 16m 30s. Rate: 7.3 symbols/min [2025-10-17T18:08:32.977773] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:33.023792] [DEBUG] [LOCAL ] CODI: Loaded 41807 existing records from primary storage. [2025-10-17T18:08:33.024048] [INFO ] [MAIN ] CODI: Loaded 41807 existing records. [2025-10-17T18:08:33.200660] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:33.200862] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-17T18:08:33.200909] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-17T18:08:33.201282] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-17T18:08:33.201338] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-17T18:08:33.556861] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:33.557978] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-17T18:08:33.632717] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T18:08:33.846058] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:08:34.358060] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-17T18:08:34.605039] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T18:08:35.158059] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-17T18:08:35.957998] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-17T18:08:36.325478] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:08:36.758086] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-17T18:08:37.030033] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T18:08:37.055899] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:08:37.558071] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-17T18:08:38.357989] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-17T18:08:38.642057] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T18:08:38.814491] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T18:08:39.158015] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-17T18:08:39.957998] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-17T18:08:40.199368] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T18:08:40.234054] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T18:08:40.758066] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-17T18:08:41.558078] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-17T18:08:41.755530] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T18:08:41.865553] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T18:08:42.358101] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-17T18:08:42.894771] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T18:08:43.158059] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-17T18:08:43.360077] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T18:08:43.958074] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-17T18:08:44.377879] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T18:08:44.758078] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-17T18:08:45.558017] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-17T18:08:45.622536] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T18:08:46.064490] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:08:46.068338] [INFO ] [REMOTE ] CNS: Full fetch complete (30777 records). [2025-10-17T18:08:46.068431] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-17T18:08:46.068999] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:08:46.069098] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:08:46.069187] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:08:46.069281] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-17T18:08:46.069369] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-17T18:08:46.069411] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-17T18:08:46.069592] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-17T18:08:46.069712] [INFO ] [MAIN ] Update Progress: 500/2368 symbols completed. CNS took 32.3s. Estimated remaining: 4h 16m 40s. Rate: 7.3 symbols/min [2025-10-17T18:08:46.239196] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:46.288488] [DEBUG] [LOCAL ] COF: Loaded 54012 existing records from primary storage. [2025-10-17T18:08:46.288831] [INFO ] [MAIN ] COF: Loaded 54012 existing records. [2025-10-17T18:08:46.363146] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-17T18:08:46.465467] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:46.465712] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-17T18:08:46.465771] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-17T18:08:46.465959] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-17T18:08:46.466006] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-17T18:08:46.809262] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:47.104150] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:08:47.157990] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-17T18:08:47.921093] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:08:47.957995] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-17T18:08:48.758020] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-17T18:08:49.229543] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T18:08:49.558013] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-17T18:08:49.929579] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T18:08:49.936950] [INFO ] [REMOTE ] CNQ: Full fetch complete (77740 records). [2025-10-17T18:08:49.937078] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-17T18:08:50.342277] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-17T18:08:50.342432] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-17T18:08:50.343383] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-17T18:08:50.343501] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-17T18:08:50.345173] [DEBUG] [LOCAL ] CNQ: Trimmed 77740 records to 54362 (keeping 200 days of data) [2025-10-17T18:08:50.398835] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-17T18:08:50.484129] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:08:50.721788] [DEBUG] [LOCAL ] CNQ: Primary data saved (54362 records). [2025-10-17T18:08:50.721941] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-17T18:08:50.722525] [INFO ] [MAIN ] Update Progress: 501/2368 symbols completed. CNQ took 40.9s. Estimated remaining: 4h 16m 19s. Rate: 7.3 symbols/min [2025-10-17T18:08:50.919324] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:50.919532] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-17T18:08:50.919570] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-17T18:08:50.919717] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-17T18:08:50.919766] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-17T18:08:50.919808] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-17T18:08:50.919839] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-17T18:08:51.163431] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-17T18:08:51.277875] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:51.855632] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T18:08:51.958045] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-17T18:08:52.511990] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:08:52.758053] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-17T18:08:52.931237] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:08:53.558048] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-17T18:08:53.983964] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-17T18:08:54.358085] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-17T18:08:54.783822] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T18:08:54.845061] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:08:55.158100] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-17T18:08:55.958098] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-17T18:08:56.162767] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T18:08:56.758087] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-17T18:08:56.877389] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:08:57.557999] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-17T18:08:57.657911] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T18:08:58.358036] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-17T18:08:58.783966] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T18:08:59.158007] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-17T18:08:59.562849] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T18:08:59.958050] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-17T18:09:00.168273] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:09:00.174818] [INFO ] [REMOTE ] CODI: Full fetch complete (53111 records). [2025-10-17T18:09:00.174972] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-17T18:09:00.559403] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-17T18:09:00.559530] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-17T18:09:00.560284] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-17T18:09:00.560349] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-17T18:09:00.561565] [DEBUG] [LOCAL ] CODI: Trimmed 53111 records to 42174 (keeping 200 days of data) [2025-10-17T18:09:00.758909] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-17T18:09:00.796017] [DEBUG] [LOCAL ] CODI: Primary data saved (42174 records). [2025-10-17T18:09:00.796152] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-17T18:09:00.796616] [INFO ] [MAIN ] Update Progress: 502/2368 symbols completed. CODI took 28.0s. Estimated remaining: 4h 16m 17s. Rate: 7.3 symbols/min [2025-10-17T18:09:00.973789] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:01.025937] [DEBUG] [LOCAL ] COLD: Loaded 52781 existing records from primary storage. [2025-10-17T18:09:01.026241] [INFO ] [MAIN ] COLD: Loaded 52781 existing records. [2025-10-17T18:09:01.230944] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:01.231392] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-17T18:09:01.231452] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-17T18:09:01.231803] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-17T18:09:01.231863] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-17T18:09:01.610331] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:01.610890] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-17T18:09:01.646754] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T18:09:02.270319] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-17T18:09:02.358057] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-17T18:09:03.158062] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-17T18:09:03.360263] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-17T18:09:03.958022] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-17T18:09:04.421030] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-17T18:09:04.628742] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-17T18:09:04.758118] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-17T18:09:05.131308] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:09:05.558042] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-17T18:09:05.742903] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:09:06.358022] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-17T18:09:06.864677] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:09:07.158015] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-17T18:09:07.694222] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T18:09:07.922915] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:09:07.957993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-17T18:09:08.758025] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-17T18:09:09.209397] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T18:09:09.558062] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-17T18:09:09.645798] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:09:10.358096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-17T18:09:10.648006] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T18:09:11.158071] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-17T18:09:11.311777] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T18:09:11.958047] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-17T18:09:12.123668] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:09:12.758006] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-17T18:09:12.906359] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:09:12.916318] [INFO ] [REMOTE ] CNX: Full fetch complete (74923 records). [2025-10-17T18:09:12.916487] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-17T18:09:13.319399] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-17T18:09:13.319733] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-17T18:09:13.320580] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-17T18:09:13.320627] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-17T18:09:13.322071] [DEBUG] [LOCAL ] CNX: Trimmed 74923 records to 52093 (keeping 200 days of data) [2025-10-17T18:09:13.577730] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-17T18:09:13.620827] [DEBUG] [LOCAL ] CNX: Primary data saved (52093 records). [2025-10-17T18:09:13.620934] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-17T18:09:13.621010] [INFO ] [MAIN ] Update Progress: 503/2368 symbols completed. CNX took 44.0s. Estimated remaining: 4h 16m 26s. Rate: 7.3 symbols/min [2025-10-17T18:09:13.793357] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:13.843230] [DEBUG] [LOCAL ] COMP: Loaded 53796 existing records from primary storage. [2025-10-17T18:09:13.843566] [INFO ] [MAIN ] COMP: Loaded 53796 existing records. [2025-10-17T18:09:14.026602] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:14.026920] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-17T18:09:14.027056] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-17T18:09:14.027964] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-17T18:09:14.028028] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-17T18:09:14.432601] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-17T18:09:14.431008] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:14.443320] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-17T18:09:14.471615] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T18:09:15.158023] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-17T18:09:15.808673] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T18:09:15.957999] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-17T18:09:16.083222] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T18:09:16.758084] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-17T18:09:17.490204] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T18:09:17.497925] [INFO ] [REMOTE ] COF: Full fetch complete (77661 records). [2025-10-17T18:09:17.498099] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-17T18:09:17.565157] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-17T18:09:17.909892] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-17T18:09:17.910035] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-17T18:09:17.911031] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-17T18:09:17.911151] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-17T18:09:17.912740] [DEBUG] [LOCAL ] COF: Trimmed 77661 records to 54402 (keeping 200 days of data) [2025-10-17T18:09:18.060995] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T18:09:18.308172] [DEBUG] [LOCAL ] COF: Primary data saved (54402 records). [2025-10-17T18:09:18.308390] [INFO ] [MAIN ] COF: Full history saved. [2025-10-17T18:09:18.309553] [INFO ] [MAIN ] Update Progress: 504/2368 symbols completed. COF took 32.2s. Estimated remaining: 4h 16m 5s. Rate: 7.3 symbols/min [2025-10-17T18:09:18.363775] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-17T18:09:18.502557] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:18.536736] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T18:09:18.578485] [DEBUG] [LOCAL ] CON: Loaded 39243 existing records from primary storage. [2025-10-17T18:09:18.578835] [INFO ] [MAIN ] CON: Loaded 39243 existing records. [2025-10-17T18:09:18.776743] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:18.776973] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-17T18:09:18.777021] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-17T18:09:18.777233] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-17T18:09:18.777289] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-17T18:09:19.128967] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:19.157988] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-17T18:09:19.353669] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T18:09:19.958071] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-17T18:09:20.625323] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T18:09:20.758001] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-17T18:09:20.800076] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T18:09:21.547595] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T18:09:21.557994] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-17T18:09:22.358054] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-17T18:09:22.910134] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-17T18:09:22.918041] [INFO ] [REMOTE ] COHR: Full fetch complete (77056 records). [2025-10-17T18:09:22.918148] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-17T18:09:22.919043] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:09:22.919131] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:09:22.919174] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:09:22.919240] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-17T18:09:22.919305] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-17T18:09:22.919341] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-17T18:09:22.919380] [DEBUG] [LOCAL ] COHR: No derivative data file found to delete. [2025-10-17T18:09:22.919438] [INFO ] [MAIN ] Update Progress: 505/2368 symbols completed. COHR took 32.2s. Estimated remaining: 4h 15m 43s. Rate: 7.3 symbols/min [2025-10-17T18:09:23.100206] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:23.130809] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:09:23.159479] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-17T18:09:23.160135] [DEBUG] [LOCAL ] COOK: Loaded 25126 existing records from primary storage. [2025-10-17T18:09:23.161434] [INFO ] [MAIN ] COOK: Loaded 25126 existing records. [2025-10-17T18:09:23.336472] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:23.336791] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-17T18:09:23.336841] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-17T18:09:23.337013] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-17T18:09:23.337066] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-17T18:09:23.692151] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:23.958088] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-17T18:09:24.350396] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:09:24.758002] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-17T18:09:25.032076] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:09:25.194838] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T18:09:25.558057] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-17T18:09:26.265323] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:09:26.358101] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-17T18:09:26.907703] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T18:09:27.093005] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:09:27.158040] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-17T18:09:27.958046] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-17T18:09:28.026411] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:09:28.758034] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-17T18:09:29.413140] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T18:09:29.558035] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-17T18:09:29.825754] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:09:30.358087] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-17T18:09:31.042662] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T18:09:31.158050] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-17T18:09:31.958041] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-17T18:09:32.071618] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T18:09:32.245090] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T18:09:32.758047] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-17T18:09:33.558096] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-17T18:09:33.809510] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T18:09:33.994058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T18:09:34.358040] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-17T18:09:35.158008] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-17T18:09:35.449604] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:09:35.772769] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:09:35.958034] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-17T18:09:36.280458] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T18:09:36.758022] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-17T18:09:37.051408] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:09:37.558024] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-17T18:09:38.357999] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-17T18:09:38.439581] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T18:09:38.702839] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T18:09:39.158033] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-17T18:09:39.958035] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-17T18:09:40.539970] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:09:40.629282] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T18:09:40.636153] [INFO ] [REMOTE ] COLD: Full fetch complete (74371 records). [2025-10-17T18:09:40.636311] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-17T18:09:40.637080] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:09:40.637170] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:09:40.637214] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:09:40.637253] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-17T18:09:40.637310] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-17T18:09:40.637345] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-17T18:09:40.637498] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-17T18:09:40.637959] [INFO ] [MAIN ] Update Progress: 506/2368 symbols completed. COLD took 39.8s. Estimated remaining: 4h 16m 10s. Rate: 7.3 symbols/min [2025-10-17T18:09:40.763113] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-17T18:09:40.807006] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:40.864804] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-17T18:09:40.865194] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-10-17T18:09:41.041043] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:41.041288] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-17T18:09:41.041346] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-17T18:09:41.041706] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-17T18:09:41.041767] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-17T18:09:41.403222] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:41.426803] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:09:41.558038] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-17T18:09:42.364790] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-17T18:09:42.371095] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:09:42.798344] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T18:09:42.802416] [INFO ] [REMOTE ] COOK: Full fetch complete (33135 records). [2025-10-17T18:09:42.802496] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-17T18:09:43.167786] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-17T18:09:43.182584] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-17T18:09:43.182685] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-17T18:09:43.183278] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-17T18:09:43.183339] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-17T18:09:43.184205] [DEBUG] [LOCAL ] COOK: Trimmed 33135 records to 25238 (keeping 200 days of data) [2025-10-17T18:09:43.318887] [DEBUG] [LOCAL ] COOK: Primary data saved (25238 records). [2025-10-17T18:09:43.319022] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-17T18:09:43.319118] [INFO ] [MAIN ] Update Progress: 507/2368 symbols completed. COOK took 20.4s. Estimated remaining: 4h 15m 41s. Rate: 7.3 symbols/min [2025-10-17T18:09:43.515596] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:43.559283] [DEBUG] [LOCAL ] COR: Loaded 46937 existing records from primary storage. [2025-10-17T18:09:43.559576] [INFO ] [MAIN ] COR: Loaded 46937 existing records. [2025-10-17T18:09:43.737232] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:43.737500] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-17T18:09:43.737676] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-17T18:09:43.737945] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-17T18:09:43.738099] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-17T18:09:43.961531] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-17T18:09:44.059812] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:09:44.128831] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:44.758122] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-17T18:09:45.049596] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:09:45.558029] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-17T18:09:45.921248] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:09:46.104839] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T18:09:46.358040] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-17T18:09:47.157987] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-17T18:09:47.518108] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:09:47.777311] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T18:09:47.958073] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-17T18:09:48.575678] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:09:48.758064] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-17T18:09:49.558017] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-17T18:09:49.768923] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T18:09:50.358008] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-17T18:09:50.455412] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:09:50.463092] [INFO ] [REMOTE ] COMP: Full fetch complete (77399 records). [2025-10-17T18:09:50.463269] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-17T18:09:50.866091] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-17T18:09:50.866239] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-17T18:09:50.867115] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-17T18:09:50.867178] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-17T18:09:50.889068] [DEBUG] [LOCAL ] COMP: Trimmed 77399 records to 54186 (keeping 200 days of data) [2025-10-17T18:09:50.890397] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T18:09:51.158056] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-17T18:09:51.209533] [DEBUG] [LOCAL ] COMP: Primary data saved (54186 records). [2025-10-17T18:09:51.209698] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-17T18:09:51.209796] [INFO ] [MAIN ] Update Progress: 508/2368 symbols completed. COMP took 37.6s. Estimated remaining: 4h 15m 31s. Rate: 7.3 symbols/min [2025-10-17T18:09:51.381888] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:51.433204] [DEBUG] [LOCAL ] COTY: Loaded 53658 existing records from primary storage. [2025-10-17T18:09:51.433607] [INFO ] [MAIN ] COTY: Loaded 53658 existing records. [2025-10-17T18:09:51.622917] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:51.623181] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-17T18:09:51.623364] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-17T18:09:51.623712] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-17T18:09:51.623784] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-17T18:09:51.960082] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-17T18:09:51.961500] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:09:52.030907] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:52.758053] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-17T18:09:53.136189] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T18:09:53.201163] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T18:09:53.558002] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-17T18:09:54.358032] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-17T18:09:54.662553] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T18:09:55.158044] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-17T18:09:55.210429] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T18:09:55.958060] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-17T18:09:56.449471] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T18:09:56.758007] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-17T18:09:56.873702] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T18:09:57.558059] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-17T18:09:57.736201] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T18:09:57.950205] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T18:09:57.955914] [INFO ] [REMOTE ] CON: Full fetch complete (56897 records). [2025-10-17T18:09:57.956044] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-17T18:09:58.344177] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-17T18:09:58.344272] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-17T18:09:58.345079] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-17T18:09:58.345145] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-17T18:09:58.346538] [DEBUG] [LOCAL ] CON: Trimmed 56897 records to 39523 (keeping 200 days of data) [2025-10-17T18:09:58.398334] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-17T18:09:58.581842] [DEBUG] [LOCAL ] CON: Primary data saved (39523 records). [2025-10-17T18:09:58.582001] [INFO ] [MAIN ] CON: Full history saved. [2025-10-17T18:09:58.582110] [INFO ] [MAIN ] Update Progress: 509/2368 symbols completed. CON took 40.3s. Estimated remaining: 4h 15m 20s. Rate: 7.3 symbols/min [2025-10-17T18:09:58.750197] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:58.796679] [DEBUG] [LOCAL ] COUR: Loaded 49681 existing records from primary storage. [2025-10-17T18:09:58.796996] [INFO ] [MAIN ] COUR: Loaded 49681 existing records. [2025-10-17T18:09:58.977276] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:58.977737] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-17T18:09:58.977813] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-17T18:09:58.978126] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-17T18:09:58.978289] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-17T18:09:59.155696] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:09:59.158094] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-17T18:09:59.372839] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:59.958043] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-17T18:10:00.265273] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:10:00.758059] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-17T18:10:01.558018] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-17T18:10:01.645793] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-17T18:10:01.910173] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T18:10:02.358050] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-17T18:10:03.158048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-17T18:10:03.247034] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-17T18:10:03.683059] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T18:10:03.958060] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-17T18:10:04.461579] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-17T18:10:04.758025] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-17T18:10:05.242584] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T18:10:05.558002] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-17T18:10:05.597967] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:10:06.358032] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-17T18:10:06.683676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:10:07.158027] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-17T18:10:07.875677] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-17T18:10:07.963124] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-17T18:10:07.982801] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:10:08.758001] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-17T18:10:09.016591] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T18:10:09.557996] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-17T18:10:09.899363] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T18:10:10.358027] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-17T18:10:10.598596] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T18:10:11.122866] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T18:10:11.158070] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-17T18:10:11.958029] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-17T18:10:12.261318] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T18:10:12.758049] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-17T18:10:12.818133] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:10:13.550291] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:10:13.560853] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-17T18:10:14.358067] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-17T18:10:14.743883] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T18:10:15.158064] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-17T18:10:15.405359] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T18:10:15.958093] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-17T18:10:16.004881] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:10:16.758059] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-17T18:10:16.803841] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T18:10:17.558087] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-17T18:10:17.620419] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T18:10:18.055512] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T18:10:18.063070] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-17T18:10:18.063236] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-17T18:10:18.363265] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-17T18:10:18.452176] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-17T18:10:18.452256] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-17T18:10:18.453129] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-17T18:10:18.453192] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-17T18:10:18.454801] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54507 (keeping 200 days of data) [2025-10-17T18:10:18.696452] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T18:10:18.816537] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-17T18:10:18.816750] [INFO ] [MAIN ] COP: Full history saved. [2025-10-17T18:10:18.817265] [INFO ] [MAIN ] Update Progress: 510/2368 symbols completed. COP took 38.2s. Estimated remaining: 4h 15m 55s. Rate: 7.3 symbols/min [2025-10-17T18:10:18.980618] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:19.030735] [DEBUG] [LOCAL ] CP: Loaded 53628 existing records from primary storage. [2025-10-17T18:10:19.031063] [INFO ] [MAIN ] CP: Loaded 53628 existing records. [2025-10-17T18:10:19.166837] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-17T18:10:19.206629] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:19.206863] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-17T18:10:19.206908] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-17T18:10:19.207348] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-17T18:10:19.207404] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-17T18:10:19.551466] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:19.888862] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T18:10:19.958016] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-17T18:10:20.763136] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-17T18:10:20.782607] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T18:10:21.558104] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-17T18:10:21.597805] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T18:10:22.358002] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-17T18:10:22.707742] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:10:23.157997] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-17T18:10:23.382564] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:10:23.957992] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-17T18:10:24.060296] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:10:24.066429] [INFO ] [REMOTE ] COR: Full fetch complete (68573 records). [2025-10-17T18:10:24.066577] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-17T18:10:24.447281] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-17T18:10:24.447377] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-17T18:10:24.448343] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-17T18:10:24.448407] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-17T18:10:24.449783] [DEBUG] [LOCAL ] COR: Trimmed 68573 records to 47244 (keeping 200 days of data) [2025-10-17T18:10:24.737806] [DEBUG] [LOCAL ] COR: Primary data saved (47244 records). [2025-10-17T18:10:24.737934] [INFO ] [MAIN ] COR: Full history saved. [2025-10-17T18:10:24.738465] [INFO ] [MAIN ] Update Progress: 511/2368 symbols completed. COR took 41.4s. Estimated remaining: 4h 15m 39s. Rate: 7.3 symbols/min [2025-10-17T18:10:24.792930] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-17T18:10:24.910912] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:10:24.927341] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:24.934405] [INFO ] [REMOTE ] COTY: Full fetch complete (76911 records). [2025-10-17T18:10:24.934497] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-17T18:10:24.935205] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:10:24.935394] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:10:24.935463] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:10:24.935536] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-17T18:10:24.935601] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-17T18:10:24.935666] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-17T18:10:24.935853] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-17T18:10:24.935969] [INFO ] [MAIN ] Update Progress: 512/2368 symbols completed. COTY took 33.7s. Estimated remaining: 4h 15m 1s. Rate: 7.3 symbols/min [2025-10-17T18:10:25.118865] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:25.119030] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-17T18:10:25.119072] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-17T18:10:25.119182] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-17T18:10:25.119247] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-17T18:10:25.119335] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-17T18:10:25.119393] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-17T18:10:25.202504] [DEBUG] [LOCAL ] CPA: Loaded 28578 existing records from primary storage. [2025-10-17T18:10:25.229971] [INFO ] [MAIN ] CPA: Loaded 28578 existing records. [2025-10-17T18:10:25.576902] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:25.577298] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-17T18:10:25.577356] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-17T18:10:25.590575] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-17T18:10:25.617046] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-17T18:10:25.689546] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:25.716250] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-17T18:10:25.980039] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-17T18:10:26.122354] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:26.357991] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-17T18:10:26.453402] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T18:10:26.456380] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T18:10:27.158100] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-17T18:10:27.532745] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T18:10:27.958058] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-17T18:10:28.022114] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T18:10:28.758041] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-17T18:10:29.479790] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:10:29.558019] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-17T18:10:30.200197] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T18:10:30.358028] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-17T18:10:30.805271] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:10:31.158035] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-17T18:10:31.958028] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-17T18:10:32.174700] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:10:32.758019] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-17T18:10:32.851201] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:10:32.925542] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:10:33.558033] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-17T18:10:34.357994] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-17T18:10:34.647089] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-17T18:10:34.683881] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:10:34.714880] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:10:35.158017] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-17T18:10:35.958045] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-17T18:10:36.321063] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T18:10:36.758009] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-17T18:10:37.167111] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T18:10:37.174099] [INFO ] [REMOTE ] COUR: Full fetch complete (71079 records). [2025-10-17T18:10:37.174222] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-17T18:10:37.551159] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-17T18:10:37.551240] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-17T18:10:37.552055] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-17T18:10:37.552120] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-17T18:10:37.553441] [DEBUG] [LOCAL ] COUR: Trimmed 71079 records to 50057 (keeping 200 days of data) [2025-10-17T18:10:37.602813] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-17T18:10:37.847685] [DEBUG] [LOCAL ] COUR: Primary data saved (50057 records). [2025-10-17T18:10:37.847823] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-17T18:10:37.847903] [INFO ] [MAIN ] Update Progress: 513/2368 symbols completed. COUR took 39.3s. Estimated remaining: 4h 15m 10s. Rate: 7.3 symbols/min [2025-10-17T18:10:38.020689] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:38.041056] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T18:10:38.074287] [DEBUG] [LOCAL ] CPAY: Loaded 30724 existing records from primary storage. [2025-10-17T18:10:38.074546] [INFO ] [MAIN ] CPAY: Loaded 30724 existing records. [2025-10-17T18:10:38.249555] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:38.249799] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-17T18:10:38.249849] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-17T18:10:38.250130] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-17T18:10:38.250188] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-17T18:10:38.363143] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-17T18:10:38.602601] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:39.001672] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T18:10:39.112291] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:10:39.157994] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-17T18:10:39.958097] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-17T18:10:40.632392] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T18:10:40.757991] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-17T18:10:41.435959] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:10:41.557989] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-17T18:10:41.762621] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:10:42.358049] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-17T18:10:42.697257] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-17T18:10:43.158030] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-17T18:10:43.330782] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:10:43.536511] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-17T18:10:43.958078] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-17T18:10:44.758087] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-17T18:10:45.216707] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:10:45.558059] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-17T18:10:46.298095] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T18:10:46.358059] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-17T18:10:46.914471] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:10:47.158062] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-17T18:10:47.958010] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-17T18:10:48.309356] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:10:48.311773] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T18:10:48.572350] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T18:10:48.758090] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-17T18:10:49.558020] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-17T18:10:50.358013] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-17T18:10:50.582487] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:10:50.590192] [INFO ] [REMOTE ] CP: Full fetch complete (77303 records). [2025-10-17T18:10:50.590321] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-17T18:10:50.780612] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T18:10:51.006944] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-17T18:10:51.007018] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-17T18:10:51.007880] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-17T18:10:51.007945] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-17T18:10:51.009354] [DEBUG] [LOCAL ] CP: Trimmed 77303 records to 54017 (keeping 200 days of data) [2025-10-17T18:10:51.200184] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-17T18:10:51.287581] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T18:10:51.396367] [DEBUG] [LOCAL ] CP: Primary data saved (54017 records). [2025-10-17T18:10:51.396511] [INFO ] [MAIN ] CP: Full history saved. [2025-10-17T18:10:51.397026] [INFO ] [MAIN ] Update Progress: 514/2368 symbols completed. CP took 32.6s. Estimated remaining: 4h 15m 21s. Rate: 7.3 symbols/min [2025-10-17T18:10:51.563588] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:51.580419] [DEBUG] [LOCAL ] CPF: Loaded 15396 existing records from primary storage. [2025-10-17T18:10:51.580681] [INFO ] [MAIN ] CPF: Loaded 15396 existing records. [2025-10-17T18:10:51.784484] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:51.784728] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-17T18:10:51.784783] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-17T18:10:51.785015] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-17T18:10:51.785074] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-17T18:10:51.963696] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-17T18:10:52.139862] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:52.452146] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T18:10:52.626816] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T18:10:52.630712] [INFO ] [REMOTE ] CPA: Full fetch complete (41374 records). [2025-10-17T18:10:52.630797] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-17T18:10:52.771045] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-17T18:10:53.012811] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-17T18:10:53.012908] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-17T18:10:53.013570] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-17T18:10:53.013632] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-17T18:10:53.014570] [DEBUG] [LOCAL ] CPA: Trimmed 41374 records to 28704 (keeping 200 days of data) [2025-10-17T18:10:53.191769] [DEBUG] [LOCAL ] CPA: Primary data saved (28704 records). [2025-10-17T18:10:53.191904] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-17T18:10:53.191983] [INFO ] [MAIN ] Update Progress: 515/2368 symbols completed. CPA took 28.5s. Estimated remaining: 4h 14m 49s. Rate: 7.3 symbols/min [2025-10-17T18:10:53.356688] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:53.368343] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:10:53.376214] [DEBUG] [LOCAL ] CPK: Loaded 14061 existing records from primary storage. [2025-10-17T18:10:53.376439] [INFO ] [MAIN ] CPK: Loaded 14061 existing records. [2025-10-17T18:10:53.550176] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:53.550402] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-17T18:10:53.550470] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-17T18:10:53.550739] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-17T18:10:53.550796] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-17T18:10:53.563150] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-17T18:10:53.903438] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:54.358035] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-17T18:10:55.079048] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T18:10:55.157999] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-17T18:10:55.958034] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-17T18:10:56.441144] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T18:10:56.441984] [INFO ] [REMOTE ] CPAC: Full fetch complete (1791 records). [2025-10-17T18:10:56.442053] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-17T18:10:56.558968] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T18:10:56.629601] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:10:56.629894] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:10:56.630145] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:10:56.630234] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-17T18:10:56.630331] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-17T18:10:56.630396] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-17T18:10:56.630467] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-17T18:10:56.630564] [INFO ] [MAIN ] Update Progress: 516/2368 symbols completed. CPAC took 31.7s. Estimated remaining: 4h 14m 24s. Rate: 7.3 symbols/min [2025-10-17T18:10:56.771309] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-17T18:10:56.803815] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:56.825221] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:10:56.879241] [DEBUG] [LOCAL ] CPNG: Loaded 54069 existing records from primary storage. [2025-10-17T18:10:56.879581] [INFO ] [MAIN ] CPNG: Loaded 54069 existing records. [2025-10-17T18:10:57.055534] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:57.055794] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-17T18:10:57.055842] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-17T18:10:57.056228] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-17T18:10:57.056283] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-17T18:10:57.409139] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:57.558006] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-17T18:10:57.943223] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:10:58.358024] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-17T18:10:59.158059] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-17T18:10:59.706818] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T18:10:59.845869] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T18:10:59.958013] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-17T18:10:59.996978] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:11:00.758077] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-17T18:11:01.558078] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-17T18:11:02.358009] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-17T18:11:02.405881] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T18:11:02.430852] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:11:02.451413] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T18:11:03.158052] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-17T18:11:03.492260] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T18:11:03.958026] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-17T18:11:04.758008] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-17T18:11:05.105065] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:11:05.305556] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T18:11:05.558045] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-17T18:11:06.116477] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:11:06.358039] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-17T18:11:06.542948] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T18:11:07.158040] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-17T18:11:07.178225] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T18:11:07.958005] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-17T18:11:08.010670] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T18:11:08.758037] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-17T18:11:09.135101] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T18:11:09.419289] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T18:11:09.558028] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-17T18:11:10.358069] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-17T18:11:10.555221] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:11:11.158018] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-17T18:11:11.742049] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T18:11:11.958026] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-17T18:11:12.758042] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-17T18:11:12.913579] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T18:11:13.419196] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-17T18:11:13.558001] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-17T18:11:13.685875] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T18:11:14.358069] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-17T18:11:14.537543] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T18:11:15.158023] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-17T18:11:15.657780] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T18:11:15.958010] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-17T18:11:16.055997] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T18:11:16.758048] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-17T18:11:16.909950] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T18:11:17.558039] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-17T18:11:17.832413] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T18:11:18.358033] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-17T18:11:18.683637] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:11:18.686336] [INFO ] [REMOTE ] CPF: Full fetch complete (23622 records). [2025-10-17T18:11:18.686407] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-17T18:11:19.058176] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-17T18:11:19.058251] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-17T18:11:19.058701] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-17T18:11:19.058763] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-17T18:11:19.059339] [DEBUG] [LOCAL ] CPF: Trimmed 23622 records to 15519 (keeping 200 days of data) [2025-10-17T18:11:19.148898] [DEBUG] [LOCAL ] CPF: Primary data saved (15519 records). [2025-10-17T18:11:19.149076] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-17T18:11:19.149214] [INFO ] [MAIN ] Update Progress: 517/2368 symbols completed. CPF took 27.8s. Estimated remaining: 4h 15m 6s. Rate: 7.3 symbols/min [2025-10-17T18:11:19.158022] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-17T18:11:19.964063] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-17T18:11:19.966965] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T18:11:20.620700] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T18:11:20.758019] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-17T18:11:21.363946] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T18:11:21.368378] [INFO ] [REMOTE ] CPAY: Full fetch complete (44969 records). [2025-10-17T18:11:21.368530] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-17T18:11:21.563129] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-17T18:11:21.744836] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T18:11:21.762499] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-17T18:11:21.762737] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-17T18:11:21.763508] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-17T18:11:21.763590] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-17T18:11:21.765244] [DEBUG] [LOCAL ] CPAY: Trimmed 44969 records to 30966 (keeping 200 days of data) [2025-10-17T18:11:21.953187] [DEBUG] [LOCAL ] CPAY: Primary data saved (30966 records). [2025-10-17T18:11:21.953328] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-17T18:11:21.953529] [INFO ] [MAIN ] Update Progress: 518/2368 symbols completed. CPAY took 44.1s. Estimated remaining: 4h 14m 39s. Rate: 7.3 symbols/min [2025-10-17T18:11:22.358064] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-17T18:11:23.501244] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T18:11:23.504029] [INFO ] [REMOTE ] CPK: Full fetch complete (18595 records). [2025-10-17T18:11:23.504100] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-17T18:11:23.864306] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-17T18:11:23.864380] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-17T18:11:23.864821] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-17T18:11:23.864882] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-17T18:11:23.865462] [DEBUG] [LOCAL ] CPK: Trimmed 18595 records to 14207 (keeping 200 days of data) [2025-10-17T18:11:23.953957] [DEBUG] [LOCAL ] CPK: Primary data saved (14207 records). [2025-10-17T18:11:23.954088] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-17T18:11:23.954170] [INFO ] [MAIN ] Update Progress: 519/2368 symbols completed. CPK took 30.8s. Estimated remaining: 4h 14m 8s. Rate: 7.3 symbols/min [2025-10-17T18:11:24.136305] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-17T18:11:24.147880] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-17T18:11:26.510189] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-17T18:11:26.521180] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-17T18:11:28.999506] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-17T18:11:29.011577] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-17T18:11:30.941519] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T18:11:30.952873] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-17T18:11:33.301758] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-17T18:11:33.314002] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-17T18:11:35.748434] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-17T18:11:35.757292] [INFO ] [REMOTE ] CPNG: Full fetch complete (77782 records). [2025-10-17T18:11:35.757902] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-17T18:11:36.293599] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-17T18:11:36.293927] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-17T18:11:36.294833] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-17T18:11:36.294896] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-17T18:11:36.296395] [DEBUG] [LOCAL ] CPNG: Trimmed 77782 records to 54459 (keeping 200 days of data) [2025-10-17T18:11:36.611575] [DEBUG] [LOCAL ] CPNG: Primary data saved (54459 records). [2025-10-17T18:11:36.611738] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-17T18:11:36.611826] [INFO ] [MAIN ] Update Progress: 520/2368 symbols completed. CPNG took 40.0s. Estimated remaining: 4h 14m 16s. Rate: 7.3 symbols/min [2025-10-17T18:11:37.237097] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.238453] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.307574] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.314451] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-10-17T18:11:37.320403] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-10-17T18:11:37.338946] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-17T18:11:37.339258] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-17T18:11:37.343631] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-17T18:11:37.343783] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-17T18:11:37.343434] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.355269] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-17T18:11:37.355530] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-17T18:11:37.397236] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-17T18:11:37.405955] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-17T18:11:37.416613] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-17T18:11:37.429335] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-17T18:11:37.807614] [DEBUG] [LOCAL ] CPT: Loaded 44888 existing records from primary storage. [2025-10-17T18:11:37.866154] [DEBUG] [LOCAL ] CPRI: Loaded 52846 existing records from primary storage. [2025-10-17T18:11:37.893385] [INFO ] [MAIN ] CPRI: Loaded 52846 existing records. [2025-10-17T18:11:37.863358] [INFO ] [MAIN ] CPT: Loaded 44888 existing records. [2025-10-17T18:11:38.110086] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:38.172197] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-17T18:11:38.522439] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:38.518316] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:38.532317] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-17T18:11:38.545518] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-17T18:11:38.546400] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-17T18:11:38.545422] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:38.546600] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-17T18:11:38.546726] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-17T18:11:38.547096] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-17T18:11:38.547169] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-17T18:11:38.552362] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-17T18:11:38.588612] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-17T18:11:39.262460] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:39.263089] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-17T18:11:39.294734] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:39.295136] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-17T18:11:39.342214] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:11:39.346671] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-17T18:11:39.423596] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:11:39.428141] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-17T18:11:40.404624] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T18:11:40.409536] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-17T18:11:40.564293] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:11:40.570224] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-17T18:11:40.883348] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:11:40.891895] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-17T18:11:41.175831] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:11:41.186669] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-17T18:11:41.372124] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:11:41.377512] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-17T18:11:41.560094] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:11:41.565494] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-17T18:11:42.172013] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T18:11:42.181180] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-17T18:11:42.491934] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:11:42.497458] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-17T18:11:42.585434] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:11:42.592471] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-17T18:11:42.873726] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T18:11:42.884361] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-17T18:11:43.309211] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T18:11:43.313525] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-17T18:11:43.692624] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:11:43.701886] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-17T18:11:44.150496] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:11:44.157618] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-17T18:11:44.210867] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:11:44.221532] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-17T18:11:44.392374] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:11:44.397628] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-17T18:11:45.385104] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T18:11:45.394717] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-17T18:11:45.493881] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:11:45.501019] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-17T18:11:45.614272] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T18:11:45.620703] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-17T18:11:45.733711] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:11:46.358002] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-17T18:11:46.605080] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T18:11:46.684390] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:11:46.853602] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T18:11:47.158034] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-17T18:11:47.958054] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-17T18:11:48.151633] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T18:11:48.428717] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:11:48.765078] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-17T18:11:48.766234] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T18:11:49.558026] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-17T18:11:50.363901] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-17T18:11:50.374798] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:11:51.158006] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-17T18:11:51.359135] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T18:11:51.591876] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T18:11:51.958106] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-17T18:11:52.758025] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-17T18:11:53.052137] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T18:11:53.084106] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T18:11:53.397356] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T18:11:53.558032] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-17T18:11:54.358050] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-17T18:11:54.672860] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T18:11:55.158026] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-17T18:11:55.958024] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-17T18:11:56.023514] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:11:56.226339] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:11:56.228976] [INFO ] [REMOTE ] CQP: Full fetch complete (29962 records). [2025-10-17T18:11:56.229066] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-17T18:11:56.593937] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-17T18:11:56.594037] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-17T18:11:56.594583] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-17T18:11:56.594664] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-17T18:11:56.595436] [DEBUG] [LOCAL ] CQP: Trimmed 29962 records to 19156 (keeping 200 days of data) [2025-10-17T18:11:56.718136] [DEBUG] [LOCAL ] CQP: Primary data saved (19156 records). [2025-10-17T18:11:56.718301] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-17T18:11:56.718426] [INFO ] [MAIN ] Update Progress: 521/2368 symbols completed. CQP took 20.1s. Estimated remaining: 4h 14m 49s. Rate: 7.2 symbols/min [2025-10-17T18:11:56.761312] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-17T18:11:56.893120] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:56.918604] [DEBUG] [LOCAL ] CR: Loaded 24311 existing records from primary storage. [2025-10-17T18:11:56.918898] [INFO ] [MAIN ] CR: Loaded 24311 existing records. [2025-10-17T18:11:57.043773] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T18:11:57.091423] [INFO ] [REMOTE ] CPS: Full fetch complete (36354 records). [2025-10-17T18:11:57.111925] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:57.112138] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-17T18:11:57.112876] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-17T18:11:57.113084] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-17T18:11:57.113388] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-17T18:11:57.113446] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-17T18:11:57.568460] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-17T18:11:57.914062] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:57.932377] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-17T18:11:57.932465] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-17T18:11:57.933114] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-17T18:11:57.933231] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-17T18:11:57.934177] [DEBUG] [LOCAL ] CPS: Trimmed 36354 records to 25505 (keeping 200 days of data) [2025-10-17T18:11:58.084414] [DEBUG] [LOCAL ] CPS: Primary data saved (25505 records). [2025-10-17T18:11:58.084554] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-17T18:11:58.084629] [INFO ] [MAIN ] Update Progress: 522/2368 symbols completed. CPS took 21.4s. Estimated remaining: 4h 14m 17s. Rate: 7.3 symbols/min [2025-10-17T18:11:58.261506] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:58.272359] [DEBUG] [LOCAL ] CRBD: Loaded 8956 existing records from primary storage. [2025-10-17T18:11:58.272601] [INFO ] [MAIN ] CRBD: Loaded 8956 existing records. [2025-10-17T18:11:58.360361] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-17T18:11:58.455287] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:58.455502] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-17T18:11:58.455575] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-17T18:11:58.455760] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-17T18:11:58.455833] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-17T18:11:58.797211] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:11:58.879821] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:59.158035] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-17T18:11:59.191125] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:11:59.451940] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:11:59.958038] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-17T18:12:00.758043] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-17T18:12:01.497150] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T18:12:01.558037] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-17T18:12:01.673344] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-17T18:12:02.358004] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-17T18:12:02.713822] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T18:12:03.123605] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:12:03.157984] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-17T18:12:03.958073] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-17T18:12:04.264851] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:12:04.300129] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T18:12:04.758048] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-17T18:12:05.558007] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-17T18:12:05.687030] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:12:05.693367] [INFO ] [REMOTE ] CPT: Full fetch complete (64574 records). [2025-10-17T18:12:05.693512] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-17T18:12:06.072976] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:12:06.117145] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-17T18:12:06.117256] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-17T18:12:06.118421] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-17T18:12:06.118549] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-17T18:12:06.120225] [DEBUG] [LOCAL ] CPT: Trimmed 64574 records to 45243 (keeping 200 days of data) [2025-10-17T18:12:06.358005] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-17T18:12:06.426768] [DEBUG] [LOCAL ] CPT: Primary data saved (45243 records). [2025-10-17T18:12:06.426903] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-17T18:12:06.427878] [INFO ] [MAIN ] Update Progress: 523/2368 symbols completed. CPT took 29.8s. Estimated remaining: 4h 14m 9s. Rate: 7.3 symbols/min [2025-10-17T18:12:06.604227] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:06.655726] [DEBUG] [LOCAL ] CRBG: Loaded 52976 existing records from primary storage. [2025-10-17T18:12:06.656103] [INFO ] [MAIN ] CRBG: Loaded 52976 existing records. [2025-10-17T18:12:06.836728] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:06.836975] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-17T18:12:06.837023] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-17T18:12:06.837403] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-17T18:12:06.837484] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-17T18:12:07.086170] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:12:07.161733] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-17T18:12:07.216617] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:07.389941] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T18:12:07.397242] [INFO ] [REMOTE ] CPRI: Full fetch complete (76205 records). [2025-10-17T18:12:07.397364] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-17T18:12:07.778568] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-17T18:12:07.778675] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-17T18:12:07.779563] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-17T18:12:07.779609] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-17T18:12:07.781030] [DEBUG] [LOCAL ] CPRI: Trimmed 76205 records to 53228 (keeping 200 days of data) [2025-10-17T18:12:07.961289] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-17T18:12:08.094909] [DEBUG] [LOCAL ] CPRI: Primary data saved (53228 records). [2025-10-17T18:12:08.095048] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-17T18:12:08.095165] [INFO ] [MAIN ] Update Progress: 524/2368 symbols completed. CPRI took 31.5s. Estimated remaining: 4h 13m 37s. Rate: 7.3 symbols/min [2025-10-17T18:12:08.265569] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:08.306536] [DEBUG] [LOCAL ] CRC: Loaded 44395 existing records from primary storage. [2025-10-17T18:12:08.306865] [INFO ] [MAIN ] CRC: Loaded 44395 existing records. [2025-10-17T18:12:08.487617] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:08.487988] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-17T18:12:08.488062] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-17T18:12:08.488573] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-17T18:12:08.488631] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-17T18:12:08.759102] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:12:08.758518] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-17T18:12:08.805794] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:12:08.890585] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:09.558078] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-17T18:12:10.312571] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T18:12:10.358011] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-17T18:12:10.670784] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T18:12:10.985962] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T18:12:11.158023] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-17T18:12:11.900836] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T18:12:11.958107] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-17T18:12:12.758034] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-17T18:12:12.790485] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T18:12:13.558002] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-17T18:12:14.031280] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:12:14.358060] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-17T18:12:15.119698] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T18:12:15.147993] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T18:12:15.157994] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-17T18:12:15.958059] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-17T18:12:16.731165] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T18:12:16.758011] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-17T18:12:17.082009] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T18:12:17.558044] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-17T18:12:18.153212] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:12:18.358028] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-17T18:12:19.158009] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-17T18:12:19.256004] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T18:12:19.958019] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-17T18:12:20.065530] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T18:12:20.090896] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T18:12:20.516776] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T18:12:20.758023] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-17T18:12:21.557999] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-17T18:12:21.927035] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T18:12:22.358093] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-17T18:12:23.047390] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:12:23.158015] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-17T18:12:23.789964] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:12:23.958066] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-17T18:12:24.763701] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-17T18:12:24.782392] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:12:25.299531] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T18:12:25.558026] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-17T18:12:26.141906] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:12:26.145409] [INFO ] [REMOTE ] CR: Full fetch complete (34783 records). [2025-10-17T18:12:26.145509] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-17T18:12:26.364607] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-17T18:12:26.531932] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-17T18:12:26.532032] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-17T18:12:26.532658] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-17T18:12:26.532723] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-17T18:12:26.533612] [DEBUG] [LOCAL ] CR: Trimmed 34783 records to 24488 (keeping 200 days of data) [2025-10-17T18:12:26.683344] [DEBUG] [LOCAL ] CR: Primary data saved (24488 records). [2025-10-17T18:12:26.683472] [INFO ] [MAIN ] CR: Full history saved. [2025-10-17T18:12:26.683582] [INFO ] [MAIN ] Update Progress: 525/2368 symbols completed. CR took 30.0s. Estimated remaining: 4h 14m 5s. Rate: 7.3 symbols/min [2025-10-17T18:12:26.861790] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:26.861937] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-17T18:12:26.861974] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-17T18:12:26.862114] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-17T18:12:26.862174] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-17T18:12:26.862220] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-17T18:12:26.862254] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-17T18:12:27.159538] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-17T18:12:27.219033] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:27.226513] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T18:12:27.274108] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:12:27.958116] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-17T18:12:28.758031] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-17T18:12:28.963779] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T18:12:29.383996] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T18:12:29.461173] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:12:29.463575] [INFO ] [REMOTE ] CRBD: Full fetch complete (13265 records). [2025-10-17T18:12:29.463827] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-17T18:12:29.563525] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-17T18:12:29.818548] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-17T18:12:29.818662] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-17T18:12:29.818987] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-17T18:12:29.819028] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-17T18:12:29.819473] [DEBUG] [LOCAL ] CRBD: Trimmed 13265 records to 9015 (keeping 200 days of data) [2025-10-17T18:12:29.871360] [DEBUG] [LOCAL ] CRBD: Primary data saved (9015 records). [2025-10-17T18:12:29.871469] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-17T18:12:29.871550] [INFO ] [MAIN ] Update Progress: 526/2368 symbols completed. CRBD took 31.8s. Estimated remaining: 4h 13m 39s. Rate: 7.3 symbols/min [2025-10-17T18:12:30.044236] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:30.098501] [DEBUG] [LOCAL ] CRGY: Loaded 52897 existing records from primary storage. [2025-10-17T18:12:30.098958] [INFO ] [MAIN ] CRGY: Loaded 52897 existing records. [2025-10-17T18:12:30.278636] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:30.278857] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-17T18:12:30.278907] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-17T18:12:30.279277] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-17T18:12:30.279315] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-17T18:12:30.363232] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-17T18:12:30.605017] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:12:30.628112] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:30.628231] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-17T18:12:30.628690] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:12:30.628766] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-17T18:12:30.628832] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:12:30.628905] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-17T18:12:30.628977] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-17T18:12:30.629016] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-17T18:12:30.629057] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-17T18:12:30.629106] [INFO ] [MAIN ] Update Progress: 527/2368 symbols completed. CRCL took 3.9s. Estimated remaining: 4h 13m 5s. Rate: 7.3 symbols/min [2025-10-17T18:12:30.820808] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:30.871360] [DEBUG] [LOCAL ] CRH: Loaded 53831 existing records from primary storage. [2025-10-17T18:12:30.871765] [INFO ] [MAIN ] CRH: Loaded 53831 existing records. [2025-10-17T18:12:31.048304] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:31.048523] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-17T18:12:31.048570] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-17T18:12:31.049070] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-17T18:12:31.049126] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-17T18:12:31.163125] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-17T18:12:31.421788] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:31.458418] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:12:31.958039] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-17T18:12:32.758058] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-17T18:12:33.080753] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T18:12:33.175048] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T18:12:33.558035] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-17T18:12:34.358127] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-17T18:12:34.405144] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:12:35.158037] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-17T18:12:35.604583] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:12:35.963179] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-17T18:12:35.986928] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:12:36.758008] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-17T18:12:36.937155] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:12:37.061717] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:12:37.558035] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-17T18:12:38.358036] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-17T18:12:38.623741] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T18:12:39.158034] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-17T18:12:39.213524] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:12:39.963366] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-17T18:12:39.977001] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:12:40.742406] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:12:40.757989] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-17T18:12:41.558041] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-17T18:12:41.768677] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T18:12:42.358065] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-17T18:12:42.647061] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T18:12:43.095230] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T18:12:43.101870] [INFO ] [REMOTE ] CRC: Full fetch complete (62962 records). [2025-10-17T18:12:43.102016] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-17T18:12:43.163142] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-17T18:12:43.476456] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-17T18:12:43.476535] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-17T18:12:43.477325] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-17T18:12:43.477389] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-17T18:12:43.478639] [DEBUG] [LOCAL ] CRC: Trimmed 62962 records to 44717 (keeping 200 days of data) [2025-10-17T18:12:43.753951] [DEBUG] [LOCAL ] CRC: Primary data saved (44717 records). [2025-10-17T18:12:43.754134] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-17T18:12:43.754265] [INFO ] [MAIN ] Update Progress: 528/2368 symbols completed. CRC took 35.7s. Estimated remaining: 4h 13m 13s. Rate: 7.3 symbols/min [2025-10-17T18:12:43.924041] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:43.966619] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-17T18:12:43.969441] [DEBUG] [LOCAL ] CRI: Loaded 50021 existing records from primary storage. [2025-10-17T18:12:43.969859] [INFO ] [MAIN ] CRI: Loaded 50021 existing records. [2025-10-17T18:12:44.151492] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:44.151717] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-17T18:12:44.151794] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-17T18:12:44.152162] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-17T18:12:44.152201] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-17T18:12:44.490613] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-17T18:12:44.567775] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:44.758000] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-17T18:12:44.939178] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:12:45.558028] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-17T18:12:46.035240] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T18:12:46.358030] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-17T18:12:46.443405] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T18:12:47.158007] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-17T18:12:47.450019] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:12:47.457232] [INFO ] [REMOTE ] CRBG: Full fetch complete (75644 records). [2025-10-17T18:12:47.457382] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-17T18:12:47.458280] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:12:47.458374] [FATAL] [MAIN ] CRBG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:12:47.458420] [WARN ] [MAIN ] CRBG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:12:47.458490] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-17T18:12:47.458590] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-10-17T18:12:47.458677] [INFO ] [LOCAL ] CRBG: Starting deletion of derivative data. [2025-10-17T18:12:47.458928] [DEBUG] [LOCAL ] CRBG: Deleted derivative data file. [2025-10-17T18:12:47.459331] [INFO ] [MAIN ] Update Progress: 529/2368 symbols completed. CRBG took 41.0s. Estimated remaining: 4h 12m 49s. Rate: 7.3 symbols/min [2025-10-17T18:12:47.630875] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:47.685759] [DEBUG] [LOCAL ] CRK: Loaded 52635 existing records from primary storage. [2025-10-17T18:12:47.686110] [INFO ] [MAIN ] CRK: Loaded 52635 existing records. [2025-10-17T18:12:47.859602] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:47.859840] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-17T18:12:47.859888] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-17T18:12:47.860192] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-17T18:12:47.860232] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-17T18:12:47.959839] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-17T18:12:48.224821] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:48.254880] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:12:48.698422] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T18:12:48.758001] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-17T18:12:49.557999] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-17T18:12:49.820513] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:12:50.311813] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:12:50.358015] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-17T18:12:51.158005] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-17T18:12:51.269831] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:12:51.958042] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-17T18:12:52.117972] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:12:52.757998] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-17T18:12:53.030629] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T18:12:53.393823] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:12:53.558021] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-17T18:12:54.239415] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T18:12:54.358007] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-17T18:12:55.123452] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T18:12:55.158024] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-17T18:12:55.958036] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-17T18:12:56.223900] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:12:56.758005] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-17T18:12:56.865174] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T18:12:57.558078] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-17T18:12:58.165485] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-17T18:12:58.358018] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-17T18:12:58.500000] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T18:12:59.101244] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:12:59.158037] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-17T18:12:59.958012] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-17T18:13:00.139836] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:13:00.758043] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-17T18:13:01.195854] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T18:13:01.558064] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-17T18:13:02.179392] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T18:13:02.358065] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-17T18:13:02.404978] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:13:03.065686] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:13:03.158035] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-17T18:13:03.914264] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:13:03.958004] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-17T18:13:04.758003] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-17T18:13:04.948521] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:13:05.558044] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-17T18:13:05.841900] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T18:13:06.358038] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-17T18:13:06.679557] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T18:13:07.158027] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-17T18:13:07.285299] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T18:13:07.958004] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-17T18:13:08.227918] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:13:08.235222] [INFO ] [REMOTE ] CRGY: Full fetch complete (76142 records). [2025-10-17T18:13:08.235346] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-17T18:13:08.636601] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-17T18:13:08.636727] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-17T18:13:08.637755] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-17T18:13:08.637865] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-17T18:13:08.639339] [DEBUG] [LOCAL ] CRGY: Trimmed 76142 records to 53283 (keeping 200 days of data) [2025-10-17T18:13:08.766189] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-17T18:13:08.874452] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:13:08.994366] [DEBUG] [LOCAL ] CRGY: Primary data saved (53283 records). [2025-10-17T18:13:08.994507] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-17T18:13:08.994600] [INFO ] [MAIN ] Update Progress: 530/2368 symbols completed. CRGY took 39.1s. Estimated remaining: 4h 13m 27s. Rate: 7.3 symbols/min [2025-10-17T18:13:09.159112] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:09.159292] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-10-17T18:13:09.159329] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-10-17T18:13:09.159468] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-17T18:13:09.159535] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-17T18:13:09.159587] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-10-17T18:13:09.159622] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-17T18:13:09.525936] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:09.557986] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-17T18:13:09.692106] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:13:09.700886] [INFO ] [REMOTE ] CRH: Full fetch complete (77540 records). [2025-10-17T18:13:09.701118] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-17T18:13:10.115984] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-17T18:13:10.116082] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-17T18:13:10.117008] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-17T18:13:10.117073] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-17T18:13:10.118672] [DEBUG] [LOCAL ] CRH: Trimmed 77540 records to 54220 (keeping 200 days of data) [2025-10-17T18:13:10.359685] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-17T18:13:10.462211] [DEBUG] [LOCAL ] CRH: Primary data saved (54220 records). [2025-10-17T18:13:10.462446] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-17T18:13:10.462620] [INFO ] [MAIN ] Update Progress: 531/2368 symbols completed. CRH took 39.8s. Estimated remaining: 4h 12m 55s. Rate: 7.3 symbols/min [2025-10-17T18:13:10.646586] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:10.682423] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:13:10.736883] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-17T18:13:10.737217] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-10-17T18:13:10.925760] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:10.926090] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-17T18:13:10.926201] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-17T18:13:10.926725] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-17T18:13:10.926817] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-17T18:13:11.072628] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:13:11.169358] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-17T18:13:11.321774] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:11.958010] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-17T18:13:12.164804] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T18:13:12.758103] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-17T18:13:12.948920] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:13:13.558071] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-17T18:13:14.196449] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T18:13:14.358052] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-17T18:13:14.427485] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-17T18:13:14.772983] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:13:15.158007] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-17T18:13:15.802531] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:13:15.957998] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-17T18:13:16.758019] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-17T18:13:17.558008] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-17T18:13:17.973692] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-17T18:13:18.147403] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T18:13:18.155507] [INFO ] [REMOTE ] CRK: Full fetch complete (75834 records). [2025-10-17T18:13:18.155714] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-17T18:13:18.364016] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-17T18:13:18.521948] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:13:18.591998] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-17T18:13:18.592076] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-17T18:13:18.592962] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-17T18:13:18.593051] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-17T18:13:18.594424] [DEBUG] [LOCAL ] CRK: Trimmed 75834 records to 53025 (keeping 200 days of data) [2025-10-17T18:13:18.897750] [DEBUG] [LOCAL ] CRK: Primary data saved (53025 records). [2025-10-17T18:13:18.897883] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-17T18:13:18.898377] [INFO ] [MAIN ] Update Progress: 532/2368 symbols completed. CRK took 31.4s. Estimated remaining: 4h 12m 48s. Rate: 7.3 symbols/min [2025-10-17T18:13:19.079953] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:19.080179] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-10-17T18:13:19.080323] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-10-17T18:13:19.080459] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-17T18:13:19.080513] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-17T18:13:19.080559] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-17T18:13:19.080595] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-17T18:13:19.160481] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-17T18:13:19.274559] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T18:13:19.369191] [INFO ] [REMOTE ] CRI: Full fetch complete (70655 records). [2025-10-17T18:13:19.387528] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-17T18:13:19.390619] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:13:19.411484] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:13:19.439420] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:13:19.448145] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-17T18:13:19.469258] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-17T18:13:19.469343] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-10-17T18:13:19.469205] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:19.469701] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-10-17T18:13:19.470544] [INFO ] [MAIN ] Update Progress: 533/2368 symbols completed. CRI took 35.7s. Estimated remaining: 4h 12m 13s. Rate: 7.3 symbols/min [2025-10-17T18:13:19.635183] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:19.635369] [DEBUG] [LOCAL ] CRT: No existing data file found in primary storage. [2025-10-17T18:13:19.635406] [WARN ] [MAIN ] CRT: No existing data found, performing full refresh instead. [2025-10-17T18:13:19.635515] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-17T18:13:19.635555] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-17T18:13:19.635595] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-17T18:13:19.635628] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-17T18:13:19.963158] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-17T18:13:20.057979] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:20.706230] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-17T18:13:20.763216] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-17T18:13:20.782433] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T18:13:21.558035] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-17T18:13:21.663617] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T18:13:22.358056] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-17T18:13:23.158005] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-17T18:13:23.214676] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:13:23.290238] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-17T18:13:23.830110] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T18:13:23.958040] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-17T18:13:24.163731] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T18:13:24.758033] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-17T18:13:25.401269] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T18:13:25.558034] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-17T18:13:26.358006] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-17T18:13:26.545677] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-17T18:13:27.145448] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:13:27.157980] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-17T18:13:27.959139] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-17T18:13:27.961528] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:13:28.718384] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:13:28.757994] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-17T18:13:29.459975] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T18:13:29.563122] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-17T18:13:29.584483] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-17T18:13:30.358024] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-17T18:13:31.105926] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:13:31.158007] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-17T18:13:31.958053] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-17T18:13:32.665637] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:13:32.757990] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-17T18:13:32.868351] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-17T18:13:33.335046] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:13:33.558003] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-17T18:13:34.364489] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-17T18:13:34.380744] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:13:35.033911] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T18:13:35.158017] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-17T18:13:35.529284] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:13:35.957995] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-17T18:13:36.758021] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-17T18:13:36.826122] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T18:13:36.832348] [INFO ] [REMOTE ] CRL: Full fetch complete (63494 records). [2025-10-17T18:13:36.832468] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-17T18:13:37.219392] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-17T18:13:37.219481] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-17T18:13:37.220348] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-17T18:13:37.220414] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-17T18:13:37.221792] [DEBUG] [LOCAL ] CRL: Trimmed 63494 records to 43452 (keeping 200 days of data) [2025-10-17T18:13:37.350304] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T18:13:37.489158] [DEBUG] [LOCAL ] CRL: Primary data saved (43452 records). [2025-10-17T18:13:37.489305] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-17T18:13:37.489387] [INFO ] [MAIN ] Update Progress: 534/2368 symbols completed. CRL took 28.5s. Estimated remaining: 4h 12m 38s. Rate: 7.3 symbols/min [2025-10-17T18:13:37.558159] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-17T18:13:37.661596] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:37.692482] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:13:37.735726] [DEBUG] [LOCAL ] CSAN: Loaded 42492 existing records from primary storage. [2025-10-17T18:13:37.736074] [INFO ] [MAIN ] CSAN: Loaded 42492 existing records. [2025-10-17T18:13:37.910379] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:37.910686] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-17T18:13:37.910747] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-17T18:13:37.911024] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-17T18:13:37.911082] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-17T18:13:38.254985] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:38.358026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-17T18:13:39.158021] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-17T18:13:39.958004] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-17T18:13:40.046851] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T18:13:40.241088] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-17T18:13:40.612328] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T18:13:40.675221] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T18:13:40.758027] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-17T18:13:41.558030] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-17T18:13:42.358028] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-17T18:13:43.156565] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:13:43.164507] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-17T18:13:43.322779] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-17T18:13:43.620460] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:13:43.789122] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T18:13:43.958048] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-17T18:13:44.559558] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:13:44.758041] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-17T18:13:45.473538] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T18:13:45.558032] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-17T18:13:46.358036] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-17T18:13:47.158034] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-17T18:13:47.807321] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T18:13:47.808562] [INFO ] [REMOTE ] CRT: Full fetch complete (7380 records). [2025-10-17T18:13:47.808631] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-17T18:13:47.960366] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-17T18:13:48.184183] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-17T18:13:48.184393] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-17T18:13:48.184735] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-17T18:13:48.184930] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-17T18:13:48.195242] [DEBUG] [LOCAL ] CRT: Trimmed 7380 records to 4975 (keeping 200 days of data) [2025-10-17T18:13:48.214474] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T18:13:48.253532] [DEBUG] [LOCAL ] CRT: Primary data saved (4975 records). [2025-10-17T18:13:48.253799] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-17T18:13:48.253911] [INFO ] [MAIN ] Update Progress: 535/2368 symbols completed. CRT took 28.8s. Estimated remaining: 4h 12m 39s. Rate: 7.3 symbols/min [2025-10-17T18:13:48.387302] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-17T18:13:48.468741] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:48.501152] [DEBUG] [LOCAL ] CSL: Loaded 31764 existing records from primary storage. [2025-10-17T18:13:48.501429] [INFO ] [MAIN ] CSL: Loaded 31764 existing records. [2025-10-17T18:13:48.678967] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:48.679200] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-17T18:13:48.679249] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-17T18:13:48.679587] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-17T18:13:48.679672] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-17T18:13:48.763279] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-17T18:13:49.035918] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:49.526432] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:13:49.557990] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-17T18:13:50.358047] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-17T18:13:50.386605] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:13:50.975400] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:13:51.158026] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-17T18:13:51.727703] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:13:51.958086] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-17T18:13:52.758031] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-17T18:13:52.861740] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:13:52.867790] [INFO ] [REMOTE ] CRS: Full fetch complete (62527 records). [2025-10-17T18:13:52.868069] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-17T18:13:53.041934] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T18:13:53.137189] [INFO ] [REMOTE ] CRM: Full fetch complete (77945 records). [2025-10-17T18:13:53.161852] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-17T18:13:53.503720] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-17T18:13:53.512028] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-17T18:13:53.527852] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-17T18:13:53.561268] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-17T18:13:53.572718] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-17T18:13:53.638001] [DEBUG] [LOCAL ] CRS: Trimmed 62527 records to 43714 (keeping 200 days of data) [2025-10-17T18:13:53.826093] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-17T18:13:53.826428] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-17T18:13:53.829608] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-17T18:13:53.830457] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-17T18:13:53.838546] [DEBUG] [LOCAL ] CRM: Trimmed 77945 records to 54550 (keeping 200 days of data) [2025-10-17T18:13:54.283093] [DEBUG] [LOCAL ] CRS: Primary data saved (43714 records). [2025-10-17T18:13:54.283952] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-17T18:13:54.284275] [INFO ] [MAIN ] Update Progress: 536/2368 symbols completed. CRS took 35.4s. Estimated remaining: 4h 12m 23s. Rate: 7.3 symbols/min [2025-10-17T18:13:54.486215] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T18:13:54.503470] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:54.515336] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-17T18:13:54.574036] [DEBUG] [LOCAL ] CSR: Loaded 13529 existing records from primary storage. [2025-10-17T18:13:54.581905] [INFO ] [MAIN ] CSR: Loaded 13529 existing records. [2025-10-17T18:13:54.798268] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:54.803963] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-17T18:13:54.805735] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-17T18:13:54.806372] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-17T18:13:54.807168] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-17T18:13:54.904261] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-17T18:13:54.904426] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-17T18:13:54.910893] [INFO ] [MAIN ] Update Progress: 537/2368 symbols completed. CRM took 44.4s. Estimated remaining: 4h 11m 48s. Rate: 7.3 symbols/min [2025-10-17T18:13:55.220250] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T18:13:55.319047] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-17T18:13:55.322755] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:55.413723] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:55.453155] [DEBUG] [LOCAL ] CSTM: Loaded 47940 existing records from primary storage. [2025-10-17T18:13:55.453492] [INFO ] [MAIN ] CSTM: Loaded 47940 existing records. [2025-10-17T18:13:55.626932] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:55.627153] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-17T18:13:55.627200] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-17T18:13:55.627600] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-17T18:13:55.627696] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-17T18:13:55.981162] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:55.976276] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-17T18:13:56.006735] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T18:13:56.453043] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:13:56.758066] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-17T18:13:57.037277] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T18:13:57.558086] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-17T18:13:58.169511] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:13:58.188918] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T18:13:58.358033] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-17T18:13:59.158035] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-17T18:13:59.897396] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:13:59.957983] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-17T18:13:59.977811] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T18:14:00.758031] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-17T18:14:01.558052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-17T18:14:01.597094] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T18:14:02.358040] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-17T18:14:02.421869] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:14:03.069283] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:14:03.158021] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-17T18:14:03.700945] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T18:14:03.821089] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:14:03.958002] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-17T18:14:04.758026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-17T18:14:05.550269] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:14:05.559838] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-17T18:14:06.363139] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-17T18:14:06.377301] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T18:14:06.464267] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T18:14:07.158085] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-17T18:14:07.958023] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-17T18:14:07.991474] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:14:08.744805] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:14:08.750517] [INFO ] [REMOTE ] CSAN: Full fetch complete (60374 records). [2025-10-17T18:14:08.750693] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-17T18:14:08.763226] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-17T18:14:09.085044] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T18:14:09.166492] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-17T18:14:09.166581] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-17T18:14:09.167329] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-17T18:14:09.167392] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-17T18:14:09.168632] [DEBUG] [LOCAL ] CSAN: Trimmed 60374 records to 42773 (keeping 200 days of data) [2025-10-17T18:14:09.399391] [DEBUG] [LOCAL ] CSAN: Primary data saved (42773 records). [2025-10-17T18:14:09.399520] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-17T18:14:09.399598] [INFO ] [MAIN ] Update Progress: 538/2368 symbols completed. CSAN took 31.9s. Estimated remaining: 4h 12m 1s. Rate: 7.3 symbols/min [2025-10-17T18:14:09.562767] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-17T18:14:09.564217] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:09.586540] [DEBUG] [LOCAL ] CSV: Loaded 12746 existing records from primary storage. [2025-10-17T18:14:09.586820] [INFO ] [MAIN ] CSV: Loaded 12746 existing records. [2025-10-17T18:14:09.762937] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:09.763169] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-17T18:14:09.763239] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-17T18:14:09.763400] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-17T18:14:09.763449] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-17T18:14:10.123888] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:10.358579] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-17T18:14:10.362793] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T18:14:10.536608] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:14:11.158070] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-17T18:14:11.267530] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:14:11.958132] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-17T18:14:12.563930] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:14:12.758063] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-17T18:14:13.245898] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T18:14:13.558044] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-17T18:14:14.183943] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:14:14.358016] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-17T18:14:14.724225] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T18:14:15.158031] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-17T18:14:15.958049] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-17T18:14:16.114399] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:14:16.195296] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T18:14:16.758022] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-17T18:14:16.792944] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T18:14:17.558061] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-17T18:14:18.088033] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T18:14:18.124579] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T18:14:18.358026] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-17T18:14:19.158040] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-17T18:14:19.500621] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T18:14:19.958032] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-17T18:14:20.232408] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:14:20.758085] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-17T18:14:21.412021] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T18:14:21.558021] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-17T18:14:22.280318] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:14:22.358017] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-17T18:14:22.800246] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:14:23.157992] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-17T18:14:23.471503] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T18:14:23.958042] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-17T18:14:24.758001] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-17T18:14:24.783132] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T18:14:24.787937] [INFO ] [REMOTE ] CSL: Full fetch complete (45646 records). [2025-10-17T18:14:24.788075] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-17T18:14:25.089541] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:14:25.130626] [INFO ] [REMOTE ] CSR: Full fetch complete (18007 records). [2025-10-17T18:14:25.148126] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-17T18:14:25.297574] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-17T18:14:25.319363] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-17T18:14:25.320137] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-17T18:14:25.320502] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-17T18:14:25.460602] [DEBUG] [LOCAL ] CSL: Trimmed 45646 records to 31991 (keeping 200 days of data) [2025-10-17T18:14:25.568561] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-17T18:14:25.597710] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T18:14:25.699624] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-17T18:14:25.700042] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-17T18:14:25.701896] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-17T18:14:25.701981] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-17T18:14:25.704951] [DEBUG] [LOCAL ] CSR: Trimmed 18007 records to 13649 (keeping 200 days of data) [2025-10-17T18:14:25.813018] [DEBUG] [LOCAL ] CSR: Primary data saved (13649 records). [2025-10-17T18:14:25.819333] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-17T18:14:25.819761] [INFO ] [MAIN ] Update Progress: 539/2368 symbols completed. CSR took 31.5s. Estimated remaining: 4h 12m 21s. Rate: 7.2 symbols/min [2025-10-17T18:14:26.065484] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:26.066095] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-17T18:14:26.067220] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-17T18:14:26.069828] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-17T18:14:26.070144] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-17T18:14:26.070779] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-17T18:14:26.071151] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-17T18:14:26.279263] [DEBUG] [LOCAL ] CSL: Primary data saved (31991 records). [2025-10-17T18:14:26.337506] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-17T18:14:26.348908] [INFO ] [MAIN ] Update Progress: 540/2368 symbols completed. CSL took 38.1s. Estimated remaining: 4h 11m 46s. Rate: 7.3 symbols/min [2025-10-17T18:14:26.364682] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-17T18:14:26.574194] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:26.639823] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:26.648838] [DEBUG] [LOCAL ] CTBB: Loaded 6801 existing records from primary storage. [2025-10-17T18:14:26.649051] [INFO ] [MAIN ] CTBB: Loaded 6801 existing records. [2025-10-17T18:14:26.836481] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:26.836736] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-17T18:14:26.836789] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-17T18:14:26.836956] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-17T18:14:26.837011] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-17T18:14:27.163177] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-17T18:14:27.200690] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:27.363545] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:14:27.404295] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:14:27.404541] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-17T18:14:27.404629] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:14:27.404722] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-17T18:14:27.404786] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:14:27.404857] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-17T18:14:27.404922] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-17T18:14:27.404957] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-17T18:14:27.404995] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-17T18:14:27.405062] [INFO ] [MAIN ] Update Progress: 541/2368 symbols completed. CSW took 1.6s. Estimated remaining: 4h 11m 14s. Rate: 7.3 symbols/min [2025-10-17T18:14:27.583308] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:27.616364] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T18:14:27.629793] [DEBUG] [LOCAL ] CTDD: Loaded 5483 existing records from primary storage. [2025-10-17T18:14:27.630023] [INFO ] [MAIN ] CTDD: Loaded 5483 existing records. [2025-10-17T18:14:27.812696] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:27.812925] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-17T18:14:27.812971] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-17T18:14:27.813128] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-17T18:14:27.813185] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-17T18:14:27.963225] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-17T18:14:28.204919] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:28.758096] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-17T18:14:29.057798] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:14:29.402399] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:14:29.558040] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-17T18:14:30.267238] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T18:14:30.357995] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-17T18:14:31.014240] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T18:14:31.158023] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-17T18:14:31.958024] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-17T18:14:32.562605] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T18:14:32.759798] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-17T18:14:32.762581] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T18:14:33.558047] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-17T18:14:33.588192] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T18:14:34.358047] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-17T18:14:34.530581] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T18:14:34.932962] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T18:14:35.158021] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-17T18:14:35.958053] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-17T18:14:36.758019] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-17T18:14:36.824783] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:14:36.926613] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T18:14:37.482102] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T18:14:37.558012] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-17T18:14:38.358055] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-17T18:14:39.158006] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-17T18:14:39.269104] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T18:14:39.305497] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:14:39.312522] [INFO ] [REMOTE ] CSTM: Full fetch complete (69526 records). [2025-10-17T18:14:39.312711] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-17T18:14:39.735897] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-17T18:14:39.735985] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-17T18:14:39.737016] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-17T18:14:39.737083] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-17T18:14:39.738445] [DEBUG] [LOCAL ] CSTM: Trimmed 69526 records to 48273 (keeping 200 days of data) [2025-10-17T18:14:39.841306] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T18:14:39.958097] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-17T18:14:40.038717] [DEBUG] [LOCAL ] CSTM: Primary data saved (48273 records). [2025-10-17T18:14:40.038883] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-17T18:14:40.038998] [INFO ] [MAIN ] Update Progress: 542/2368 symbols completed. CSTM took 45.1s. Estimated remaining: 4h 11m 20s. Rate: 7.3 symbols/min [2025-10-17T18:14:40.202151] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:40.202315] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-17T18:14:40.202352] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-17T18:14:40.202464] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-17T18:14:40.202504] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-17T18:14:40.202544] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-17T18:14:40.202575] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-17T18:14:40.541927] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:40.758004] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-17T18:14:40.887445] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:14:40.889367] [INFO ] [REMOTE ] CSV: Full fetch complete (19157 records). [2025-10-17T18:14:40.889441] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-17T18:14:41.007117] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:14:41.036424] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-17T18:14:41.045444] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:14:41.047857] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-17T18:14:41.064519] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:14:41.115596] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-17T18:14:41.163402] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-17T18:14:41.173938] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-17T18:14:41.174121] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-17T18:14:41.174198] [INFO ] [MAIN ] Update Progress: 543/2368 symbols completed. CTEV took 1.1s. Estimated remaining: 4h 10m 48s. Rate: 7.3 symbols/min [2025-10-17T18:14:41.414441] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-17T18:14:41.440806] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:41.436805] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-17T18:14:41.441426] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-17T18:14:41.441956] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-17T18:14:41.442731] [DEBUG] [LOCAL ] CSV: Trimmed 19157 records to 12794 (keeping 200 days of data) [2025-10-17T18:14:41.540072] [DEBUG] [LOCAL ] CTO: Loaded 27883 existing records from primary storage. [2025-10-17T18:14:41.541187] [INFO ] [MAIN ] CTO: Loaded 27883 existing records. [2025-10-17T18:14:41.563097] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-17T18:14:41.669680] [DEBUG] [LOCAL ] CSV: Primary data saved (12794 records). [2025-10-17T18:14:41.680849] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-17T18:14:41.696357] [INFO ] [MAIN ] Update Progress: 544/2368 symbols completed. CSV took 32.3s. Estimated remaining: 4h 10m 14s. Rate: 7.3 symbols/min [2025-10-17T18:14:41.837083] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:41.866824] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-17T18:14:41.869045] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-17T18:14:41.869330] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-17T18:14:41.879865] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-17T18:14:42.041823] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:42.052363] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-17T18:14:42.052427] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-17T18:14:42.063495] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-17T18:14:42.078921] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-17T18:14:42.105801] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-17T18:14:42.129593] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-17T18:14:42.284826] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:14:42.358711] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-17T18:14:42.536018] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:42.704111] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:43.121716] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T18:14:43.158002] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-17T18:14:43.861805] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T18:14:43.958081] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-17T18:14:44.758022] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-17T18:14:45.467945] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:14:45.558034] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-17T18:14:46.289483] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T18:14:46.357997] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-17T18:14:46.942180] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T18:14:47.158057] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-17T18:14:47.459433] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:14:47.650806] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T18:14:47.958046] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-17T18:14:48.758120] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-17T18:14:49.022692] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:14:49.391153] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T18:14:49.558044] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-17T18:14:50.358059] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-17T18:14:50.472347] [DEBUG] [REMOTE ] CTBB: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T18:14:50.472673] [WARN ] [REMOTE ] CTBB: No data returned for month 2025-08 [2025-10-17T18:14:50.472764] [FATAL] [REMOTE ] CTBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:14:50.472866] [FATAL] [MAIN ] CTBB: Failed to fetch primary data. [2025-10-17T18:14:50.472933] [WARN ] [MAIN ] CTBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:14:50.472987] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-17T18:14:50.473048] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-17T18:14:50.473083] [INFO ] [LOCAL ] CTBB: Starting deletion of derivative data. [2025-10-17T18:14:50.473223] [DEBUG] [LOCAL ] CTBB: Deleted derivative data file. [2025-10-17T18:14:50.473314] [INFO ] [MAIN ] Update Progress: 545/2368 symbols completed. CTBB took 24.1s. Estimated remaining: 4h 10m 7s. Rate: 7.3 symbols/min [2025-10-17T18:14:50.640261] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:50.692073] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-10-17T18:14:50.692392] [INFO ] [MAIN ] CTRA: Loaded 54038 existing records. [2025-10-17T18:14:50.874417] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:50.874698] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-17T18:14:50.874775] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-17T18:14:50.875097] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-17T18:14:50.875152] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-17T18:14:51.158433] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-17T18:14:51.239395] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:51.290878] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:14:51.763196] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T18:14:51.958069] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-17T18:14:52.561353] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T18:14:52.758008] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-17T18:14:53.558038] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-17T18:14:54.358064] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-17T18:14:54.807262] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:14:54.859882] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:14:54.871277] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T18:14:55.158038] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-17T18:14:55.764551] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T18:14:55.958019] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-17T18:14:56.758047] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-17T18:14:57.349501] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T18:14:57.558043] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-17T18:14:58.358059] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-17T18:14:58.584872] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:14:58.650150] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T18:14:59.080983] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T18:14:59.082136] [INFO ] [REMOTE ] CTDD: Full fetch complete (8022 records). [2025-10-17T18:14:59.082206] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-17T18:14:59.163236] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-17T18:14:59.436301] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-17T18:14:59.436396] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-17T18:14:59.436605] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-17T18:14:59.436663] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-17T18:14:59.437105] [DEBUG] [LOCAL ] CTDD: Trimmed 8022 records to 5501 (keeping 200 days of data) [2025-10-17T18:14:59.469995] [DEBUG] [LOCAL ] CTDD: Primary data saved (5501 records). [2025-10-17T18:14:59.470104] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-17T18:14:59.470191] [INFO ] [MAIN ] Update Progress: 546/2368 symbols completed. CTDD took 32.1s. Estimated remaining: 4h 10m 2s. Rate: 7.3 symbols/min [2025-10-17T18:14:59.634170] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:59.634362] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-17T18:14:59.634400] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-17T18:14:59.634515] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-17T18:14:59.634593] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-17T18:14:59.634681] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-17T18:14:59.634732] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-17T18:14:59.960203] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-17T18:14:59.989696] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:00.769294] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-17T18:15:00.771567] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:15:01.558036] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-17T18:15:01.883197] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T18:15:01.990211] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T18:15:02.358034] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-17T18:15:03.158034] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-17T18:15:03.805632] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-17T18:15:03.957987] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-17T18:15:04.117821] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:15:04.449441] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T18:15:04.758087] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-17T18:15:05.558053] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-17T18:15:05.692196] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:15:06.161463] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:15:06.358033] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-17T18:15:07.158042] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-17T18:15:07.513986] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:15:07.860707] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T18:15:07.958023] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-17T18:15:08.490307] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:15:08.758111] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-17T18:15:09.558033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-17T18:15:10.000564] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T18:15:10.077457] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T18:15:10.358070] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-17T18:15:11.158021] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-17T18:15:11.216679] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T18:15:11.957998] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-17T18:15:12.241898] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:15:12.655274] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:15:12.758063] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-17T18:15:13.400161] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T18:15:13.404696] [INFO ] [REMOTE ] CTO: Full fetch complete (41514 records). [2025-10-17T18:15:13.404778] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-17T18:15:13.563166] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-17T18:15:13.831539] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-17T18:15:13.833686] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-17T18:15:13.835406] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T18:15:13.834795] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-17T18:15:13.842032] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-17T18:15:13.843350] [DEBUG] [LOCAL ] CTO: Trimmed 41514 records to 28050 (keeping 200 days of data) [2025-10-17T18:15:14.021078] [DEBUG] [LOCAL ] CTO: Primary data saved (28050 records). [2025-10-17T18:15:14.021217] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-17T18:15:14.021297] [INFO ] [MAIN ] Update Progress: 547/2368 symbols completed. CTO took 32.8s. Estimated remaining: 4h 10m 14s. Rate: 7.3 symbols/min [2025-10-17T18:15:14.187868] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:14.188057] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-17T18:15:14.188094] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-17T18:15:14.188233] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-17T18:15:14.188298] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-17T18:15:14.188347] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-17T18:15:14.188379] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-17T18:15:14.367832] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-17T18:15:14.541966] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:15.158023] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-17T18:15:15.531105] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T18:15:15.899979] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T18:15:15.958019] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-17T18:15:16.758017] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-17T18:15:16.941114] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:15:17.320986] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:15:17.558059] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-17T18:15:18.358038] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-17T18:15:18.415720] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T18:15:19.158060] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-17T18:15:19.352392] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T18:15:19.480623] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:15:19.958010] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-17T18:15:20.758179] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-17T18:15:21.211488] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T18:15:21.212956] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:15:21.558101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-17T18:15:22.198430] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T18:15:22.358024] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-17T18:15:22.797198] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T18:15:23.158026] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-17T18:15:23.958012] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-17T18:15:24.007049] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T18:15:24.652277] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T18:15:24.757986] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-17T18:15:25.272478] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:15:25.558026] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-17T18:15:26.130937] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:15:26.139765] [INFO ] [REMOTE ] CTOS: Full fetch complete (54020 records). [2025-10-17T18:15:26.139888] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-17T18:15:26.364346] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-17T18:15:26.538626] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-17T18:15:26.538730] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-17T18:15:26.539414] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-17T18:15:26.539454] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-17T18:15:26.540545] [DEBUG] [LOCAL ] CTOS: Trimmed 54020 records to 37827 (keeping 200 days of data) [2025-10-17T18:15:26.742584] [DEBUG] [LOCAL ] CTOS: Primary data saved (37827 records). [2025-10-17T18:15:26.742760] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-17T18:15:26.742853] [INFO ] [MAIN ] Update Progress: 548/2368 symbols completed. CTOS took 45.0s. Estimated remaining: 4h 10m 21s. Rate: 7.3 symbols/min [2025-10-17T18:15:26.908913] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:26.928274] [DEBUG] [LOCAL ] CTS: Loaded 19832 existing records from primary storage. [2025-10-17T18:15:26.928487] [INFO ] [MAIN ] CTS: Loaded 19832 existing records. [2025-10-17T18:15:27.103231] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:15:27.103472] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-17T18:15:27.103546] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-17T18:15:27.103914] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-17T18:15:27.103971] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-17T18:15:27.164664] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-17T18:15:27.463214] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T18:15:27.492776] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:27.958032] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-17T18:15:28.520713] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T18:15:28.528016] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-17T18:15:28.528137] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-17T18:15:28.642948] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T18:15:28.763108] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-17T18:15:28.933728] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-17T18:15:28.933809] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-17T18:15:28.934673] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-17T18:15:28.934735] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-17T18:15:28.936147] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 54427 (keeping 200 days of data) [2025-10-17T18:15:29.264796] [DEBUG] [LOCAL ] CTRA: Primary data saved (54427 records). [2025-10-17T18:15:29.264938] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-17T18:15:29.265567] [INFO ] [MAIN ] Update Progress: 549/2368 symbols completed. CTRA took 38.8s. Estimated remaining: 4h 9m 54s. Rate: 7.3 symbols/min [2025-10-17T18:15:29.431238] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:29.431469] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-17T18:15:29.431513] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-17T18:15:29.431630] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-17T18:15:29.431707] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-17T18:15:29.431757] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-17T18:15:29.431790] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-17T18:15:29.569813] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-17T18:15:29.796199] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:29.824590] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:15:29.881520] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:15:30.358022] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-17T18:15:31.121120] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:15:31.158011] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-17T18:15:31.644917] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:15:31.651935] [INFO ] [REMOTE ] CTRE: Full fetch complete (71038 records). [2025-10-17T18:15:31.652068] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-17T18:15:31.652864] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:15:31.652974] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:15:31.653052] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:15:31.653152] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-17T18:15:31.653233] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-17T18:15:31.653272] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-17T18:15:31.653314] [DEBUG] [LOCAL ] CTRE: No derivative data file found to delete. [2025-10-17T18:15:31.653374] [INFO ] [MAIN ] Update Progress: 550/2368 symbols completed. CTRE took 32.2s. Estimated remaining: 4h 9m 26s. Rate: 7.3 symbols/min [2025-10-17T18:15:31.830458] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:31.830691] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-17T18:15:31.830748] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-17T18:15:31.830869] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-17T18:15:31.830911] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-17T18:15:31.830953] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-17T18:15:31.830986] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-17T18:15:31.963106] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-17T18:15:32.233848] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:32.314284] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T18:15:32.706750] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T18:15:32.757987] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-17T18:15:33.558027] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-17T18:15:34.040041] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T18:15:34.358036] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-17T18:15:34.670024] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T18:15:35.158005] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-17T18:15:35.329961] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:15:35.958004] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-17T18:15:36.759055] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:15:36.758144] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-17T18:15:37.393273] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T18:15:37.558020] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-17T18:15:37.853838] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:15:38.358152] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-17T18:15:38.676859] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T18:15:39.158092] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-17T18:15:39.310238] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:15:39.958071] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-17T18:15:40.445380] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T18:15:40.758095] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-17T18:15:41.087851] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T18:15:41.558042] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-17T18:15:41.804529] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-17T18:15:42.358018] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-17T18:15:43.141717] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T18:15:43.157976] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-17T18:15:43.963227] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-17T18:15:43.978956] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (4.02 seconds). [2025-10-17T18:15:44.117079] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:15:44.433282] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T18:15:44.758084] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-17T18:15:45.558037] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-17T18:15:46.358025] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-17T18:15:46.555482] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T18:15:47.158050] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-17T18:15:47.427359] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:15:47.498358] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:15:47.958052] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-17T18:15:48.616693] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:15:48.758037] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-17T18:15:49.470136] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:15:49.558033] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-17T18:15:50.358001] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-17T18:15:50.477548] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T18:15:50.484474] [INFO ] [REMOTE ] CTRI: Full fetch complete (53836 records). [2025-10-17T18:15:50.484591] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-17T18:15:50.859368] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-17T18:15:50.859461] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-17T18:15:50.860174] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-17T18:15:50.860236] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-17T18:15:50.861785] [DEBUG] [LOCAL ] CTRI: Trimmed 53836 records to 40805 (keeping 200 days of data) [2025-10-17T18:15:51.098147] [DEBUG] [LOCAL ] CTRI: Primary data saved (40805 records). [2025-10-17T18:15:51.098267] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-17T18:15:51.098339] [INFO ] [MAIN ] Update Progress: 551/2368 symbols completed. CTRI took 37.1s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-17T18:15:51.161290] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-17T18:15:51.276051] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:51.308596] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T18:15:51.364912] [DEBUG] [LOCAL ] CUBE: Loaded 51290 existing records from primary storage. [2025-10-17T18:15:51.365247] [INFO ] [MAIN ] CUBE: Loaded 51290 existing records. [2025-10-17T18:15:51.594986] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T18:15:51.594707] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:15:51.596511] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-17T18:15:51.596996] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-17T18:15:51.598463] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-17T18:15:51.598420] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T18:15:51.598578] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-17T18:15:51.963150] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-17T18:15:51.967165] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:52.758030] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-17T18:15:53.558029] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-17T18:15:53.809280] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:15:53.836391] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T18:15:54.358111] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-17T18:15:54.704490] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T18:15:55.158030] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-17T18:15:55.330500] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:15:55.958055] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-17T18:15:56.296499] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-17T18:15:56.758012] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-17T18:15:56.903869] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:15:57.558036] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-17T18:15:58.250068] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:15:58.357989] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-17T18:15:59.158076] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-17T18:15:59.450595] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:15:59.497521] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T18:15:59.958116] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-17T18:16:00.009625] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:16:00.013163] [INFO ] [REMOTE ] CTS: Full fetch complete (27234 records). [2025-10-17T18:16:00.013270] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-17T18:16:00.389710] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-17T18:16:00.389857] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-17T18:16:00.390382] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-17T18:16:00.390426] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-17T18:16:00.391382] [DEBUG] [LOCAL ] CTS: Trimmed 27234 records to 20047 (keeping 200 days of data) [2025-10-17T18:16:00.510787] [DEBUG] [LOCAL ] CTS: Primary data saved (20047 records). [2025-10-17T18:16:00.510914] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-17T18:16:00.510994] [INFO ] [MAIN ] Update Progress: 552/2368 symbols completed. CTS took 33.8s. Estimated remaining: 4h 9m 51s. Rate: 7.3 symbols/min [2025-10-17T18:16:00.673986] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:00.700032] [DEBUG] [LOCAL ] CUBI: Loaded 27422 existing records from primary storage. [2025-10-17T18:16:00.700305] [INFO ] [MAIN ] CUBI: Loaded 27422 existing records. [2025-10-17T18:16:00.763132] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-17T18:16:00.898560] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:00.898819] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-17T18:16:00.898870] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-17T18:16:00.899072] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-17T18:16:00.899127] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-17T18:16:01.245205] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:01.558048] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-17T18:16:02.340999] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-17T18:16:02.349243] [INFO ] [REMOTE ] CTVA: Full fetch complete (77211 records). [2025-10-17T18:16:02.349376] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-17T18:16:02.363125] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-17T18:16:02.678842] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T18:16:02.763913] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-17T18:16:02.764158] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-17T18:16:02.765158] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-17T18:16:02.765402] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-17T18:16:02.803474] [DEBUG] [LOCAL ] CTVA: Trimmed 77211 records to 54075 (keeping 200 days of data) [2025-10-17T18:16:02.803219] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T18:16:02.930500] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:16:03.167236] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-17T18:16:03.196310] [DEBUG] [LOCAL ] CTVA: Primary data saved (54075 records). [2025-10-17T18:16:03.196466] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-17T18:16:03.196541] [INFO ] [MAIN ] Update Progress: 553/2368 symbols completed. CTVA took 33.9s. Estimated remaining: 4h 9m 24s. Rate: 7.3 symbols/min [2025-10-17T18:16:03.376880] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:03.429929] [DEBUG] [LOCAL ] CUK: Loaded 51433 existing records from primary storage. [2025-10-17T18:16:03.430269] [INFO ] [MAIN ] CUK: Loaded 51433 existing records. [2025-10-17T18:16:03.627907] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:03.628140] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-17T18:16:03.628190] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-17T18:16:03.628639] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-17T18:16:03.628736] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-17T18:16:03.972784] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-17T18:16:04.021911] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:04.135328] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:16:04.758064] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-17T18:16:05.558007] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-17T18:16:06.017118] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T18:16:06.196953] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:16:06.358034] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-17T18:16:06.765811] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:16:07.158034] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-17T18:16:07.958024] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-17T18:16:08.213134] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T18:16:08.355008] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T18:16:08.758008] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-17T18:16:08.799116] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T18:16:09.184546] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T18:16:09.185469] [INFO ] [REMOTE ] CUBB: Full fetch complete (956 records). [2025-10-17T18:16:09.185544] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-17T18:16:09.409013] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-17T18:16:09.409217] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:16:09.409264] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:16:09.409330] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-17T18:16:09.409398] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-17T18:16:09.409435] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-17T18:16:09.409475] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-17T18:16:09.409550] [INFO ] [MAIN ] Update Progress: 554/2368 symbols completed. CUBB took 37.8s. Estimated remaining: 4h 9m 9s. Rate: 7.3 symbols/min [2025-10-17T18:16:09.567302] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-17T18:16:09.594985] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:09.600284] [DEBUG] [LOCAL ] CULP: Loaded 2930 existing records from primary storage. [2025-10-17T18:16:09.600450] [INFO ] [MAIN ] CULP: Loaded 2930 existing records. [2025-10-17T18:16:09.776620] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:09.776872] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-17T18:16:09.776946] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-17T18:16:09.777109] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-17T18:16:09.777165] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-17T18:16:10.127378] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:10.358039] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-17T18:16:11.084916] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T18:16:11.158027] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-17T18:16:11.463423] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T18:16:11.958048] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-17T18:16:12.317788] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:16:12.758050] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-17T18:16:13.303265] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T18:16:13.558058] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-17T18:16:13.944005] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T18:16:14.358059] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-17T18:16:15.158088] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-17T18:16:15.437160] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:16:15.854980] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:16:15.958043] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-17T18:16:16.758050] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-17T18:16:17.003680] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:16:17.229933] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T18:16:17.243577] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:16:17.558026] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-17T18:16:18.358042] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-17T18:16:19.158018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-17T18:16:19.330603] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T18:16:19.504950] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:16:19.958043] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-17T18:16:20.758064] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-17T18:16:21.044769] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:16:21.278417] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T18:16:21.304391] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:16:21.558037] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-17T18:16:22.358081] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-17T18:16:23.158061] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-17T18:16:23.344913] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:16:23.459076] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:16:23.958048] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-17T18:16:24.620549] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T18:16:24.758030] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-17T18:16:25.047739] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T18:16:25.245813] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T18:16:25.558041] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-17T18:16:26.358094] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-17T18:16:26.993696] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:16:27.158035] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-17T18:16:27.675019] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T18:16:27.766626] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:16:27.958026] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-17T18:16:28.758028] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-17T18:16:29.558010] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-17T18:16:29.828796] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:16:29.835940] [INFO ] [REMOTE ] CUBE: Full fetch complete (73287 records). [2025-10-17T18:16:29.836089] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-17T18:16:29.942259] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-17T18:16:30.229157] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-17T18:16:30.229253] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-17T18:16:30.230179] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-17T18:16:30.230246] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-17T18:16:30.232459] [DEBUG] [LOCAL ] CUBE: Trimmed 73287 records to 51666 (keeping 200 days of data) [2025-10-17T18:16:30.359225] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-17T18:16:30.566879] [DEBUG] [LOCAL ] CUBE: Primary data saved (51666 records). [2025-10-17T18:16:30.567041] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-17T18:16:30.567169] [INFO ] [MAIN ] Update Progress: 555/2368 symbols completed. CUBE took 39.5s. Estimated remaining: 4h 9m 43s. Rate: 7.3 symbols/min [2025-10-17T18:16:30.776578] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:30.778798] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:16:30.825279] [DEBUG] [LOCAL ] CURB: Loaded 33087 existing records from primary storage. [2025-10-17T18:16:30.825570] [INFO ] [MAIN ] CURB: Loaded 33087 existing records. [2025-10-17T18:16:31.006229] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:31.006521] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-17T18:16:31.006584] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-17T18:16:31.006957] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-17T18:16:31.007026] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-17T18:16:31.163138] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-17T18:16:31.372083] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:31.756056] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T18:16:31.759943] [INFO ] [REMOTE ] CUBI: Full fetch complete (38995 records). [2025-10-17T18:16:31.760044] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-17T18:16:31.760684] [FATAL] [VALIDATOR ] CUBI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:16:31.760775] [FATAL] [MAIN ] CUBI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:16:31.760819] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:16:31.760867] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-17T18:16:31.760960] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-17T18:16:31.761023] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-10-17T18:16:31.761258] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-10-17T18:16:31.761384] [INFO ] [MAIN ] Update Progress: 556/2368 symbols completed. CUBI took 31.3s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-17T18:16:31.933455] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:31.933713] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-17T18:16:31.933768] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-17T18:16:31.933902] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-17T18:16:31.933983] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-17T18:16:31.934072] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-17T18:16:31.934142] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-17T18:16:31.963974] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-17T18:16:32.289744] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:32.747540] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T18:16:32.757987] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-17T18:16:33.042470] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T18:16:33.136448] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-17T18:16:33.558025] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-17T18:16:34.284562] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T18:16:34.285498] [INFO ] [REMOTE ] CULP: Full fetch complete (4558 records). [2025-10-17T18:16:34.285587] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-17T18:16:34.363216] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-17T18:16:34.639584] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-17T18:16:34.639684] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-17T18:16:34.639837] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-17T18:16:34.639877] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-17T18:16:34.640218] [DEBUG] [LOCAL ] CULP: Trimmed 4558 records to 2947 (keeping 200 days of data) [2025-10-17T18:16:34.656689] [DEBUG] [LOCAL ] CULP: Primary data saved (2947 records). [2025-10-17T18:16:34.656841] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-17T18:16:34.656948] [INFO ] [MAIN ] Update Progress: 557/2368 symbols completed. CULP took 25.2s. Estimated remaining: 4h 8m 46s. Rate: 7.3 symbols/min [2025-10-17T18:16:35.158034] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-17T18:16:35.806173] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:16:35.958070] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-17T18:16:36.758088] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-17T18:16:36.948513] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T18:16:37.258166] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T18:16:37.558061] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-17T18:16:38.358042] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-17T18:16:38.545759] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T18:16:38.858479] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T18:16:39.158007] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-17T18:16:39.562259] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T18:16:39.958029] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-17T18:16:40.758041] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-17T18:16:41.100928] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T18:16:41.185084] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:16:41.192739] [INFO ] [REMOTE ] CUK: Full fetch complete (74333 records). [2025-10-17T18:16:41.192885] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-17T18:16:41.565600] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-17T18:16:41.589487] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-17T18:16:41.589575] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-17T18:16:41.590463] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-17T18:16:41.590709] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-17T18:16:41.594228] [DEBUG] [LOCAL ] CUK: Trimmed 74333 records to 51814 (keeping 200 days of data) [2025-10-17T18:16:41.904496] [DEBUG] [LOCAL ] CUK: Primary data saved (51814 records). [2025-10-17T18:16:41.904668] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-17T18:16:41.905430] [INFO ] [MAIN ] Update Progress: 558/2368 symbols completed. CUK took 38.7s. Estimated remaining: 4h 8m 35s. Rate: 7.3 symbols/min [2025-10-17T18:16:42.180816] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:16:42.358057] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-17T18:16:42.462493] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T18:16:43.158098] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-17T18:16:43.905145] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:16:43.957988] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-17T18:16:44.256971] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T18:16:44.758032] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-17T18:16:45.231410] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:16:45.442356] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T18:16:45.558047] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-17T18:16:46.358123] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-17T18:16:47.040193] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T18:16:47.157985] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-17T18:16:47.546436] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:16:47.958089] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-17T18:16:48.500974] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:16:48.758099] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-17T18:16:49.011827] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T18:16:49.558068] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-17T18:16:49.812704] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T18:16:50.358096] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-17T18:16:50.806226] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:16:51.158084] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-17T18:16:51.407195] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T18:16:51.958037] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-17T18:16:52.630028] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T18:16:52.757988] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-17T18:16:53.318395] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:16:53.323500] [INFO ] [REMOTE ] CURB: Full fetch complete (47450 records). [2025-10-17T18:16:53.323634] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-17T18:16:53.705515] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-17T18:16:53.705608] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-17T18:16:53.706405] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-17T18:16:53.706472] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-17T18:16:53.707891] [DEBUG] [LOCAL ] CURB: Trimmed 47450 records to 33392 (keeping 200 days of data) [2025-10-17T18:16:53.907109] [DEBUG] [LOCAL ] CURB: Primary data saved (33392 records). [2025-10-17T18:16:53.907243] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-17T18:16:53.907338] [INFO ] [MAIN ] Update Progress: 559/2368 symbols completed. CURB took 23.3s. Estimated remaining: 4h 8m 39s. Rate: 7.3 symbols/min [2025-10-17T18:16:54.160746] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T18:16:54.165478] [INFO ] [REMOTE ] CURV: Full fetch complete (38996 records). [2025-10-17T18:16:54.165563] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-17T18:16:54.531357] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-17T18:16:54.531427] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-17T18:16:54.532064] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-17T18:16:54.532136] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-17T18:16:54.533222] [DEBUG] [LOCAL ] CURV: Trimmed 38996 records to 27541 (keeping 200 days of data) [2025-10-17T18:16:54.685304] [DEBUG] [LOCAL ] CURV: Primary data saved (27541 records). [2025-10-17T18:16:54.685486] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-17T18:16:54.685597] [INFO ] [MAIN ] Update Progress: 560/2368 symbols completed. CURV took 22.9s. Estimated remaining: 4h 8m 6s. Rate: 7.3 symbols/min [2025-10-17T18:16:55.157391] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.219707] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-17T18:16:55.244026] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-17T18:16:55.316681] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.328173] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.317017] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-17T18:16:55.328377] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-17T18:16:55.347887] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-17T18:16:55.348246] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-17T18:16:55.376600] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.721392] [DEBUG] [LOCAL ] CUZ: Loaded 50005 existing records from primary storage. [2025-10-17T18:16:55.737790] [DEBUG] [LOCAL ] CVE: Loaded 53952 existing records from primary storage. [2025-10-17T18:16:55.738166] [INFO ] [MAIN ] CUZ: Loaded 50005 existing records. [2025-10-17T18:16:55.748775] [INFO ] [MAIN ] CVE: Loaded 53952 existing records. [2025-10-17T18:16:55.966960] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:56.007981] [DEBUG] [LOCAL ] CVI: Loaded 47001 existing records from primary storage. [2025-10-17T18:16:56.017730] [INFO ] [MAIN ] CVI: Loaded 47001 existing records. [2025-10-17T18:16:56.013611] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-17T18:16:56.294625] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:56.307246] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:56.307550] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-17T18:16:56.307691] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-17T18:16:56.318151] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-17T18:16:56.323374] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-17T18:16:56.381531] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-17T18:16:56.386226] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-17T18:16:56.386183] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:56.386454] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-17T18:16:56.386707] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-17T18:16:56.386611] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-17T18:16:56.446934] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-17T18:16:56.550707] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-17T18:16:56.581808] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-17T18:16:57.301831] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:16:57.328543] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:57.375053] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-17T18:16:57.374807] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-17T18:16:57.427194] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:57.427635] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-17T18:16:57.521585] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:57.522000] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-17T18:16:58.182374] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:16:58.184789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-17T18:16:59.100617] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T18:16:59.103803] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-17T18:16:59.155455] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:16:59.165696] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-17T18:16:59.368275] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T18:16:59.444685] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T18:16:59.812305] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-17T18:16:59.958032] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-17T18:17:00.767824] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-17T18:17:00.772937] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:17:01.558035] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-17T18:17:01.734511] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:17:01.801370] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T18:17:02.358056] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-17T18:17:03.117231] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T18:17:03.158001] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-17T18:17:03.408959] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:17:03.958030] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-17T18:17:04.645191] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:17:04.758005] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-17T18:17:04.908904] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T18:17:05.558067] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-17T18:17:06.257544] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:17:06.358067] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-17T18:17:07.158039] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-17T18:17:07.239478] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:17:07.294971] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T18:17:07.958090] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-17T18:17:08.512578] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T18:17:08.758035] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-17T18:17:08.853557] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T18:17:09.558011] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-17T18:17:09.605864] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T18:17:10.358080] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-17T18:17:11.158019] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-17T18:17:11.441244] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T18:17:11.958053] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-17T18:17:12.388560] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T18:17:12.758023] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-17T18:17:12.914373] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:17:13.558065] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-17T18:17:13.670197] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T18:17:14.358004] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-17T18:17:14.511104] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:17:14.513978] [INFO ] [REMOTE ] CVEO: Full fetch complete (20833 records). [2025-10-17T18:17:14.514063] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-17T18:17:14.852985] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T18:17:14.941966] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-17T18:17:14.942046] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-17T18:17:14.942510] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-17T18:17:14.942552] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-17T18:17:14.943167] [DEBUG] [LOCAL ] CVEO: Trimmed 20833 records to 15568 (keeping 200 days of data) [2025-10-17T18:17:15.031087] [DEBUG] [LOCAL ] CVEO: Primary data saved (15568 records). [2025-10-17T18:17:15.031227] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-17T18:17:15.031298] [INFO ] [MAIN ] Update Progress: 561/2368 symbols completed. CVEO took 20.3s. Estimated remaining: 4h 8m 37s. Rate: 7.3 symbols/min [2025-10-17T18:17:15.172758] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-17T18:17:15.206332] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:15.223196] [DEBUG] [LOCAL ] CVLG: Loaded 15699 existing records from primary storage. [2025-10-17T18:17:15.223474] [INFO ] [MAIN ] CVLG: Loaded 15699 existing records. [2025-10-17T18:17:15.404081] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:15.404326] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-17T18:17:15.404385] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-17T18:17:15.404560] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-17T18:17:15.404600] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-17T18:17:15.782336] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:15.958026] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-17T18:17:16.247499] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:17:16.758041] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-17T18:17:16.950117] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T18:17:17.133702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T18:17:17.558041] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-17T18:17:18.305834] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T18:17:18.352327] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T18:17:18.357977] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-17T18:17:19.158023] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-17T18:17:19.305003] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:17:19.958094] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-17T18:17:20.758096] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-17T18:17:20.980702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:17:21.558048] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-17T18:17:21.865955] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T18:17:22.358085] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-17T18:17:22.458222] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T18:17:22.593987] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T18:17:23.158068] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-17T18:17:23.958025] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-17T18:17:24.259503] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T18:17:24.428326] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T18:17:24.758002] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-17T18:17:25.558018] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-17T18:17:25.627776] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T18:17:25.629335] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:17:26.358107] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-17T18:17:27.158026] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-17T18:17:27.207341] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:17:27.600751] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:17:27.958035] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-17T18:17:28.758043] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-17T18:17:29.059933] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:17:29.558027] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-17T18:17:29.640279] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T18:17:29.816626] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:17:30.358046] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-17T18:17:30.937044] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:17:31.158024] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-17T18:17:31.958026] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-17T18:17:32.252670] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:17:32.758060] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-17T18:17:32.888483] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T18:17:33.558000] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-17T18:17:33.797183] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:17:33.803998] [INFO ] [REMOTE ] CUZ: Full fetch complete (70957 records). [2025-10-17T18:17:33.804118] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-17T18:17:34.188595] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-17T18:17:34.188760] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-17T18:17:34.189587] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-17T18:17:34.189632] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-17T18:17:34.191029] [DEBUG] [LOCAL ] CUZ: Trimmed 70957 records to 50363 (keeping 200 days of data) [2025-10-17T18:17:34.381017] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-17T18:17:34.434827] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T18:17:34.459736] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:17:34.474448] [INFO ] [REMOTE ] CVE: Full fetch complete (77716 records). [2025-10-17T18:17:34.475312] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-17T18:17:34.891578] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-17T18:17:34.892215] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-17T18:17:34.893141] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-17T18:17:34.893224] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-17T18:17:34.901294] [DEBUG] [LOCAL ] CVE: Trimmed 77716 records to 54342 (keeping 200 days of data) [2025-10-17T18:17:35.173147] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-17T18:17:35.187462] [DEBUG] [LOCAL ] CUZ: Primary data saved (50363 records). [2025-10-17T18:17:35.188420] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-17T18:17:35.189595] [INFO ] [MAIN ] Update Progress: 562/2368 symbols completed. CUZ took 40.5s. Estimated remaining: 4h 9m 7s. Rate: 7.2 symbols/min [2025-10-17T18:17:35.454160] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:35.459181] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-17T18:17:35.467775] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-17T18:17:35.472906] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-17T18:17:35.473003] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-17T18:17:35.479683] [DEBUG] [LOCAL ] CVE: Primary data saved (54342 records). [2025-10-17T18:17:35.479623] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-17T18:17:35.479818] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-17T18:17:35.479887] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-17T18:17:35.480005] [INFO ] [MAIN ] Update Progress: 563/2368 symbols completed. CVE took 40.8s. Estimated remaining: 4h 8m 33s. Rate: 7.3 symbols/min [2025-10-17T18:17:35.849352] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:36.028424] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:36.028845] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-17T18:17:36.067385] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-17T18:17:36.075599] [INFO ] [MAIN ] CVS: Loaded 54084 existing records. [2025-10-17T18:17:36.076441] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T18:17:36.258056] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:36.258266] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-17T18:17:36.258313] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-17T18:17:36.258632] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-17T18:17:36.258774] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-17T18:17:36.428678] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T18:17:36.645789] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:36.757998] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-17T18:17:37.558017] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-17T18:17:38.062762] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T18:17:38.357997] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-17T18:17:38.592995] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:17:38.596429] [INFO ] [REMOTE ] CVLG: Full fetch complete (21375 records). [2025-10-17T18:17:38.596593] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-17T18:17:38.968728] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-17T18:17:38.968894] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-17T18:17:38.969434] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-17T18:17:38.969514] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-17T18:17:38.980977] [DEBUG] [LOCAL ] CVLG: Trimmed 21375 records to 15760 (keeping 200 days of data) [2025-10-17T18:17:39.007890] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-17T18:17:39.111197] [DEBUG] [LOCAL ] CVLG: Primary data saved (15760 records). [2025-10-17T18:17:39.111334] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-17T18:17:39.111414] [INFO ] [MAIN ] Update Progress: 564/2368 symbols completed. CVLG took 24.1s. Estimated remaining: 4h 8m 10s. Rate: 7.3 symbols/min [2025-10-17T18:17:39.166127] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-17T18:17:39.280781] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:39.332793] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-17T18:17:39.333162] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-10-17T18:17:39.505987] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:39.506181] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-17T18:17:39.506228] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-17T18:17:39.506516] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-17T18:17:39.506555] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-17T18:17:39.857193] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:39.958015] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-17T18:17:40.579326] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-17T18:17:40.758022] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-17T18:17:40.891436] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:17:40.898084] [INFO ] [REMOTE ] CVI: Full fetch complete (67244 records). [2025-10-17T18:17:40.898185] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-17T18:17:41.280238] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-17T18:17:41.280316] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-17T18:17:41.281218] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-17T18:17:41.281282] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-17T18:17:41.282592] [DEBUG] [LOCAL ] CVI: Trimmed 67244 records to 47330 (keeping 200 days of data) [2025-10-17T18:17:41.554915] [DEBUG] [LOCAL ] CVI: Primary data saved (47330 records). [2025-10-17T18:17:41.555049] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-17T18:17:41.555132] [INFO ] [MAIN ] Update Progress: 565/2368 symbols completed. CVI took 46.9s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-10-17T18:17:41.566545] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-17T18:17:41.724146] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:41.724342] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-10-17T18:17:41.724419] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-10-17T18:17:41.724535] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-17T18:17:41.724575] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-17T18:17:41.724616] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-17T18:17:41.724674] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-17T18:17:42.078018] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:42.245333] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T18:17:42.358036] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-17T18:17:42.973540] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-17T18:17:43.158010] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-17T18:17:43.608760] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T18:17:43.958068] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-17T18:17:44.647862] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T18:17:44.751045] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T18:17:44.761430] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-17T18:17:45.558037] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-17T18:17:46.075379] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:17:46.188148] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T18:17:46.358042] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-17T18:17:47.158048] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-17T18:17:47.265755] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T18:17:47.958004] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-17T18:17:48.505375] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T18:17:48.758126] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-17T18:17:49.558048] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-17T18:17:49.630044] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-17T18:17:49.950083] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T18:17:50.126158] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T18:17:50.358026] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-17T18:17:51.158035] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-17T18:17:51.857466] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-17T18:17:51.958014] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-17T18:17:52.403128] [DEBUG] [REMOTE ] CVX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T18:17:52.403439] [WARN ] [REMOTE ] CVX: No data returned for month 2025-04 [2025-10-17T18:17:52.403532] [FATAL] [REMOTE ] CVX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:17:52.403634] [FATAL] [MAIN ] CVX: Failed to fetch primary data. [2025-10-17T18:17:52.403737] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:17:52.403811] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-17T18:17:52.403877] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-17T18:17:52.403914] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-17T18:17:52.404131] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-17T18:17:52.404217] [INFO ] [MAIN ] Update Progress: 566/2368 symbols completed. CVX took 13.3s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-10-17T18:17:52.579014] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-17T18:17:52.624296] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:52.678016] [DEBUG] [LOCAL ] CWAN: Loaded 53002 existing records from primary storage. [2025-10-17T18:17:52.678342] [INFO ] [MAIN ] CWAN: Loaded 53002 existing records. [2025-10-17T18:17:52.763237] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-17T18:17:52.864728] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:52.864919] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-17T18:17:52.864967] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-17T18:17:52.865289] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-17T18:17:52.865329] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-17T18:17:53.223750] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:53.480120] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T18:17:53.558010] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-17T18:17:54.358100] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-17T18:17:54.860458] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T18:17:55.158009] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-17T18:17:55.645497] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-17T18:17:55.691521] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:17:55.958046] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-17T18:17:56.758031] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-17T18:17:57.262418] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T18:17:57.558017] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-17T18:17:58.094159] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:17:58.339988] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-17T18:17:58.358002] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-17T18:17:59.158042] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-17T18:17:59.359629] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:17:59.958042] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-17T18:18:00.449088] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:18:00.758033] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-17T18:18:01.092755] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T18:18:01.520197] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:18:01.558065] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-17T18:18:02.358005] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-17T18:18:02.635335] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T18:18:03.158020] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-17T18:18:03.434033] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:18:03.879547] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-17T18:18:03.958082] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-17T18:18:04.758005] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-17T18:18:04.821840] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T18:18:05.558059] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-17T18:18:06.254555] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-17T18:18:06.265133] [INFO ] [REMOTE ] CVNA: Full fetch complete (76760 records). [2025-10-17T18:18:06.265302] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-17T18:18:06.359460] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-17T18:18:06.677138] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-17T18:18:06.677354] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-17T18:18:06.678381] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-17T18:18:06.678474] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-17T18:18:06.680250] [DEBUG] [LOCAL ] CVNA: Trimmed 76760 records to 53628 (keeping 200 days of data) [2025-10-17T18:18:06.801015] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T18:18:07.048319] [DEBUG] [LOCAL ] CVNA: Primary data saved (53628 records). [2025-10-17T18:18:07.048431] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-17T18:18:07.048504] [INFO ] [MAIN ] Update Progress: 567/2368 symbols completed. CVNA took 31.9s. Estimated remaining: 4h 7m 55s. Rate: 7.3 symbols/min [2025-10-17T18:18:07.159725] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-17T18:18:07.226673] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:07.264563] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T18:18:07.303458] [DEBUG] [LOCAL ] CWEN: Loaded 45638 existing records from primary storage. [2025-10-17T18:18:07.303812] [INFO ] [MAIN ] CWEN: Loaded 45638 existing records. [2025-10-17T18:18:07.491275] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:07.491555] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-17T18:18:07.491718] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-17T18:18:07.492148] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-17T18:18:07.492208] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-17T18:18:07.657925] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:18:07.888860] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:07.957986] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-17T18:18:08.036438] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T18:18:08.044038] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-17T18:18:08.044167] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-17T18:18:08.454028] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-17T18:18:08.454113] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-17T18:18:08.455001] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-17T18:18:08.455065] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-17T18:18:08.456491] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54474 (keeping 200 days of data) [2025-10-17T18:18:08.759360] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-17T18:18:08.786213] [DEBUG] [LOCAL ] CVS: Primary data saved (54474 records). [2025-10-17T18:18:08.786323] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-17T18:18:08.786400] [INFO ] [MAIN ] Update Progress: 568/2368 symbols completed. CVS took 33.3s. Estimated remaining: 4h 7m 26s. Rate: 7.3 symbols/min [2025-10-17T18:18:08.962744] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:09.014000] [DEBUG] [LOCAL ] CWH: Loaded 51694 existing records from primary storage. [2025-10-17T18:18:09.014315] [INFO ] [MAIN ] CWH: Loaded 51694 existing records. [2025-10-17T18:18:09.197280] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:09.197536] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-17T18:18:09.197602] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-17T18:18:09.198193] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-17T18:18:09.198255] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-17T18:18:09.556409] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:09.565912] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-17T18:18:09.581855] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:18:10.358020] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-17T18:18:10.392231] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:18:11.158013] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-17T18:18:11.348714] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:18:11.623979] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T18:18:11.958028] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-17T18:18:12.758102] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-17T18:18:12.806709] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:18:13.111544] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T18:18:13.558028] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-17T18:18:14.320798] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T18:18:14.358087] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-17T18:18:15.158086] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-17T18:18:15.302708] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:18:15.423127] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:18:15.958035] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-17T18:18:16.503350] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:18:16.758055] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-17T18:18:17.089421] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:18:17.093028] [INFO ] [REMOTE ] CW: Full fetch complete (33159 records). [2025-10-17T18:18:17.093161] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-17T18:18:17.469843] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-17T18:18:17.469919] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-17T18:18:17.470448] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-17T18:18:17.470487] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-17T18:18:17.471268] [DEBUG] [LOCAL ] CW: Trimmed 33159 records to 22372 (keeping 200 days of data) [2025-10-17T18:18:17.559584] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-17T18:18:17.614968] [DEBUG] [LOCAL ] CW: Primary data saved (22372 records). [2025-10-17T18:18:17.615146] [INFO ] [MAIN ] CW: Full history saved. [2025-10-17T18:18:17.615249] [INFO ] [MAIN ] Update Progress: 569/2368 symbols completed. CW took 36.1s. Estimated remaining: 4h 7m 20s. Rate: 7.3 symbols/min [2025-10-17T18:18:17.810022] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:17.857776] [DEBUG] [LOCAL ] CWK: Loaded 49995 existing records from primary storage. [2025-10-17T18:18:17.858106] [INFO ] [MAIN ] CWK: Loaded 49995 existing records. [2025-10-17T18:18:18.055811] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:18.056185] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-17T18:18:18.056325] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-17T18:18:18.056768] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-17T18:18:18.056837] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-17T18:18:18.370300] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-17T18:18:18.466031] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:18.491452] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:18:18.745852] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:18:19.158040] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-17T18:18:19.958063] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-17T18:18:20.138735] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:18:20.758007] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-17T18:18:21.095427] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:18:21.558009] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-17T18:18:21.743366] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T18:18:22.358018] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-17T18:18:22.631486] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:18:23.158052] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-17T18:18:23.500785] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:18:23.566807] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T18:18:23.958031] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-17T18:18:24.649109] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:18:24.757995] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-17T18:18:25.558008] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-17T18:18:25.616558] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:18:26.308243] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:18:26.358034] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-17T18:18:27.158071] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-17T18:18:27.234396] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:18:27.958071] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-17T18:18:28.107948] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:18:28.758038] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-17T18:18:28.852298] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:18:28.859850] [INFO ] [REMOTE ] CWAN: Full fetch complete (75555 records). [2025-10-17T18:18:28.859986] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-17T18:18:29.261889] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-17T18:18:29.262003] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-17T18:18:29.262969] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-17T18:18:29.263037] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-17T18:18:29.264588] [DEBUG] [LOCAL ] CWAN: Trimmed 75555 records to 53387 (keeping 200 days of data) [2025-10-17T18:18:29.560572] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-17T18:18:29.589621] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:18:29.618165] [DEBUG] [LOCAL ] CWAN: Primary data saved (53387 records). [2025-10-17T18:18:29.618310] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-17T18:18:29.618392] [INFO ] [MAIN ] Update Progress: 570/2368 symbols completed. CWAN took 37.2s. Estimated remaining: 4h 7m 24s. Rate: 7.3 symbols/min [2025-10-17T18:18:29.781086] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:29.808827] [DEBUG] [LOCAL ] CWT: Loaded 28331 existing records from primary storage. [2025-10-17T18:18:29.809097] [INFO ] [MAIN ] CWT: Loaded 28331 existing records. [2025-10-17T18:18:29.981431] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:29.981634] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-17T18:18:29.981716] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-17T18:18:29.981910] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-17T18:18:29.981967] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-17T18:18:30.344478] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:30.357989] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-17T18:18:30.421575] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:18:31.157989] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-17T18:18:31.436286] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T18:18:31.958069] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-17T18:18:32.244967] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:18:32.758010] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-17T18:18:32.791770] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:18:33.546682] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T18:18:33.558021] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-17T18:18:33.994187] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T18:18:34.358060] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-17T18:18:35.161402] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-17T18:18:35.166769] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T18:18:35.668284] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T18:18:35.958036] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-17T18:18:36.651909] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:18:36.758012] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-17T18:18:37.558029] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-17T18:18:37.609932] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T18:18:38.358042] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-17T18:18:38.417152] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T18:18:38.712669] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:18:39.158085] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-17T18:18:39.958038] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-17T18:18:40.074188] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:18:40.421063] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T18:18:40.758037] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-17T18:18:41.456203] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:18:41.466714] [INFO ] [REMOTE ] CWEN: Full fetch complete (65531 records). [2025-10-17T18:18:41.466925] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-17T18:18:41.563209] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-17T18:18:41.892541] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-17T18:18:41.892666] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-17T18:18:41.893564] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-17T18:18:41.893697] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-17T18:18:41.912766] [DEBUG] [LOCAL ] CWEN: Trimmed 65531 records to 45984 (keeping 200 days of data) [2025-10-17T18:18:41.914319] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T18:18:42.221058] [DEBUG] [LOCAL ] CWEN: Primary data saved (45984 records). [2025-10-17T18:18:42.221200] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-17T18:18:42.221901] [INFO ] [MAIN ] Update Progress: 571/2368 symbols completed. CWEN took 35.2s. Estimated remaining: 4h 7m 29s. Rate: 7.3 symbols/min [2025-10-17T18:18:42.363176] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-17T18:18:42.394931] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:42.395057] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-10-17T18:18:42.395094] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-10-17T18:18:42.395209] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-17T18:18:42.395249] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-17T18:18:42.395290] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-17T18:18:42.395323] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-17T18:18:42.760517] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:43.158019] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-17T18:18:43.416695] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:18:43.702992] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:18:43.958020] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-17T18:18:44.758055] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-17T18:18:44.908587] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:18:45.293301] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T18:18:45.558027] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-17T18:18:46.370624] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-17T18:18:46.373394] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:18:46.818892] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:18:47.158035] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-17T18:18:47.958003] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-17T18:18:48.145241] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:18:48.758038] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-17T18:18:48.891714] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T18:18:49.562119] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-17T18:18:49.635027] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:18:49.952037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T18:18:50.358037] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-17T18:18:51.158019] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-17T18:18:51.359499] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:18:51.366551] [INFO ] [REMOTE ] CWK: Full fetch complete (71323 records). [2025-10-17T18:18:51.366707] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-17T18:18:51.769139] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-17T18:18:51.769288] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-17T18:18:51.770273] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-17T18:18:51.770355] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-17T18:18:51.772536] [DEBUG] [LOCAL ] CWK: Trimmed 71323 records to 50364 (keeping 200 days of data) [2025-10-17T18:18:51.891730] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T18:18:51.903022] [INFO ] [REMOTE ] CWH: Full fetch complete (73217 records). [2025-10-17T18:18:51.909506] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-17T18:18:51.968455] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-17T18:18:52.455970] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-17T18:18:52.456347] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-17T18:18:52.470151] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-17T18:18:52.469260] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:18:52.477447] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-17T18:18:52.506846] [DEBUG] [LOCAL ] CWH: Trimmed 73217 records to 52055 (keeping 200 days of data) [2025-10-17T18:18:52.654502] [DEBUG] [LOCAL ] CWK: Primary data saved (50364 records). [2025-10-17T18:18:52.654983] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-17T18:18:52.655366] [INFO ] [MAIN ] Update Progress: 572/2368 symbols completed. CWK took 35.0s. Estimated remaining: 4h 7m 28s. Rate: 7.3 symbols/min [2025-10-17T18:18:52.760782] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-17T18:18:52.843245] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:52.858013] [DEBUG] [LOCAL ] CXE: Loaded 6167 existing records from primary storage. [2025-10-17T18:18:52.859205] [INFO ] [MAIN ] CXE: Loaded 6167 existing records. [2025-10-17T18:18:53.138765] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:53.145067] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-17T18:18:53.145684] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-17T18:18:53.146247] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-17T18:18:53.146620] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-17T18:18:53.526473] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:53.565208] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-17T18:18:53.609946] [DEBUG] [LOCAL ] CWH: Primary data saved (52055 records). [2025-10-17T18:18:53.610221] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-17T18:18:53.610958] [INFO ] [MAIN ] Update Progress: 573/2368 symbols completed. CWH took 44.8s. Estimated remaining: 4h 6m 56s. Rate: 7.3 symbols/min [2025-10-17T18:18:53.789779] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:53.790000] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-10-17T18:18:53.790189] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-10-17T18:18:53.790406] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-17T18:18:53.790602] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-17T18:18:53.790732] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-17T18:18:53.790832] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-17T18:18:53.928046] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:18:54.185410] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T18:18:54.231953] [INFO ] [REMOTE ] CWT: Full fetch complete (41108 records). [2025-10-17T18:18:54.231848] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:54.232334] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-17T18:18:54.370061] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-17T18:18:54.505805] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T18:18:54.618580] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-17T18:18:54.618687] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-17T18:18:54.619336] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-17T18:18:54.619396] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-17T18:18:54.620395] [DEBUG] [LOCAL ] CWT: Trimmed 41108 records to 28510 (keeping 200 days of data) [2025-10-17T18:18:54.783247] [DEBUG] [LOCAL ] CWT: Primary data saved (28510 records). [2025-10-17T18:18:54.783381] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-17T18:18:54.783483] [INFO ] [MAIN ] Update Progress: 574/2368 symbols completed. CWT took 25.2s. Estimated remaining: 4h 6m 26s. Rate: 7.3 symbols/min [2025-10-17T18:18:54.949163] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:54.993754] [DEBUG] [LOCAL ] CXM: Loaded 47906 existing records from primary storage. [2025-10-17T18:18:54.994072] [INFO ] [MAIN ] CXM: Loaded 47906 existing records. [2025-10-17T18:18:55.168216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-17T18:18:55.209779] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:55.210697] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-17T18:18:55.210758] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-17T18:18:55.210954] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-17T18:18:55.210996] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-17T18:18:55.583719] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:55.839551] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T18:18:55.958055] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-17T18:18:56.203379] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T18:18:56.404960] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T18:18:56.758056] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-17T18:18:57.558020] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-17T18:18:58.050070] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:18:58.358004] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-17T18:18:58.653718] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:18:59.158031] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-17T18:18:59.958048] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-17T18:19:00.102529] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:19:00.396293] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T18:19:00.758004] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-17T18:19:01.054138] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:19:01.558024] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-17T18:19:02.358057] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-17T18:19:02.482678] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T18:19:02.854042] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:19:02.972983] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:19:03.158046] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-17T18:19:03.808447] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T18:19:03.958035] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-17T18:19:04.758024] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-17T18:19:04.947390] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T18:19:05.558020] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-17T18:19:06.358028] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-17T18:19:06.443439] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:19:06.599850] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T18:19:07.097844] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T18:19:07.158103] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-17T18:19:07.958072] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-17T18:19:08.707477] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:19:08.758466] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-17T18:19:08.760390] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T18:19:09.558013] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-17T18:19:10.358059] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-17T18:19:10.366713] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T18:19:10.412920] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:19:11.158061] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-17T18:19:11.174195] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T18:19:11.760533] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:19:11.958045] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-17T18:19:12.564580] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T18:19:12.758070] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-17T18:19:13.558016] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-17T18:19:14.358003] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-17T18:19:14.397485] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T18:19:14.398346] [INFO ] [REMOTE ] CXH: Full fetch complete (5321 records). [2025-10-17T18:19:14.398414] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-17T18:19:14.556518] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T18:19:14.795612] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-17T18:19:14.795723] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-17T18:19:14.795901] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-17T18:19:14.795952] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-17T18:19:14.796381] [DEBUG] [LOCAL ] CXH: Trimmed 5321 records to 4462 (keeping 200 days of data) [2025-10-17T18:19:14.822757] [DEBUG] [LOCAL ] CXH: Primary data saved (4462 records). [2025-10-17T18:19:14.822908] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-17T18:19:14.822986] [INFO ] [MAIN ] Update Progress: 575/2368 symbols completed. CXH took 21.2s. Estimated remaining: 4h 6m 55s. Rate: 7.3 symbols/min [2025-10-17T18:19:14.995214] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:15.028423] [DEBUG] [LOCAL ] CXT: Loaded 31299 existing records from primary storage. [2025-10-17T18:19:15.028750] [INFO ] [MAIN ] CXT: Loaded 31299 existing records. [2025-10-17T18:19:15.168333] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-17T18:19:15.210368] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:15.216977] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T18:19:15.218922] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-17T18:19:15.219751] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-17T18:19:15.220046] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-17T18:19:15.220090] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-17T18:19:15.587202] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:15.958097] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-17T18:19:16.758061] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-17T18:19:16.898590] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:19:17.284163] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T18:19:17.433487] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T18:19:17.557996] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-17T18:19:18.174082] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T18:19:18.358026] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-17T18:19:18.969365] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T18:19:19.158014] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-17T18:19:19.958092] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-17T18:19:20.758057] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-17T18:19:20.765754] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T18:19:20.942097] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:19:21.558031] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-17T18:19:22.160617] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T18:19:22.358064] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-17T18:19:23.062680] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:19:23.158054] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-17T18:19:23.958015] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-17T18:19:24.060571] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T18:19:24.758013] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-17T18:19:24.876625] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T18:19:24.997940] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T18:19:25.558026] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-17T18:19:25.660572] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T18:19:25.662344] [INFO ] [REMOTE ] CXE: Full fetch complete (11432 records). [2025-10-17T18:19:25.662462] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-17T18:19:26.024395] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-17T18:19:26.024479] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-17T18:19:26.024793] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-17T18:19:26.024877] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-17T18:19:26.025308] [DEBUG] [LOCAL ] CXE: Trimmed 11432 records to 6233 (keeping 200 days of data) [2025-10-17T18:19:26.064586] [DEBUG] [LOCAL ] CXE: Primary data saved (6233 records). [2025-10-17T18:19:26.064787] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-17T18:19:26.064911] [INFO ] [MAIN ] Update Progress: 576/2368 symbols completed. CXE took 33.4s. Estimated remaining: 4h 6m 56s. Rate: 7.3 symbols/min [2025-10-17T18:19:26.228993] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:26.269580] [DEBUG] [LOCAL ] CXW: Loaded 44193 existing records from primary storage. [2025-10-17T18:19:26.269898] [INFO ] [MAIN ] CXW: Loaded 44193 existing records. [2025-10-17T18:19:26.366754] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-17T18:19:26.462776] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:26.462997] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-17T18:19:26.463048] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-17T18:19:26.463444] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-17T18:19:26.463501] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-17T18:19:26.846919] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:26.983986] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:19:27.158012] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-17T18:19:27.958089] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-17T18:19:28.187219] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:19:28.194576] [INFO ] [REMOTE ] CX: Full fetch complete (76581 records). [2025-10-17T18:19:28.194737] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-17T18:19:28.589689] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-17T18:19:28.589841] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-17T18:19:28.590881] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-17T18:19:28.591000] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-17T18:19:28.592733] [DEBUG] [LOCAL ] CX: Trimmed 76581 records to 53605 (keeping 200 days of data) [2025-10-17T18:19:28.699302] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:19:28.787094] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-17T18:19:28.939597] [DEBUG] [LOCAL ] CX: Primary data saved (53605 records). [2025-10-17T18:19:28.939831] [INFO ] [MAIN ] CX: Full history saved. [2025-10-17T18:19:28.939930] [INFO ] [MAIN ] Update Progress: 577/2368 symbols completed. CX took 46.7s. Estimated remaining: 4h 6m 31s. Rate: 7.3 symbols/min [2025-10-17T18:19:29.108540] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:29.108793] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-17T18:19:29.108848] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-17T18:19:29.108959] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-17T18:19:29.109002] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-17T18:19:29.109049] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-17T18:19:29.109083] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-17T18:19:29.468854] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:29.548199] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:19:29.557981] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-17T18:19:30.149031] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T18:19:30.330467] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T18:19:30.357977] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-17T18:19:30.978562] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:19:31.158036] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-17T18:19:31.958070] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-17T18:19:32.725706] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:19:32.757985] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-17T18:19:33.140437] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:19:33.558029] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-17T18:19:34.351443] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T18:19:34.360980] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-17T18:19:34.989743] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:19:35.158071] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-17T18:19:35.624843] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:19:35.958041] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-17T18:19:36.513060] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T18:19:36.758028] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-17T18:19:37.384363] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T18:19:37.558015] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-17T18:19:37.856080] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T18:19:38.358031] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-17T18:19:39.158046] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-17T18:19:39.223057] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:19:39.958060] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-17T18:19:40.165805] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:19:40.172252] [INFO ] [REMOTE ] CXM: Full fetch complete (68681 records). [2025-10-17T18:19:40.172389] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-17T18:19:40.540443] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T18:19:40.582749] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-17T18:19:40.582819] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-17T18:19:40.583715] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-17T18:19:40.583785] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-17T18:19:40.585097] [DEBUG] [LOCAL ] CXM: Trimmed 68681 records to 48245 (keeping 200 days of data) [2025-10-17T18:19:40.771850] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-17T18:19:40.846902] [DEBUG] [LOCAL ] CXM: Primary data saved (48245 records). [2025-10-17T18:19:40.847034] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-17T18:19:40.847113] [INFO ] [MAIN ] Update Progress: 578/2368 symbols completed. CXM took 46.1s. Estimated remaining: 4h 6m 34s. Rate: 7.3 symbols/min [2025-10-17T18:19:41.011732] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:41.053033] [DEBUG] [LOCAL ] CYH: Loaded 48083 existing records from primary storage. [2025-10-17T18:19:41.053342] [INFO ] [MAIN ] CYH: Loaded 48083 existing records. [2025-10-17T18:19:41.232394] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:41.232673] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-17T18:19:41.232734] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-17T18:19:41.232918] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-17T18:19:41.232956] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-17T18:19:41.583314] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:41.577889] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-17T18:19:41.610726] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:19:42.080292] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T18:19:42.357993] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-17T18:19:43.005819] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T18:19:43.157992] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-17T18:19:43.958012] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-17T18:19:44.048112] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T18:19:44.516969] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:19:44.758004] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-17T18:19:45.174903] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T18:19:45.558042] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-17T18:19:45.812870] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T18:19:46.358015] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-17T18:19:47.158026] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-17T18:19:47.195160] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:19:47.672974] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:19:47.958074] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-17T18:19:48.758000] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-17T18:19:49.079777] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T18:19:49.333091] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:19:49.338136] [INFO ] [REMOTE ] CXT: Full fetch complete (45732 records). [2025-10-17T18:19:49.338296] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-17T18:19:49.563725] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-17T18:19:49.719839] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-17T18:19:49.719959] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-17T18:19:49.720675] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-17T18:19:49.720740] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-17T18:19:49.721889] [DEBUG] [LOCAL ] CXT: Trimmed 45732 records to 31488 (keeping 200 days of data) [2025-10-17T18:19:49.907020] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T18:19:49.914342] [INFO ] [REMOTE ] CYD: Full fetch complete (35318 records). [2025-10-17T18:19:49.914725] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-17T18:19:50.256191] [DEBUG] [LOCAL ] CXT: Primary data saved (31488 records). [2025-10-17T18:19:50.279837] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-17T18:19:50.289905] [INFO ] [MAIN ] Update Progress: 579/2368 symbols completed. CXT took 35.5s. Estimated remaining: 4h 6m 29s. Rate: 7.3 symbols/min [2025-10-17T18:19:50.365165] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-17T18:19:50.388036] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-17T18:19:50.363113] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-17T18:19:50.393971] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-17T18:19:50.429892] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-17T18:19:50.498431] [DEBUG] [LOCAL ] CYD: Trimmed 35318 records to 27356 (keeping 200 days of data) [2025-10-17T18:19:50.501671] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:50.692682] [DEBUG] [LOCAL ] CYD: Primary data saved (27356 records). [2025-10-17T18:19:50.687815] [DEBUG] [LOCAL ] D: Loaded 54036 existing records from primary storage. [2025-10-17T18:19:50.692936] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-17T18:19:50.693085] [INFO ] [MAIN ] D: Loaded 54036 existing records. [2025-10-17T18:19:50.693186] [INFO ] [MAIN ] Update Progress: 580/2368 symbols completed. CYD took 21.8s. Estimated remaining: 4h 5m 56s. Rate: 7.3 symbols/min [2025-10-17T18:19:51.041781] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:51.019971] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:51.042116] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-17T18:19:51.042439] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-17T18:19:51.042858] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-17T18:19:51.042914] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-17T18:19:51.174261] [DEBUG] [LOCAL ] DAC: Loaded 12709 existing records from primary storage. [2025-10-17T18:19:51.196271] [INFO ] [MAIN ] DAC: Loaded 12709 existing records. [2025-10-17T18:19:51.607045] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:51.591752] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:51.621701] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-17T18:19:51.624188] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-17T18:19:51.621517] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-17T18:19:51.625302] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-17T18:19:51.625717] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-17T18:19:51.626967] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-17T18:19:51.961800] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-17T18:19:52.003692] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:52.032506] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:19:52.758038] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-17T18:19:53.558864] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-17T18:19:53.561939] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:19:53.677768] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:19:53.699593] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T18:19:54.358047] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-17T18:19:55.140307] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T18:19:55.157998] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-17T18:19:55.958005] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-17T18:19:56.191676] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:19:56.352107] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:19:56.758049] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-17T18:19:56.930087] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:19:57.558070] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-17T18:19:58.225612] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T18:19:58.358089] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-17T18:19:59.166844] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-17T18:19:59.186423] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:19:59.958101] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-17T18:20:00.153060] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:20:00.294962] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:20:00.758100] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-17T18:20:01.558022] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-17T18:20:01.831061] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T18:20:02.358050] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-17T18:20:02.691885] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:20:02.694030] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T18:20:03.158089] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-17T18:20:03.958145] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-17T18:20:04.750362] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:20:04.759795] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-17T18:20:04.848319] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-17T18:20:05.557992] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-17T18:20:05.859365] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:20:05.929766] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:20:06.358015] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-17T18:20:07.158026] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-17T18:20:07.252741] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T18:20:07.456092] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:20:07.958043] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-17T18:20:08.758010] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-17T18:20:08.913377] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:20:09.040103] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:20:09.558027] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-17T18:20:10.358071] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-17T18:20:10.540199] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T18:20:10.546491] [INFO ] [REMOTE ] CXW: Full fetch complete (64935 records). [2025-10-17T18:20:10.546681] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-17T18:20:10.937814] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-17T18:20:10.937930] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-17T18:20:10.938960] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-17T18:20:10.939140] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-17T18:20:10.941047] [DEBUG] [LOCAL ] CXW: Trimmed 64935 records to 44487 (keeping 200 days of data) [2025-10-17T18:20:11.161281] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-17T18:20:11.168993] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T18:20:11.224825] [DEBUG] [LOCAL ] CXW: Primary data saved (44487 records). [2025-10-17T18:20:11.225025] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-17T18:20:11.226096] [INFO ] [MAIN ] Update Progress: 581/2368 symbols completed. CXW took 45.2s. Estimated remaining: 4h 6m 26s. Rate: 7.3 symbols/min [2025-10-17T18:20:11.430476] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:11.432891] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T18:20:11.497629] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-17T18:20:11.497989] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-10-17T18:20:11.671973] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:20:11.672191] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-17T18:20:11.672237] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-17T18:20:11.672580] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-17T18:20:11.672637] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-17T18:20:11.963217] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-17T18:20:12.031409] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:12.758014] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-17T18:20:12.833271] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T18:20:13.387510] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-17T18:20:13.558089] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-17T18:20:14.358008] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-17T18:20:14.837172] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T18:20:15.142492] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T18:20:15.157983] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-17T18:20:15.458457] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T18:20:15.958042] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-17T18:20:16.196746] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T18:20:16.199020] [INFO ] [REMOTE ] DAC: Full fetch complete (19307 records). [2025-10-17T18:20:16.199092] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-17T18:20:16.573207] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-17T18:20:16.573314] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-17T18:20:16.573796] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-17T18:20:16.573859] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-17T18:20:16.574447] [DEBUG] [LOCAL ] DAC: Trimmed 19307 records to 12751 (keeping 200 days of data) [2025-10-17T18:20:16.649489] [DEBUG] [LOCAL ] DAC: Primary data saved (12751 records). [2025-10-17T18:20:16.649622] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-17T18:20:16.649738] [INFO ] [MAIN ] Update Progress: 582/2368 symbols completed. DAC took 26.0s. Estimated remaining: 4h 6m 9s. Rate: 7.3 symbols/min [2025-10-17T18:20:16.763155] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-17T18:20:16.821517] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:16.821710] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-17T18:20:16.821761] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-17T18:20:16.821868] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-17T18:20:16.821909] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-17T18:20:16.821950] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-17T18:20:16.821982] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-17T18:20:17.178255] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:17.558037] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-17T18:20:17.955804] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T18:20:18.318371] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:20:18.357990] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-17T18:20:19.158037] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-17T18:20:19.307818] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T18:20:19.747925] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T18:20:19.754358] [INFO ] [REMOTE ] CYH: Full fetch complete (69920 records). [2025-10-17T18:20:19.754464] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-17T18:20:19.963124] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-17T18:20:20.141569] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-17T18:20:20.141680] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-17T18:20:20.142599] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-17T18:20:20.142688] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-17T18:20:20.144018] [DEBUG] [LOCAL ] CYH: Trimmed 69920 records to 48440 (keeping 200 days of data) [2025-10-17T18:20:20.414980] [DEBUG] [LOCAL ] CYH: Primary data saved (48440 records). [2025-10-17T18:20:20.415125] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-17T18:20:20.415207] [INFO ] [MAIN ] Update Progress: 583/2368 symbols completed. CYH took 39.6s. Estimated remaining: 4h 5m 47s. Rate: 7.3 symbols/min [2025-10-17T18:20:20.585195] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:20.585388] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-17T18:20:20.585426] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-17T18:20:20.585571] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-17T18:20:20.585665] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-17T18:20:20.585734] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-17T18:20:20.585771] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-17T18:20:20.758782] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-17T18:20:20.948476] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:21.307325] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T18:20:21.558045] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-17T18:20:21.790113] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:20:22.357996] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-17T18:20:22.610392] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T18:20:22.810112] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T18:20:23.158023] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-17T18:20:23.958005] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-17T18:20:24.281082] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:20:24.324580] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:20:24.758030] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-17T18:20:25.557997] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-17T18:20:25.586894] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:20:25.964373] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:20:26.358048] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-17T18:20:27.158025] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-17T18:20:27.754176] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-17T18:20:27.838765] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T18:20:27.958028] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-17T18:20:28.630317] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:20:28.758036] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-17T18:20:29.299523] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:20:29.563558] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-17T18:20:29.576291] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T18:20:29.584058] [INFO ] [REMOTE ] D: Full fetch complete (77423 records). [2025-10-17T18:20:29.584219] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-17T18:20:29.585095] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:20:29.585394] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:20:29.585465] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:20:29.585536] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-17T18:20:29.585603] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-17T18:20:29.585639] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-17T18:20:29.585878] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-17T18:20:29.585973] [INFO ] [MAIN ] Update Progress: 584/2368 symbols completed. D took 39.3s. Estimated remaining: 4h 5m 41s. Rate: 7.3 symbols/min [2025-10-17T18:20:29.761986] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:29.812566] [DEBUG] [LOCAL ] DAR: Loaded 52380 existing records from primary storage. [2025-10-17T18:20:29.812953] [INFO ] [MAIN ] DAR: Loaded 52380 existing records. [2025-10-17T18:20:30.000271] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:20:30.000690] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-17T18:20:30.000750] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-17T18:20:30.001129] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-17T18:20:30.001188] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-17T18:20:30.347838] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:30.358000] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-17T18:20:31.158027] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-17T18:20:31.195130] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:20:31.958009] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-17T18:20:32.073972] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T18:20:32.758060] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-17T18:20:33.464610] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-17T18:20:33.567101] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-17T18:20:33.573024] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T18:20:34.358036] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-17T18:20:34.548395] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T18:20:35.158069] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-17T18:20:35.697904] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:20:35.958000] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-17T18:20:36.431343] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-17T18:20:36.758050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-17T18:20:36.819145] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T18:20:37.030281] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T18:20:37.558085] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-17T18:20:38.358036] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-17T18:20:38.469175] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T18:20:38.501075] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:20:39.158044] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-17T18:20:39.958090] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-17T18:20:40.122535] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:20:40.758050] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-17T18:20:40.911073] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:20:41.558029] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-17T18:20:41.820616] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:20:42.286016] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T18:20:42.357990] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-17T18:20:43.163197] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-17T18:20:43.180046] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:20:43.958050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-17T18:20:44.480353] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-17T18:20:44.758032] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-17T18:20:45.023633] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:20:45.558013] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-17T18:20:45.810767] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T18:20:45.817938] [INFO ] [REMOTE ] DAN: Full fetch complete (71277 records). [2025-10-17T18:20:45.818047] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-17T18:20:46.198748] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-17T18:20:46.198830] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-17T18:20:46.199681] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-17T18:20:46.199747] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-17T18:20:46.201062] [DEBUG] [LOCAL ] DAN: Trimmed 71277 records to 50069 (keeping 200 days of data) [2025-10-17T18:20:46.371227] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-17T18:20:46.499273] [DEBUG] [LOCAL ] DAN: Primary data saved (50069 records). [2025-10-17T18:20:46.499416] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-17T18:20:46.499493] [INFO ] [MAIN ] Update Progress: 585/2368 symbols completed. DAN took 29.8s. Estimated remaining: 4h 5m 60s. Rate: 7.2 symbols/min [2025-10-17T18:20:46.673137] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:46.673360] [DEBUG] [LOCAL ] DAVA: No existing data file found in primary storage. [2025-10-17T18:20:46.673406] [WARN ] [MAIN ] DAVA: No existing data found, performing full refresh instead. [2025-10-17T18:20:46.673517] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-17T18:20:46.673560] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-17T18:20:46.673602] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-17T18:20:46.673635] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-17T18:20:47.040858] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:47.158596] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-17T18:20:47.164993] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-17T18:20:47.273216] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:20:47.599082] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T18:20:47.958107] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-17T18:20:48.431071] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:20:48.758040] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-17T18:20:49.558021] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-17T18:20:49.690880] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:20:49.787264] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T18:20:50.358067] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-17T18:20:50.841600] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T18:20:51.158076] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-17T18:20:51.958031] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-17T18:20:52.103164] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T18:20:52.758034] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-17T18:20:53.042434] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T18:20:53.045380] [INFO ] [REMOTE ] DAO: Full fetch complete (32412 records). [2025-10-17T18:20:53.045457] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-17T18:20:53.422020] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-17T18:20:53.422203] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-17T18:20:53.422816] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-17T18:20:53.422897] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-17T18:20:53.423787] [DEBUG] [LOCAL ] DAO: Trimmed 32412 records to 20206 (keeping 200 days of data) [2025-10-17T18:20:53.534265] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T18:20:53.558044] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-17T18:20:53.575914] [DEBUG] [LOCAL ] DAO: Primary data saved (20206 records). [2025-10-17T18:20:53.576046] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-17T18:20:53.576118] [INFO ] [MAIN ] Update Progress: 586/2368 symbols completed. DAO took 33.2s. Estimated remaining: 4h 5m 48s. Rate: 7.2 symbols/min [2025-10-17T18:20:53.744596] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:53.744784] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-17T18:20:53.744826] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-17T18:20:53.744935] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-17T18:20:53.744975] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-17T18:20:53.745016] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-17T18:20:53.745049] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-17T18:20:54.105410] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:54.124129] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T18:20:54.358037] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-17T18:20:54.467619] [DEBUG] [REMOTE ] DAY: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-17T18:20:54.467921] [WARN ] [REMOTE ] DAY: No data returned for month 2024-12 [2025-10-17T18:20:54.468010] [FATAL] [REMOTE ] DAY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:20:54.468074] [FATAL] [MAIN ] DAY: Failed to fetch primary data. [2025-10-17T18:20:54.468137] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:20:54.468213] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-17T18:20:54.468276] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-17T18:20:54.468313] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-17T18:20:54.468352] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-17T18:20:54.468398] [INFO ] [MAIN ] Update Progress: 587/2368 symbols completed. DAY took 0.9s. Estimated remaining: 4h 5m 17s. Rate: 7.3 symbols/min [2025-10-17T18:20:54.643970] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:54.699393] [DEBUG] [LOCAL ] DB: Loaded 52892 existing records from primary storage. [2025-10-17T18:20:54.699777] [INFO ] [MAIN ] DB: Loaded 52892 existing records. [2025-10-17T18:20:54.909759] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:20:54.909989] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-17T18:20:54.910040] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-17T18:20:54.910323] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-17T18:20:54.910383] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-17T18:20:55.166547] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-17T18:20:55.438879] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:55.691580] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:20:55.958069] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-17T18:20:56.663153] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T18:20:56.758046] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-17T18:20:57.558045] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-17T18:20:58.317915] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-17T18:20:58.325452] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-17T18:20:58.325598] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-17T18:20:58.371334] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-17T18:20:58.758477] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-17T18:20:58.758675] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-17T18:20:58.760214] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-17T18:20:58.760614] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-17T18:20:58.762846] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54533 (keeping 200 days of data) [2025-10-17T18:20:58.895405] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:20:58.944567] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-17T18:20:59.175618] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-17T18:20:59.203562] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-17T18:20:59.203716] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-17T18:20:59.203807] [INFO ] [MAIN ] Update Progress: 588/2368 symbols completed. DAL took 48.0s. Estimated remaining: 4h 4m 58s. Rate: 7.3 symbols/min [2025-10-17T18:20:59.372304] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:59.372479] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-17T18:20:59.372541] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-17T18:20:59.372693] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-17T18:20:59.372747] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-17T18:20:59.372794] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-17T18:20:59.372905] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-17T18:20:59.756320] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:59.880719] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:20:59.958068] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-17T18:21:00.758027] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-17T18:21:00.866756] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:21:01.558068] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-17T18:21:01.996611] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T18:21:02.358075] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-17T18:21:02.515744] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T18:21:03.158067] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-17T18:21:03.402573] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T18:21:03.506173] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-17T18:21:03.514265] [INFO ] [REMOTE ] DAR: Full fetch complete (74965 records). [2025-10-17T18:21:03.514445] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-17T18:21:03.918546] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-17T18:21:03.918635] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-17T18:21:03.919578] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-17T18:21:03.919627] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-17T18:21:03.921157] [DEBUG] [LOCAL ] DAR: Trimmed 74965 records to 52762 (keeping 200 days of data) [2025-10-17T18:21:03.971490] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-17T18:21:04.255341] [DEBUG] [LOCAL ] DAR: Primary data saved (52762 records). [2025-10-17T18:21:04.255487] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-17T18:21:04.255607] [INFO ] [MAIN ] Update Progress: 589/2368 symbols completed. DAR took 34.7s. Estimated remaining: 4h 4m 40s. Rate: 7.3 symbols/min [2025-10-17T18:21:04.423703] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:04.471517] [DEBUG] [LOCAL ] DBI: Loaded 44191 existing records from primary storage. [2025-10-17T18:21:04.471833] [INFO ] [MAIN ] DBI: Loaded 44191 existing records. [2025-10-17T18:21:04.684107] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:21:04.684505] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-17T18:21:04.684601] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-17T18:21:04.685150] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-17T18:21:04.685227] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-17T18:21:04.764271] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-17T18:21:04.823956] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:21:05.016090] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:21:05.095079] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:05.558055] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-17T18:21:06.358000] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-17T18:21:06.515978] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:21:07.005913] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T18:21:07.098102] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:21:07.157987] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-17T18:21:07.958030] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-17T18:21:08.758007] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-17T18:21:08.925089] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:21:09.558023] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-17T18:21:09.733777] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T18:21:09.781985] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:21:10.358040] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-17T18:21:11.157997] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-17T18:21:11.478011] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T18:21:11.501760] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:21:11.958035] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-17T18:21:12.758033] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-17T18:21:13.113826] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T18:21:13.558004] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-17T18:21:13.828445] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T18:21:13.920552] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T18:21:14.358040] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-17T18:21:15.158007] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-17T18:21:15.431266] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T18:21:15.951798] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:21:15.962965] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-17T18:21:16.757992] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-17T18:21:17.017389] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:21:17.024334] [INFO ] [REMOTE ] DAVA: Full fetch complete (57037 records). [2025-10-17T18:21:17.024459] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-17T18:21:17.231704] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T18:21:17.434937] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-17T18:21:17.435015] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-17T18:21:17.435802] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-17T18:21:17.435865] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-17T18:21:17.437165] [DEBUG] [LOCAL ] DAVA: Trimmed 57037 records to 42431 (keeping 200 days of data) [2025-10-17T18:21:17.598552] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-17T18:21:17.680453] [DEBUG] [LOCAL ] DAVA: Primary data saved (42431 records). [2025-10-17T18:21:17.680572] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-17T18:21:17.680661] [INFO ] [MAIN ] Update Progress: 590/2368 symbols completed. DAVA took 31.2s. Estimated remaining: 4h 4m 47s. Rate: 7.3 symbols/min [2025-10-17T18:21:17.847585] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:17.859218] [DEBUG] [LOCAL ] DBL: Loaded 9490 existing records from primary storage. [2025-10-17T18:21:17.859425] [INFO ] [MAIN ] DBL: Loaded 9490 existing records. [2025-10-17T18:21:18.042457] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:21:18.042809] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-17T18:21:18.042864] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-17T18:21:18.043004] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-17T18:21:18.043041] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-17T18:21:18.359573] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-17T18:21:18.368483] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:21:18.462168] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:19.158055] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-17T18:21:19.319584] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T18:21:19.493698] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T18:21:19.958025] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-17T18:21:19.977607] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T18:21:20.758067] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-17T18:21:21.558006] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-17T18:21:21.920256] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:21:22.036762] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T18:21:22.177306] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:21:22.358042] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-17T18:21:23.096945] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T18:21:23.158020] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-17T18:21:23.792889] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T18:21:23.958036] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-17T18:21:24.699450] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T18:21:24.758043] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-17T18:21:25.475460] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:21:25.558023] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-17T18:21:26.311972] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T18:21:26.358023] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-17T18:21:27.158030] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-17T18:21:27.256461] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T18:21:27.958036] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-17T18:21:28.758072] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-17T18:21:28.922112] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:21:29.500676] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T18:21:29.558041] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-17T18:21:29.600055] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T18:21:30.358039] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-17T18:21:31.158049] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-17T18:21:31.349901] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T18:21:31.473488] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:21:31.958005] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-17T18:21:32.177308] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T18:21:32.758116] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-17T18:21:33.558004] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-17T18:21:33.922339] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T18:21:33.929734] [INFO ] [REMOTE ] DB: Full fetch complete (75485 records). [2025-10-17T18:21:33.929864] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-17T18:21:34.331220] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-17T18:21:34.331318] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-17T18:21:34.332210] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-17T18:21:34.332276] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-17T18:21:34.333794] [DEBUG] [LOCAL ] DB: Trimmed 75485 records to 53281 (keeping 200 days of data) [2025-10-17T18:21:34.389426] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-17T18:21:34.577779] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:21:34.703075] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T18:21:34.711583] [INFO ] [REMOTE ] DBD: Full fetch complete (31597 records). [2025-10-17T18:21:34.711809] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-17T18:21:34.713510] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:21:34.717669] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:21:34.717747] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:21:34.717793] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-17T18:21:34.717851] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-17T18:21:34.717888] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-17T18:21:34.717926] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-17T18:21:34.718008] [INFO ] [MAIN ] Update Progress: 591/2368 symbols completed. DBD took 35.5s. Estimated remaining: 4h 5m 5s. Rate: 7.3 symbols/min [2025-10-17T18:21:34.723415] [DEBUG] [LOCAL ] DB: Primary data saved (53281 records). [2025-10-17T18:21:34.729989] [INFO ] [MAIN ] DB: Full history saved. [2025-10-17T18:21:34.739623] [INFO ] [MAIN ] Update Progress: 592/2368 symbols completed. DB took 40.3s. Estimated remaining: 4h 4m 32s. Rate: 7.3 symbols/min [2025-10-17T18:21:35.055155] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:35.074176] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:35.074499] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-17T18:21:35.074636] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-17T18:21:35.074773] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-17T18:21:35.075013] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-17T18:21:35.074944] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-17T18:21:35.075214] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-17T18:21:35.075303] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-17T18:21:35.075492] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-17T18:21:35.075422] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-17T18:21:35.075708] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-17T18:21:35.075612] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-17T18:21:35.107210] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-17T18:21:35.161727] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-17T18:21:35.295972] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T18:21:35.368918] [INFO ] [REMOTE ] DBL: Full fetch complete (12655 records). [2025-10-17T18:21:35.382986] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-17T18:21:35.450541] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:21:35.492387] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:21:35.512740] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:21:35.548521] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-17T18:21:35.580263] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-17T18:21:35.586822] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-17T18:21:35.669349] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-17T18:21:35.669612] [INFO ] [MAIN ] Update Progress: 593/2368 symbols completed. DBL took 18.0s. Estimated remaining: 4h 4m 2s. Rate: 7.3 symbols/min [2025-10-17T18:21:35.873579] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:35.926554] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:35.963097] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-17T18:21:36.028138] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:36.028284] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-17T18:21:36.028323] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-17T18:21:36.028435] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-17T18:21:36.028477] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-17T18:21:36.028519] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-17T18:21:36.028553] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-17T18:21:36.380178] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:36.758004] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-17T18:21:37.053625] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:21:37.558004] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-17T18:21:37.852800] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T18:21:37.901097] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T18:21:38.358086] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-17T18:21:39.158034] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-17T18:21:39.226775] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T18:21:39.229432] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:21:39.958090] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-17T18:21:40.739566] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T18:21:40.761150] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-17T18:21:41.546283] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:21:41.557999] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-17T18:21:42.180490] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T18:21:42.358015] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-17T18:21:42.446920] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:21:43.158101] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-17T18:21:43.923215] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:21:43.955881] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:21:43.965299] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-17T18:21:44.758044] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-17T18:21:45.455724] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T18:21:45.558015] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-17T18:21:46.306882] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:21:46.357990] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-17T18:21:47.160304] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-17T18:21:47.163090] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T18:21:47.957998] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-17T18:21:48.075447] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:21:48.092916] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T18:21:48.758072] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-17T18:21:49.440566] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T18:21:49.446004] [INFO ] [REMOTE ] DBI: Full fetch complete (65041 records). [2025-10-17T18:21:49.446112] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-17T18:21:49.563184] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-17T18:21:49.836520] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-17T18:21:49.836593] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-17T18:21:49.837534] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-17T18:21:49.837600] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-17T18:21:49.838997] [DEBUG] [LOCAL ] DBI: Trimmed 65041 records to 44390 (keeping 200 days of data) [2025-10-17T18:21:50.092302] [DEBUG] [LOCAL ] DBI: Primary data saved (44390 records). [2025-10-17T18:21:50.092429] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-17T18:21:50.092506] [INFO ] [MAIN ] Update Progress: 594/2368 symbols completed. DBI took 45.8s. Estimated remaining: 4h 4m 12s. Rate: 7.3 symbols/min [2025-10-17T18:21:50.270422] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:50.323136] [DEBUG] [LOCAL ] DD: Loaded 53314 existing records from primary storage. [2025-10-17T18:21:50.323445] [INFO ] [MAIN ] DD: Loaded 53314 existing records. [2025-10-17T18:21:50.359534] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-17T18:21:50.525369] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:21:50.545555] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-17T18:21:50.545800] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-17T18:21:50.546521] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T18:21:50.549980] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-17T18:21:50.552620] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-17T18:21:50.552548] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T18:21:50.913566] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:51.158021] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-17T18:21:51.891140] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T18:21:51.958069] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-17T18:21:52.758031] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-17T18:21:52.955988] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:21:53.558037] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-17T18:21:53.653197] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:21:53.689436] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T18:21:54.358031] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-17T18:21:54.714078] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:21:55.158014] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-17T18:21:55.397312] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T18:21:55.958033] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-17T18:21:56.758017] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-17T18:21:56.898187] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T18:21:56.930378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T18:21:57.558033] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-17T18:21:58.358084] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-17T18:21:58.601378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T18:21:58.638662] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:21:59.158055] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-17T18:21:59.858862] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:21:59.958033] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-17T18:22:00.758083] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-17T18:22:00.916396] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:22:01.558024] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-17T18:22:01.686812] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:22:02.186931] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:22:02.358026] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-17T18:22:03.158053] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-17T18:22:03.295856] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T18:22:03.828613] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T18:22:03.958107] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-17T18:22:04.178944] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:22:04.183428] [INFO ] [REMOTE ] DCO: Full fetch complete (19641 records). [2025-10-17T18:22:04.183566] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-17T18:22:04.623884] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-17T18:22:04.623974] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-17T18:22:04.624465] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-17T18:22:04.624515] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-17T18:22:04.625370] [DEBUG] [LOCAL ] DCO: Trimmed 19641 records to 14832 (keeping 200 days of data) [2025-10-17T18:22:04.716670] [DEBUG] [LOCAL ] DCO: Primary data saved (14832 records). [2025-10-17T18:22:04.716827] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-17T18:22:04.716905] [INFO ] [MAIN ] Update Progress: 595/2368 symbols completed. DCO took 29.0s. Estimated remaining: 4h 4m 23s. Rate: 7.3 symbols/min [2025-10-17T18:22:04.764219] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-17T18:22:04.916865] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:04.917036] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-17T18:22:04.917097] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-17T18:22:04.917249] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-17T18:22:04.917316] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-17T18:22:04.917382] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-17T18:22:04.917477] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-17T18:22:05.262403] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:05.558013] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-17T18:22:05.914870] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T18:22:06.358027] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-17T18:22:06.509456] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T18:22:07.158051] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-17T18:22:07.440431] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:22:07.958017] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-17T18:22:08.141384] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:22:08.757997] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-17T18:22:09.022923] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:22:09.032173] [INFO ] [REMOTE ] DBRG: Full fetch complete (72498 records). [2025-10-17T18:22:09.032335] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-17T18:22:09.417690] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-17T18:22:09.417783] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-17T18:22:09.418682] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-17T18:22:09.418750] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-17T18:22:09.420201] [DEBUG] [LOCAL ] DBRG: Trimmed 72498 records to 50682 (keeping 200 days of data) [2025-10-17T18:22:09.594724] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-17T18:22:09.757621] [DEBUG] [LOCAL ] DBRG: Primary data saved (50682 records). [2025-10-17T18:22:09.757937] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-17T18:22:09.758608] [INFO ] [MAIN ] Update Progress: 596/2368 symbols completed. DBRG took 35.0s. Estimated remaining: 4h 4m 5s. Rate: 7.3 symbols/min [2025-10-17T18:22:09.759677] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T18:22:09.952205] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:09.988980] [DEBUG] [LOCAL ] DDL: Loaded 37285 existing records from primary storage. [2025-10-17T18:22:09.989286] [INFO ] [MAIN ] DDL: Loaded 37285 existing records. [2025-10-17T18:22:10.174033] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:10.174299] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-17T18:22:10.174347] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-17T18:22:10.174675] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-17T18:22:10.174741] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-17T18:22:10.374318] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-17T18:22:10.535747] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:10.733501] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T18:22:11.158046] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-17T18:22:11.312206] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:22:11.957999] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-17T18:22:12.226754] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T18:22:12.758046] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-17T18:22:13.107205] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T18:22:13.558043] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-17T18:22:13.685860] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T18:22:14.358101] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-17T18:22:14.566959] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T18:22:14.703193] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T18:22:15.158075] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-17T18:22:15.894355] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T18:22:15.958049] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-17T18:22:16.585478] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T18:22:16.590460] [INFO ] [REMOTE ] DCI: Full fetch complete (53643 records). [2025-10-17T18:22:16.590588] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-17T18:22:16.763678] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-17T18:22:16.971278] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-17T18:22:16.971360] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-17T18:22:16.972126] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-17T18:22:16.972191] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-17T18:22:16.973378] [DEBUG] [LOCAL ] DCI: Trimmed 53643 records to 37560 (keeping 200 days of data) [2025-10-17T18:22:17.194297] [DEBUG] [LOCAL ] DCI: Primary data saved (37560 records). [2025-10-17T18:22:17.194437] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-17T18:22:17.194519] [INFO ] [MAIN ] Update Progress: 597/2368 symbols completed. DCI took 42.4s. Estimated remaining: 4h 3m 55s. Rate: 7.3 symbols/min [2025-10-17T18:22:17.558067] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-17T18:22:17.825251] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:22:17.899550] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:22:18.358068] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-17T18:22:19.158057] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-17T18:22:19.340503] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:22:19.529375] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T18:22:19.958061] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-17T18:22:20.767686] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-17T18:22:20.773543] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:22:20.976779] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:22:21.558039] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-17T18:22:22.358087] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-17T18:22:22.624695] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T18:22:23.158054] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-17T18:22:23.194064] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:22:23.965031] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-17T18:22:23.985795] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:22:24.758026] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-17T18:22:25.048460] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:22:25.528295] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T18:22:25.558000] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-17T18:22:26.358075] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-17T18:22:26.559876] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:22:26.764438] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:22:27.158063] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-17T18:22:27.958033] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-17T18:22:28.278889] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:22:28.286838] [INFO ] [REMOTE ] DD: Full fetch complete (76598 records). [2025-10-17T18:22:28.287011] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-17T18:22:28.685982] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-17T18:22:28.686081] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-17T18:22:28.687106] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-17T18:22:28.687177] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-17T18:22:28.688744] [DEBUG] [LOCAL ] DD: Trimmed 76598 records to 53704 (keeping 200 days of data) [2025-10-17T18:22:29.024685] [DEBUG] [LOCAL ] DD: Primary data saved (53704 records). [2025-10-17T18:22:29.024832] [INFO ] [MAIN ] DD: Full history saved. [2025-10-17T18:22:29.025554] [INFO ] [MAIN ] Update Progress: 598/2368 symbols completed. DD took 38.9s. Estimated remaining: 4h 3m 57s. Rate: 7.3 symbols/min [2025-10-17T18:22:29.164554] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T18:22:29.176051] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-17T18:22:29.265171] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T18:22:29.558035] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-17T18:22:30.835685] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T18:22:30.842174] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-17T18:22:31.097596] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:22:31.157980] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-17T18:22:32.389777] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T18:22:32.403369] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-17T18:22:33.255730] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T18:22:33.263777] [INFO ] [REMOTE ] DDD: Full fetch complete (73941 records). [2025-10-17T18:22:33.263998] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-17T18:22:33.675219] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-17T18:22:33.675375] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-17T18:22:33.676766] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-17T18:22:33.676834] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-17T18:22:33.678966] [DEBUG] [LOCAL ] DDD: Trimmed 73941 records to 51691 (keeping 200 days of data) [2025-10-17T18:22:33.984140] [DEBUG] [LOCAL ] DDD: Primary data saved (51691 records). [2025-10-17T18:22:33.984399] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-17T18:22:33.984513] [INFO ] [MAIN ] Update Progress: 599/2368 symbols completed. DDD took 29.3s. Estimated remaining: 4h 3m 39s. Rate: 7.3 symbols/min [2025-10-17T18:22:34.057461] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T18:22:34.063857] [INFO ] [REMOTE ] DDL: Full fetch complete (53596 records). [2025-10-17T18:22:34.063975] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-17T18:22:34.454777] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-17T18:22:34.454855] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-17T18:22:34.455542] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-17T18:22:34.455599] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-17T18:22:34.456812] [DEBUG] [LOCAL ] DDL: Trimmed 53596 records to 37618 (keeping 200 days of data) [2025-10-17T18:22:34.664394] [DEBUG] [LOCAL ] DDL: Primary data saved (37618 records). [2025-10-17T18:22:34.664553] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-17T18:22:34.664666] [INFO ] [MAIN ] Update Progress: 600/2368 symbols completed. DDL took 24.9s. Estimated remaining: 4h 3m 8s. Rate: 7.3 symbols/min [2025-10-17T18:22:35.348765] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.355740] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.342888] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.355933] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-17T18:22:35.376483] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-17T18:22:35.376883] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-17T18:22:35.376944] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-17T18:22:35.377022] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-17T18:22:35.378258] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.378424] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-17T18:22:35.437807] [DEBUG] [LOCAL ] DDT: Loaded 2095 existing records from primary storage. [2025-10-17T18:22:35.444319] [INFO ] [MAIN ] DDT: Loaded 2095 existing records. [2025-10-17T18:22:35.530993] [DEBUG] [LOCAL ] DDS: Loaded 12801 existing records from primary storage. [2025-10-17T18:22:35.560222] [INFO ] [MAIN ] DDS: Loaded 12801 existing records. [2025-10-17T18:22:35.957394] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:35.998192] [DEBUG] [LOCAL ] DE: Loaded 48037 existing records from primary storage. [2025-10-17T18:22:36.008714] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-17T18:22:36.008849] [INFO ] [MAIN ] DE: Loaded 48037 existing records. [2025-10-17T18:22:36.042637] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-17T18:22:36.089115] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-17T18:22:36.094494] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:36.125841] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-17T18:22:36.125774] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-17T18:22:36.255515] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-17T18:22:36.375073] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-17T18:22:36.385672] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-17T18:22:36.457830] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:36.486595] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-17T18:22:36.560054] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:36.643511] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-17T18:22:36.708839] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-17T18:22:36.915216] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-17T18:22:36.952338] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-17T18:22:37.261216] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:37.286155] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:37.292574] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-17T18:22:37.298227] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-17T18:22:37.548925] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:37.549243] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-17T18:22:37.984895] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T18:22:37.986082] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-17T18:22:38.244875] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T18:22:38.248315] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-17T18:22:38.496410] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T18:22:38.497662] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-17T18:22:38.539280] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:22:38.549894] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-17T18:22:38.941230] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T18:22:39.058432] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:22:39.158047] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-17T18:22:39.559376] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:22:39.600308] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T18:22:39.911863] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T18:22:39.958051] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-17T18:22:40.672962] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T18:22:40.758101] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-17T18:22:41.558058] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-17T18:22:42.369157] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-17T18:22:42.374040] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:22:42.422348] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T18:22:42.662563] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-17T18:22:43.158028] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-17T18:22:43.958074] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-17T18:22:44.219372] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T18:22:44.430011] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T18:22:44.758111] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-17T18:22:45.558036] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-17T18:22:46.358079] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-17T18:22:46.408140] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:22:46.721996] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-17T18:22:46.994235] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:22:47.158095] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-17T18:22:47.958050] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-17T18:22:48.758038] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-17T18:22:48.985334] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:22:49.292735] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T18:22:49.558060] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-17T18:22:49.709385] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:22:50.358055] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-17T18:22:51.013631] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T18:22:51.157996] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-17T18:22:51.515239] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T18:22:51.958026] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-17T18:22:52.758058] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-17T18:22:53.558075] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-17T18:23:05.158249] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (12.40 seconds). [2025-10-17T18:23:05.162315] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-17T18:23:05.962773] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (14.80 seconds). [2025-10-17T18:23:05.963890] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-17T18:23:06.405852] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:23:06.409012] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-17T18:23:06.969034] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (15.01 seconds). [2025-10-17T18:23:06.977123] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-17T18:23:08.458819] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (14.90 seconds). [2025-10-17T18:23:08.469274] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-17T18:23:08.520803] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T18:23:08.521612] [INFO ] [REMOTE ] DDT: Full fetch complete (2821 records). [2025-10-17T18:23:08.521705] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-17T18:23:08.863708] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T18:23:08.908385] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-17T18:23:08.909345] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-17T18:23:08.909406] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-17T18:23:08.909512] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-17T18:23:08.909551] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-17T18:23:08.909931] [DEBUG] [LOCAL ] DDT: Trimmed 2821 records to 2106 (keeping 200 days of data) [2025-10-17T18:23:08.923464] [DEBUG] [LOCAL ] DDT: Primary data saved (2106 records). [2025-10-17T18:23:08.923541] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-17T18:23:08.923613] [INFO ] [MAIN ] Update Progress: 601/2368 symbols completed. DDT took 34.3s. Estimated remaining: 4h 4m 16s. Rate: 7.2 symbols/min [2025-10-17T18:23:09.099074] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:09.133933] [DEBUG] [LOCAL ] DEC: Loaded 30584 existing records from primary storage. [2025-10-17T18:23:09.134213] [INFO ] [MAIN ] DEC: Loaded 30584 existing records. [2025-10-17T18:23:09.328495] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:09.328757] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-17T18:23:09.328808] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-17T18:23:09.329111] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-17T18:23:09.329168] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-17T18:23:09.694073] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:09.694528] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-17T18:23:09.859861] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T18:23:09.863443] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-17T18:23:09.900288] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-17T18:23:09.909569] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-17T18:23:10.024089] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:23:10.034531] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-17T18:23:10.746384] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T18:23:10.749872] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-17T18:23:11.002674] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T18:23:11.011148] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-17T18:23:11.223270] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T18:23:11.228804] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-17T18:23:11.519523] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T18:23:11.521263] [INFO ] [REMOTE ] DDS: Full fetch complete (18621 records). [2025-10-17T18:23:11.521397] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-17T18:23:11.893204] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-17T18:23:11.893328] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-17T18:23:11.893820] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-17T18:23:11.893963] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-17T18:23:11.894550] [DEBUG] [LOCAL ] DDS: Trimmed 18621 records to 12846 (keeping 200 days of data) [2025-10-17T18:23:12.006495] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T18:23:12.008585] [DEBUG] [LOCAL ] DDS: Primary data saved (12846 records). [2025-10-17T18:23:12.008773] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-17T18:23:12.018381] [INFO ] [MAIN ] Update Progress: 602/2368 symbols completed. DDS took 37.4s. Estimated remaining: 4h 3m 53s. Rate: 7.2 symbols/min [2025-10-17T18:23:12.081205] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-17T18:23:12.187389] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:12.238999] [DEBUG] [LOCAL ] DECK: Loaded 53687 existing records from primary storage. [2025-10-17T18:23:12.239358] [INFO ] [MAIN ] DECK: Loaded 53687 existing records. [2025-10-17T18:23:12.424597] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:12.433544] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-17T18:23:12.434917] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-17T18:23:12.434836] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:23:12.440614] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-17T18:23:12.440714] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-17T18:23:12.441512] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-17T18:23:12.608629] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T18:23:12.693979] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-17T18:23:12.833849] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:12.834192] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-17T18:23:13.695140] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:23:13.704613] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-17T18:23:13.821893] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T18:23:13.828013] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-17T18:23:14.387485] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:23:14.393875] [INFO ] [REMOTE ] DEA: Full fetch complete (61959 records). [2025-10-17T18:23:14.394134] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-17T18:23:14.810947] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-17T18:23:14.811130] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-17T18:23:14.811928] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-17T18:23:14.821265] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-17T18:23:14.839386] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:23:14.850050] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-17T18:23:14.851254] [DEBUG] [LOCAL ] DEA: Trimmed 61959 records to 41023 (keeping 200 days of data) [2025-10-17T18:23:15.095400] [DEBUG] [LOCAL ] DEA: Primary data saved (41023 records). [2025-10-17T18:23:15.095808] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-17T18:23:15.095891] [INFO ] [MAIN ] Update Progress: 603/2368 symbols completed. DEA took 40.4s. Estimated remaining: 4h 3m 29s. Rate: 7.2 symbols/min [2025-10-17T18:23:15.274872] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:15.320161] [DEBUG] [LOCAL ] DEI: Loaded 48658 existing records from primary storage. [2025-10-17T18:23:15.320464] [INFO ] [MAIN ] DEI: Loaded 48658 existing records. [2025-10-17T18:23:15.506419] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:15.506869] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-17T18:23:15.507239] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-17T18:23:15.507935] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-17T18:23:15.507997] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-17T18:23:15.862842] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T18:23:15.919046] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:15.919902] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-17T18:23:15.920377] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-17T18:23:15.950821] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-17T18:23:15.962525] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-17T18:23:16.936172] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T18:23:16.947233] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-17T18:23:17.426770] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:23:17.433993] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-17T18:23:17.803873] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:23:17.813274] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-17T18:23:17.907563] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T18:23:17.921088] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-17T18:23:18.734870] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T18:23:18.748342] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T18:23:18.758920] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-17T18:23:18.760266] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-17T18:23:19.061144] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:23:19.070682] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-17T18:23:19.948822] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T18:23:19.960087] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-17T18:23:19.979389] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T18:23:19.987077] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-17T18:23:20.168470] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T18:23:20.177442] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-17T18:23:20.372864] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T18:23:20.758076] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-17T18:23:21.585244] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T18:23:21.592064] [INFO ] [REMOTE ] DE: Full fetch complete (69523 records). [2025-10-17T18:23:21.592191] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-17T18:23:21.593191] [FATAL] [VALIDATOR ] DE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:23:21.593286] [FATAL] [MAIN ] DE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:23:21.593330] [WARN ] [MAIN ] DE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:23:21.593371] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-17T18:23:21.593461] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-10-17T18:23:21.593527] [INFO ] [LOCAL ] DE: Starting deletion of derivative data. [2025-10-17T18:23:21.593736] [DEBUG] [LOCAL ] DE: Deleted derivative data file. [2025-10-17T18:23:21.594531] [INFO ] [MAIN ] Update Progress: 604/2368 symbols completed. DE took 46.9s. Estimated remaining: 4h 3m 16s. Rate: 7.3 symbols/min [2025-10-17T18:23:21.721799] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:23:21.785336] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-17T18:23:21.835072] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:21.835352] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-17T18:23:21.835420] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-17T18:23:21.835600] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-17T18:23:21.835709] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-17T18:23:21.835901] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-17T18:23:21.835953] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-17T18:23:22.052708] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T18:23:22.257877] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:22.358104] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-17T18:23:22.408361] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:23:23.070356] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:23:23.157992] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-17T18:23:23.958042] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-17T18:23:24.465241] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:23:24.732199] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-17T18:23:24.757981] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-17T18:23:25.558026] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-17T18:23:26.275560] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T18:23:26.358061] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-17T18:23:27.158005] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-17T18:23:27.211709] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T18:23:27.335596] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:23:27.958045] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-17T18:23:28.407521] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T18:23:28.692742] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T18:23:28.698011] [INFO ] [REMOTE ] DEC: Full fetch complete (44345 records). [2025-10-17T18:23:28.698146] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-17T18:23:28.763239] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-17T18:23:29.112733] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-17T18:23:29.112830] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-17T18:23:29.113541] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-17T18:23:29.113609] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-17T18:23:29.114992] [DEBUG] [LOCAL ] DEC: Trimmed 44345 records to 30778 (keeping 200 days of data) [2025-10-17T18:23:29.309404] [DEBUG] [LOCAL ] DEC: Primary data saved (30778 records). [2025-10-17T18:23:29.309542] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-17T18:23:29.309626] [INFO ] [MAIN ] Update Progress: 605/2368 symbols completed. DEC took 20.4s. Estimated remaining: 4h 3m 6s. Rate: 7.3 symbols/min [2025-10-17T18:23:29.485989] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:29.538875] [DEBUG] [LOCAL ] DEO: Loaded 49588 existing records from primary storage. [2025-10-17T18:23:29.539195] [INFO ] [MAIN ] DEO: Loaded 49588 existing records. [2025-10-17T18:23:29.571200] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-17T18:23:29.761136] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:29.774345] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-17T18:23:29.774411] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-17T18:23:29.774739] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-17T18:23:29.779238] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-17T18:23:29.850491] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:23:30.172708] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:30.358035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-17T18:23:31.023199] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T18:23:31.158028] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-17T18:23:31.543306] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-17T18:23:31.958116] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-17T18:23:32.181738] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:23:32.758038] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-17T18:23:33.077815] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T18:23:33.558090] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-17T18:23:33.969885] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:23:34.358077] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-17T18:23:35.158051] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-17T18:23:35.346718] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-17T18:23:35.529465] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:23:35.963104] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-17T18:23:35.983334] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T18:23:36.758042] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-17T18:23:37.009175] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T18:23:37.558029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-17T18:23:38.358102] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-17T18:23:38.899623] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-17T18:23:39.168746] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-17T18:23:39.172096] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-17T18:23:39.181166] [INFO ] [REMOTE ] DECK: Full fetch complete (77097 records). [2025-10-17T18:23:39.181408] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-17T18:23:39.609424] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-17T18:23:39.624954] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-17T18:23:39.636871] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-17T18:23:39.638032] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T18:23:39.638165] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-17T18:23:39.650408] [DEBUG] [LOCAL ] DECK: Trimmed 77097 records to 54077 (keeping 200 days of data) [2025-10-17T18:23:39.924554] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:23:39.967737] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-17T18:23:40.061888] [DEBUG] [LOCAL ] DECK: Primary data saved (54077 records). [2025-10-17T18:23:40.062049] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-17T18:23:40.062151] [INFO ] [MAIN ] Update Progress: 606/2368 symbols completed. DECK took 28.0s. Estimated remaining: 4h 3m 5s. Rate: 7.2 symbols/min [2025-10-17T18:23:40.229229] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:40.229399] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-17T18:23:40.229435] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-17T18:23:40.229546] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-17T18:23:40.229586] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-17T18:23:40.229635] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-17T18:23:40.229738] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-17T18:23:40.592793] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:40.758040] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-17T18:23:41.226283] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T18:23:41.558042] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-17T18:23:41.796713] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:23:42.274592] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:23:42.358047] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-17T18:23:43.092349] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T18:23:43.158003] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-17T18:23:43.711618] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:23:43.958029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-17T18:23:44.758010] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-17T18:23:44.902268] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T18:23:44.909834] [INFO ] [REMOTE ] DEI: Full fetch complete (69923 records). [2025-10-17T18:23:44.909991] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-17T18:23:45.330868] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-17T18:23:45.330950] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-17T18:23:45.331792] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-17T18:23:45.331853] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-17T18:23:45.333224] [DEBUG] [LOCAL ] DEI: Trimmed 69923 records to 49027 (keeping 200 days of data) [2025-10-17T18:23:45.562676] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-17T18:23:45.630401] [DEBUG] [LOCAL ] DEI: Primary data saved (49027 records). [2025-10-17T18:23:45.630536] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-17T18:23:45.630686] [INFO ] [MAIN ] Update Progress: 607/2368 symbols completed. DEI took 30.5s. Estimated remaining: 4h 2m 49s. Rate: 7.3 symbols/min [2025-10-17T18:23:45.803133] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:45.824915] [DEBUG] [LOCAL ] DFIN: Loaded 22789 existing records from primary storage. [2025-10-17T18:23:45.825240] [INFO ] [MAIN ] DFIN: Loaded 22789 existing records. [2025-10-17T18:23:46.005151] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:46.005408] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-17T18:23:46.005582] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-17T18:23:46.005876] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-17T18:23:46.005946] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-17T18:23:46.133795] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T18:23:46.365315] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-17T18:23:46.396363] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:46.976685] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T18:23:47.038718] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-17T18:23:47.157991] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-17T18:23:47.958010] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-17T18:23:48.185124] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T18:23:48.391252] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T18:23:48.758117] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-17T18:23:49.558036] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-17T18:23:50.355058] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-17T18:23:50.366719] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-17T18:23:50.413020] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:23:50.618771] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T18:23:51.158038] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-17T18:23:51.824574] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T18:23:51.958003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-17T18:23:52.758054] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-17T18:23:53.371049] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-17T18:23:53.525324] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T18:23:53.557984] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-17T18:23:53.825865] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T18:23:54.358034] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-17T18:23:54.894404] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:23:55.158049] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-17T18:23:55.958079] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-17T18:23:56.484560] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:23:56.605315] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-17T18:23:56.758062] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-17T18:23:57.558088] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-17T18:23:58.039088] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T18:23:58.083529] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T18:23:58.358036] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-17T18:23:59.158025] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-17T18:23:59.868086] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T18:23:59.957997] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-17T18:24:00.143407] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-17T18:24:00.151010] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-17T18:24:00.151200] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-17T18:24:00.536474] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-17T18:24:00.536555] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-17T18:24:00.537574] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-17T18:24:00.537663] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-17T18:24:00.539231] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 54516 (keeping 200 days of data) [2025-10-17T18:24:00.758003] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-17T18:24:00.887378] [DEBUG] [LOCAL ] DELL: Primary data saved (54516 records). [2025-10-17T18:24:00.887536] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-17T18:24:00.887612] [INFO ] [MAIN ] Update Progress: 608/2368 symbols completed. DELL took 39.3s. Estimated remaining: 4h 3m 1s. Rate: 7.2 symbols/min [2025-10-17T18:24:01.059995] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:01.093831] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:24:01.113052] [DEBUG] [LOCAL ] DFP: Loaded 11238 existing records from primary storage. [2025-10-17T18:24:01.113329] [INFO ] [MAIN ] DFP: Loaded 11238 existing records. [2025-10-17T18:24:01.296838] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:01.297234] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-17T18:24:01.297298] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-17T18:24:01.303487] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-17T18:24:01.303594] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-17T18:24:01.392694] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T18:24:01.566387] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-17T18:24:01.689119] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:02.102549] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:24:02.358053] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-17T18:24:03.141470] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T18:24:03.157999] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-17T18:24:03.542719] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T18:24:03.911434] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T18:24:03.957996] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-17T18:24:04.721585] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:24:04.758023] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-17T18:24:05.558009] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-17T18:24:05.642058] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T18:24:06.358019] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-17T18:24:06.596316] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T18:24:07.158093] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-17T18:24:07.958029] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-17T18:24:08.185383] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T18:24:08.468775] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-17T18:24:08.475812] [INFO ] [REMOTE ] DEO: Full fetch complete (71731 records). [2025-10-17T18:24:08.475929] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-17T18:24:08.763123] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-17T18:24:08.871193] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-17T18:24:08.871296] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-17T18:24:08.872192] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-17T18:24:08.872259] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-17T18:24:08.873710] [DEBUG] [LOCAL ] DEO: Trimmed 71731 records to 49969 (keeping 200 days of data) [2025-10-17T18:24:09.179338] [DEBUG] [LOCAL ] DEO: Primary data saved (49969 records). [2025-10-17T18:24:09.179476] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-17T18:24:09.180284] [INFO ] [MAIN ] Update Progress: 609/2368 symbols completed. DEO took 39.9s. Estimated remaining: 4h 2m 52s. Rate: 7.2 symbols/min [2025-10-17T18:24:09.378539] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:09.380183] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T18:24:09.444669] [DEBUG] [LOCAL ] DG: Loaded 53667 existing records from primary storage. [2025-10-17T18:24:09.445022] [INFO ] [MAIN ] DG: Loaded 53667 existing records. [2025-10-17T18:24:09.563135] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-17T18:24:09.630772] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:09.631209] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-17T18:24:09.631267] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-17T18:24:09.631766] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-17T18:24:09.631826] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-17T18:24:10.010615] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:10.013065] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T18:24:10.358096] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-17T18:24:10.812066] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:24:10.816447] [INFO ] [REMOTE ] DFH: Full fetch complete (47828 records). [2025-10-17T18:24:10.816542] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-17T18:24:11.158054] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-17T18:24:11.192311] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-17T18:24:11.192438] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-17T18:24:11.193222] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-17T18:24:11.193469] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-17T18:24:11.200394] [DEBUG] [LOCAL ] DFH: Trimmed 47828 records to 32567 (keeping 200 days of data) [2025-10-17T18:24:11.208070] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T18:24:11.400582] [DEBUG] [LOCAL ] DFH: Primary data saved (32567 records). [2025-10-17T18:24:11.400805] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-17T18:24:11.400892] [INFO ] [MAIN ] Update Progress: 610/2368 symbols completed. DFH took 31.3s. Estimated remaining: 4h 2m 27s. Rate: 7.3 symbols/min [2025-10-17T18:24:11.573238] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:11.616243] [DEBUG] [LOCAL ] DGX: Loaded 44978 existing records from primary storage. [2025-10-17T18:24:11.616562] [INFO ] [MAIN ] DGX: Loaded 44978 existing records. [2025-10-17T18:24:11.792816] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:11.793017] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-17T18:24:11.793063] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-17T18:24:11.793392] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-17T18:24:11.793430] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-17T18:24:11.963311] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-17T18:24:12.146262] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:12.758039] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-17T18:24:12.965787] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T18:24:13.209735] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:24:13.558054] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-17T18:24:13.815582] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:24:14.358045] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-17T18:24:15.158051] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-17T18:24:15.167112] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T18:24:15.522415] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:24:15.958043] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-17T18:24:16.758067] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-17T18:24:17.130274] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T18:24:17.543685] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T18:24:17.557992] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-17T18:24:17.944584] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T18:24:18.358087] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-17T18:24:19.146586] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:24:19.157991] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-17T18:24:19.186227] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T18:24:19.958060] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-17T18:24:20.759734] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-17T18:24:20.763966] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:24:20.805812] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T18:24:21.558030] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-17T18:24:22.358031] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-17T18:24:22.823079] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:24:22.850826] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:24:22.854096] [INFO ] [REMOTE ] DFIN: Full fetch complete (33342 records). [2025-10-17T18:24:22.854197] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-17T18:24:23.163131] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-17T18:24:23.230984] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-17T18:24:23.231067] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-17T18:24:23.231626] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-17T18:24:23.231704] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-17T18:24:23.232467] [DEBUG] [LOCAL ] DFIN: Trimmed 33342 records to 22974 (keeping 200 days of data) [2025-10-17T18:24:23.326629] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T18:24:23.380496] [DEBUG] [LOCAL ] DFIN: Primary data saved (22974 records). [2025-10-17T18:24:23.380633] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-17T18:24:23.380765] [INFO ] [MAIN ] Update Progress: 611/2368 symbols completed. DFIN took 37.7s. Estimated remaining: 4h 2m 29s. Rate: 7.2 symbols/min [2025-10-17T18:24:23.552478] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:23.573130] [DEBUG] [LOCAL ] DHF: Loaded 21169 existing records from primary storage. [2025-10-17T18:24:23.573469] [INFO ] [MAIN ] DHF: Loaded 21169 existing records. [2025-10-17T18:24:23.750662] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:23.751075] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-17T18:24:23.751135] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-17T18:24:23.751411] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-17T18:24:23.751467] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-17T18:24:23.967814] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-17T18:24:24.104997] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:24.758003] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-17T18:24:25.474930] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T18:24:25.476502] [INFO ] [REMOTE ] DFP: Full fetch complete (15743 records). [2025-10-17T18:24:25.476580] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-17T18:24:25.477020] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:24:25.477105] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:24:25.477158] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:24:25.477242] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-17T18:24:25.477321] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-17T18:24:25.477370] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-10-17T18:24:25.477611] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-10-17T18:24:25.477770] [INFO ] [MAIN ] Update Progress: 612/2368 symbols completed. DFP took 24.6s. Estimated remaining: 4h 2m 3s. Rate: 7.3 symbols/min [2025-10-17T18:24:25.559510] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-17T18:24:25.659938] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:25.715719] [DEBUG] [LOCAL ] DHI: Loaded 53756 existing records from primary storage. [2025-10-17T18:24:25.716068] [INFO ] [MAIN ] DHI: Loaded 53756 existing records. [2025-10-17T18:24:25.906898] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:25.907697] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-17T18:24:25.927709] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-17T18:24:25.947775] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-17T18:24:25.948044] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-17T18:24:25.984140] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T18:24:26.273353] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-17T18:24:26.360792] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-17T18:24:26.369089] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:26.671565] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T18:24:27.158037] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-17T18:24:27.958082] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-17T18:24:28.524004] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-17T18:24:28.758106] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-17T18:24:29.084022] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T18:24:29.558035] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-17T18:24:29.911900] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T18:24:30.358005] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-17T18:24:30.773427] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T18:24:31.158057] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-17T18:24:31.434773] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T18:24:31.502229] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T18:24:31.958088] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-17T18:24:32.758033] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-17T18:24:33.034773] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:24:33.557999] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-17T18:24:33.821266] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T18:24:34.358004] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-17T18:24:34.450945] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T18:24:35.158081] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-17T18:24:35.451498] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T18:24:35.473361] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T18:24:35.958009] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-17T18:24:36.338634] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T18:24:36.758063] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-17T18:24:37.558233] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-17T18:24:37.822927] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:24:38.358033] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-17T18:24:38.623040] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:24:38.807267] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T18:24:39.158094] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-17T18:24:39.958019] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-17T18:24:40.263572] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:24:40.666509] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T18:24:40.758003] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-17T18:24:40.862739] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:24:41.558066] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-17T18:24:41.998587] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T18:24:42.358065] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-17T18:24:43.158052] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-17T18:24:43.556341] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:24:43.591466] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:24:43.598863] [INFO ] [REMOTE ] DG: Full fetch complete (77344 records). [2025-10-17T18:24:43.598987] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-17T18:24:43.976574] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-17T18:24:43.972807] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-17T18:24:43.977527] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-17T18:24:43.978484] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-17T18:24:43.978671] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-17T18:24:43.980114] [DEBUG] [LOCAL ] DG: Trimmed 77344 records to 54049 (keeping 200 days of data) [2025-10-17T18:24:44.314999] [DEBUG] [LOCAL ] DG: Primary data saved (54049 records). [2025-10-17T18:24:44.315147] [INFO ] [MAIN ] DG: Full history saved. [2025-10-17T18:24:44.315799] [INFO ] [MAIN ] Update Progress: 613/2368 symbols completed. DG took 35.1s. Estimated remaining: 4h 2m 25s. Rate: 7.2 symbols/min [2025-10-17T18:24:44.522202] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:44.576952] [DEBUG] [LOCAL ] DHR: Loaded 53768 existing records from primary storage. [2025-10-17T18:24:44.577311] [INFO ] [MAIN ] DHR: Loaded 53768 existing records. [2025-10-17T18:24:44.750751] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:44.750963] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-17T18:24:44.751012] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-17T18:24:44.751461] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-17T18:24:44.751518] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-17T18:24:44.764127] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-17T18:24:45.127884] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:45.141946] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T18:24:45.177860] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T18:24:45.558046] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-17T18:24:46.358033] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-17T18:24:46.405628] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T18:24:47.158023] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-17T18:24:47.331023] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:24:47.958060] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-17T18:24:48.330352] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T18:24:48.636154] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T18:24:48.642585] [INFO ] [REMOTE ] DGX: Full fetch complete (65325 records). [2025-10-17T18:24:48.642751] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-17T18:24:48.763122] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-17T18:24:49.083225] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-17T18:24:49.083315] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-17T18:24:49.084160] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-17T18:24:49.084228] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-17T18:24:49.085570] [DEBUG] [LOCAL ] DGX: Trimmed 65325 records to 45306 (keeping 200 days of data) [2025-10-17T18:24:49.365471] [DEBUG] [LOCAL ] DGX: Primary data saved (45306 records). [2025-10-17T18:24:49.365603] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-17T18:24:49.365705] [INFO ] [MAIN ] Update Progress: 614/2368 symbols completed. DGX took 38.0s. Estimated remaining: 4h 2m 7s. Rate: 7.2 symbols/min [2025-10-17T18:24:49.531258] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:49.531412] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-17T18:24:49.531450] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-17T18:24:49.531594] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-17T18:24:49.531686] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-17T18:24:49.531758] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-17T18:24:49.531794] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-17T18:24:49.563142] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-17T18:24:49.889311] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:49.917845] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:24:50.358038] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-17T18:24:50.445982] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T18:24:50.597753] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T18:24:51.158027] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-17T18:24:51.958009] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-17T18:24:52.163183] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T18:24:52.200298] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T18:24:52.758083] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-17T18:24:53.558004] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-17T18:24:54.071305] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:24:54.363132] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-17T18:24:54.382011] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:24:55.157997] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-17T18:24:55.384967] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:24:55.388631] [INFO ] [REMOTE ] DHF: Full fetch complete (30003 records). [2025-10-17T18:24:55.388843] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-17T18:24:55.792131] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-17T18:24:55.792409] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-17T18:24:55.792999] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-17T18:24:55.793461] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-17T18:24:55.794789] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T18:24:55.806683] [DEBUG] [LOCAL ] DHF: Trimmed 30003 records to 21251 (keeping 200 days of data) [2025-10-17T18:24:55.936262] [DEBUG] [LOCAL ] DHF: Primary data saved (21251 records). [2025-10-17T18:24:55.936412] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-17T18:24:55.936531] [INFO ] [MAIN ] Update Progress: 615/2368 symbols completed. DHF took 32.6s. Estimated remaining: 4h 1m 54s. Rate: 7.2 symbols/min [2025-10-17T18:24:55.970100] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-17T18:24:56.130743] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:56.146584] [DEBUG] [LOCAL ] DHX: Loaded 13573 existing records from primary storage. [2025-10-17T18:24:56.146829] [INFO ] [MAIN ] DHX: Loaded 13573 existing records. [2025-10-17T18:24:56.342744] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:56.342959] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-17T18:24:56.343025] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-17T18:24:56.343179] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-17T18:24:56.343239] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-17T18:24:56.739925] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:56.762252] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-17T18:24:56.767670] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:24:57.558065] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-17T18:24:57.745040] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:24:58.290919] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-17T18:24:58.357996] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-17T18:24:59.158041] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-17T18:24:59.715892] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T18:24:59.795391] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T18:24:59.958010] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-17T18:25:00.200127] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:25:00.758027] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-17T18:25:01.558028] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-17T18:25:01.984010] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T18:25:02.358030] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-17T18:25:02.978203] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T18:25:03.158031] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-17T18:25:03.762195] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-17T18:25:03.906307] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T18:25:03.957983] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-17T18:25:04.067880] [DEBUG] [REMOTE ] DHX: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-17T18:25:04.068176] [WARN ] [REMOTE ] DHX: No data returned for month 2025-03 [2025-10-17T18:25:04.068263] [FATAL] [REMOTE ] DHX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:25:04.068369] [FATAL] [MAIN ] DHX: Failed to fetch primary data. [2025-10-17T18:25:04.068447] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:25:04.068530] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-17T18:25:04.068610] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-17T18:25:04.068695] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-17T18:25:04.068896] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-17T18:25:04.069006] [INFO ] [MAIN ] Update Progress: 616/2368 symbols completed. DHX took 8.1s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-17T18:25:04.246874] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:04.261912] [DEBUG] [LOCAL ] DIAX: Loaded 13091 existing records from primary storage. [2025-10-17T18:25:04.262154] [INFO ] [MAIN ] DIAX: Loaded 13091 existing records. [2025-10-17T18:25:04.457768] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:04.458008] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-17T18:25:04.458148] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-17T18:25:04.458408] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-17T18:25:04.458495] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-17T18:25:04.758996] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-17T18:25:04.788742] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-17T18:25:04.880072] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:05.558084] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-17T18:25:06.358077] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-17T18:25:06.567606] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T18:25:06.644365] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T18:25:07.158043] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-17T18:25:07.936829] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T18:25:07.957988] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-17T18:25:08.447370] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:25:08.758043] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-17T18:25:09.554233] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:25:09.557973] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-17T18:25:10.153046] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T18:25:10.167235] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:25:10.166947] [INFO ] [REMOTE ] DHI: Full fetch complete (77009 records). [2025-10-17T18:25:10.170324] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-17T18:25:10.171522] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:25:10.171628] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:25:10.171738] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:25:10.171830] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-17T18:25:10.171912] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-17T18:25:10.171951] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-17T18:25:10.172091] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-17T18:25:10.172999] [INFO ] [MAIN ] Update Progress: 617/2368 symbols completed. DHI took 44.7s. Estimated remaining: 4h 1m 31s. Rate: 7.2 symbols/min [2025-10-17T18:25:10.344163] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:10.366579] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-17T18:25:10.384633] [DEBUG] [LOCAL ] DIN: Loaded 37519 existing records from primary storage. [2025-10-17T18:25:10.384972] [INFO ] [MAIN ] DIN: Loaded 37519 existing records. [2025-10-17T18:25:10.560268] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:10.560489] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-17T18:25:10.560540] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-17T18:25:10.560894] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-17T18:25:10.560950] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-17T18:25:10.915903] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:11.158077] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-17T18:25:11.958010] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-17T18:25:12.285448] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:25:12.725240] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T18:25:12.757983] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-17T18:25:13.558007] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-17T18:25:13.611012] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:25:14.320858] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T18:25:14.357990] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-17T18:25:14.375442] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T18:25:15.158021] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-17T18:25:15.872972] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:25:15.957986] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-17T18:25:16.757999] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-17T18:25:17.153077] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T18:25:17.226221] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T18:25:17.233120] [INFO ] [REMOTE ] DHR: Full fetch complete (77050 records). [2025-10-17T18:25:17.233266] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-17T18:25:17.234111] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:25:17.234250] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:25:17.234305] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:25:17.234373] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-17T18:25:17.234438] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-17T18:25:17.234473] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-17T18:25:17.234634] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-17T18:25:17.235185] [INFO ] [MAIN ] Update Progress: 618/2368 symbols completed. DHR took 32.9s. Estimated remaining: 4h 1m 19s. Rate: 7.3 symbols/min [2025-10-17T18:25:17.404965] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:17.459424] [DEBUG] [LOCAL ] DINO: Loaded 53216 existing records from primary storage. [2025-10-17T18:25:17.459757] [INFO ] [MAIN ] DINO: Loaded 53216 existing records. [2025-10-17T18:25:17.559671] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-17T18:25:17.642031] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:17.642264] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-17T18:25:17.642359] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-17T18:25:17.650336] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-17T18:25:17.664351] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-17T18:25:17.709240] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:25:18.038395] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:18.358037] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-17T18:25:19.158053] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-17T18:25:19.759699] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-17T18:25:19.962730] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-17T18:25:19.964437] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:25:20.102975] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T18:25:20.758045] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-17T18:25:21.550815] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:25:21.557977] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-17T18:25:21.928114] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T18:25:22.358001] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-17T18:25:22.472851] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T18:25:23.158028] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-17T18:25:23.958026] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-17T18:25:24.179043] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T18:25:24.758020] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-17T18:25:24.783585] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:25:25.558026] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-17T18:25:25.608302] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T18:25:25.649787] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T18:25:26.358036] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-17T18:25:26.644925] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:25:27.158122] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-17T18:25:27.908631] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:25:27.958034] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-17T18:25:28.758055] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-17T18:25:28.921608] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T18:25:29.558023] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-17T18:25:29.736889] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:25:30.210538] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T18:25:30.358016] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-17T18:25:31.157997] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-17T18:25:31.278475] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:25:31.441056] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T18:25:31.958034] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-17T18:25:32.467887] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T18:25:32.758009] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-17T18:25:32.876371] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T18:25:32.878605] [INFO ] [REMOTE ] DIAX: Full fetch complete (17696 records). [2025-10-17T18:25:32.878712] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-17T18:25:33.236838] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-17T18:25:33.237152] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-17T18:25:33.237562] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-17T18:25:33.237629] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-17T18:25:33.238202] [DEBUG] [LOCAL ] DIAX: Trimmed 17696 records to 13192 (keeping 200 days of data) [2025-10-17T18:25:33.318296] [DEBUG] [LOCAL ] DIAX: Primary data saved (13192 records). [2025-10-17T18:25:33.318403] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-17T18:25:33.318482] [INFO ] [MAIN ] Update Progress: 619/2368 symbols completed. DIAX took 29.2s. Estimated remaining: 4h 1m 33s. Rate: 7.2 symbols/min [2025-10-17T18:25:33.483896] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:33.538489] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-17T18:25:33.538828] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-10-17T18:25:33.568583] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-17T18:25:33.715162] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:33.715389] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-17T18:25:33.715456] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-17T18:25:33.716049] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-17T18:25:33.716108] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-17T18:25:34.071263] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:34.265058] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T18:25:34.358000] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-17T18:25:35.158096] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-17T18:25:35.384123] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:25:35.391108] [INFO ] [REMOTE ] DHT: Full fetch complete (70160 records). [2025-10-17T18:25:35.391265] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-17T18:25:35.791605] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-17T18:25:35.791733] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-17T18:25:35.792563] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-17T18:25:35.792610] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-17T18:25:35.794043] [DEBUG] [LOCAL ] DHT: Trimmed 70160 records to 48665 (keeping 200 days of data) [2025-10-17T18:25:35.964515] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-17T18:25:36.090301] [DEBUG] [LOCAL ] DHT: Primary data saved (48665 records). [2025-10-17T18:25:36.090450] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-17T18:25:36.090545] [INFO ] [MAIN ] Update Progress: 620/2368 symbols completed. DHT took 46.7s. Estimated remaining: 4h 1m 9s. Rate: 7.2 symbols/min [2025-10-17T18:25:36.256707] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:36.256869] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-17T18:25:36.256906] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-17T18:25:36.257019] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-17T18:25:36.257080] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-17T18:25:36.257154] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-17T18:25:36.257199] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-17T18:25:36.617778] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:36.758006] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-17T18:25:37.002472] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-17T18:25:37.265905] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:25:37.271185] [INFO ] [REMOTE ] DIN: Full fetch complete (54978 records). [2025-10-17T18:25:37.271276] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-17T18:25:37.328190] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T18:25:37.429839] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T18:25:37.563122] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-17T18:25:37.699311] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-17T18:25:37.699387] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-17T18:25:37.700104] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-17T18:25:37.700166] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-17T18:25:37.701235] [DEBUG] [LOCAL ] DIN: Trimmed 54978 records to 37698 (keeping 200 days of data) [2025-10-17T18:25:37.926876] [DEBUG] [LOCAL ] DIN: Primary data saved (37698 records). [2025-10-17T18:25:37.927011] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-17T18:25:37.927588] [INFO ] [MAIN ] Update Progress: 621/2368 symbols completed. DIN took 27.8s. Estimated remaining: 4h 0m 43s. Rate: 7.3 symbols/min [2025-10-17T18:25:38.093373] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:38.142977] [DEBUG] [LOCAL ] DK: Loaded 49758 existing records from primary storage. [2025-10-17T18:25:38.143332] [INFO ] [MAIN ] DK: Loaded 49758 existing records. [2025-10-17T18:25:38.316683] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:38.316902] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-17T18:25:38.316949] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-17T18:25:38.317277] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-17T18:25:38.317316] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-17T18:25:38.370100] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-17T18:25:38.673719] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:38.846134] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T18:25:39.158011] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-17T18:25:39.433323] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T18:25:39.664167] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T18:25:39.958026] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-17T18:25:40.758036] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-17T18:25:41.558102] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-17T18:25:41.725956] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:25:42.361668] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-17T18:25:42.871951] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T18:25:43.061857] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T18:25:43.158019] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-17T18:25:43.249443] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T18:25:43.958074] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-17T18:25:44.723412] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T18:25:44.757984] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-17T18:25:45.558026] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-17T18:25:46.287474] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-17T18:25:46.321926] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T18:25:46.357997] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-17T18:25:47.158121] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-17T18:25:47.415542] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:25:47.958101] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-17T18:25:48.030142] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:25:48.426229] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T18:25:48.758089] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-17T18:25:49.111832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:25:49.558085] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-17T18:25:49.849175] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-17T18:25:49.908761] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T18:25:50.358111] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-17T18:25:51.158040] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-17T18:25:51.958049] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-17T18:25:52.176472] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T18:25:52.307102] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T18:25:52.446785] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T18:25:52.758047] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-17T18:25:53.558077] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-17T18:25:54.358020] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-17T18:25:54.473229] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T18:25:55.158059] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-17T18:25:55.247186] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T18:25:55.501471] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T18:25:55.958084] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-17T18:25:56.758009] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-17T18:25:56.909138] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-17T18:25:57.558025] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-17T18:25:57.596016] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T18:25:57.931121] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-17T18:25:58.359415] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-17T18:25:58.362271] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T18:25:58.369868] [INFO ] [REMOTE ] DINO: Full fetch complete (76721 records). [2025-10-17T18:25:58.370029] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-17T18:25:58.762701] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-17T18:25:58.762801] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-17T18:25:58.763695] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-17T18:25:58.763759] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-17T18:25:58.765221] [DEBUG] [LOCAL ] DINO: Trimmed 76721 records to 53587 (keeping 200 days of data) [2025-10-17T18:25:59.088957] [DEBUG] [LOCAL ] DINO: Primary data saved (53587 records). [2025-10-17T18:25:59.089136] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-17T18:25:59.090101] [INFO ] [MAIN ] Update Progress: 622/2368 symbols completed. DINO took 41.9s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-17T18:25:59.164352] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-17T18:25:59.259259] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:59.259453] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-17T18:25:59.259499] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-17T18:25:59.259610] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-17T18:25:59.259678] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-17T18:25:59.259740] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-17T18:25:59.259785] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-17T18:25:59.609948] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:59.765244] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T18:25:59.766206] [INFO ] [REMOTE ] DIVY: Full fetch complete (1702 records). [2025-10-17T18:25:59.766279] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-17T18:25:59.958304] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T18:25:59.958817] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:25:59.958891] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:25:59.958986] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-17T18:25:59.959068] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-17T18:25:59.958424] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-17T18:25:59.960207] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-17T18:25:59.960288] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-17T18:25:59.960365] [INFO ] [MAIN ] Update Progress: 623/2368 symbols completed. DIVY took 23.9s. Estimated remaining: 4h 0m 42s. Rate: 7.2 symbols/min [2025-10-17T18:26:00.135930] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:00.184138] [DEBUG] [LOCAL ] DKS: Loaded 50058 existing records from primary storage. [2025-10-17T18:26:00.184469] [INFO ] [MAIN ] DKS: Loaded 50058 existing records. [2025-10-17T18:26:00.380976] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:00.381210] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-17T18:26:00.381261] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-17T18:26:00.381696] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-17T18:26:00.381767] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-17T18:26:00.740128] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:00.758037] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-17T18:26:00.914444] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-17T18:26:01.558004] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-17T18:26:01.722482] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:26:01.914697] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T18:26:02.358045] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-17T18:26:03.160015] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-17T18:26:03.162853] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T18:26:03.958034] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-17T18:26:04.295979] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:26:04.758039] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-17T18:26:05.400869] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-17T18:26:05.557999] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-17T18:26:05.637891] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:26:05.840461] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T18:26:06.358020] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-17T18:26:07.157992] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-17T18:26:07.521889] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T18:26:07.898884] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-17T18:26:07.958036] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-17T18:26:08.758005] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-17T18:26:09.053558] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:26:09.558005] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-17T18:26:09.966834] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T18:26:10.300202] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T18:26:10.357995] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-17T18:26:11.158093] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-17T18:26:11.158969] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:26:11.670076] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:26:11.958026] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-17T18:26:12.758045] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-17T18:26:13.535887] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-17T18:26:13.557994] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-17T18:26:13.957459] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T18:26:14.025505] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:26:14.358031] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-17T18:26:14.411550] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:26:14.419040] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-17T18:26:14.419228] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-17T18:26:14.812109] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-17T18:26:14.812203] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-17T18:26:14.813104] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-17T18:26:14.813173] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-17T18:26:14.814904] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54568 (keeping 200 days of data) [2025-10-17T18:26:15.159184] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-17T18:26:15.169130] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-17T18:26:15.169339] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-17T18:26:15.170349] [INFO ] [MAIN ] Update Progress: 624/2368 symbols completed. DIS took 41.9s. Estimated remaining: 4h 0m 53s. Rate: 7.2 symbols/min [2025-10-17T18:26:15.374370] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:15.374847] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T18:26:15.419921] [DEBUG] [LOCAL ] DLB: Loaded 32489 existing records from primary storage. [2025-10-17T18:26:15.420275] [INFO ] [MAIN ] DLB: Loaded 32489 existing records. [2025-10-17T18:26:15.646822] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:15.647047] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-17T18:26:15.647097] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-17T18:26:15.647854] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-17T18:26:15.647913] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-17T18:26:15.963228] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-17T18:26:16.023144] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:16.758059] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-17T18:26:16.838421] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T18:26:16.845050] [INFO ] [REMOTE ] DK: Full fetch complete (70618 records). [2025-10-17T18:26:16.845251] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-17T18:26:16.846093] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:26:16.846181] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:26:16.846227] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:26:16.846297] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-17T18:26:16.846365] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-17T18:26:16.846401] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-10-17T18:26:16.846568] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-10-17T18:26:16.846934] [INFO ] [MAIN ] Update Progress: 625/2368 symbols completed. DK took 38.9s. Estimated remaining: 4h 0m 26s. Rate: 7.2 symbols/min [2025-10-17T18:26:17.026161] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:17.035944] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T18:26:17.050122] [DEBUG] [LOCAL ] DLNG: Loaded 6230 existing records from primary storage. [2025-10-17T18:26:17.050348] [INFO ] [MAIN ] DLNG: Loaded 6230 existing records. [2025-10-17T18:26:17.221445] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:17.221683] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-17T18:26:17.221744] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-17T18:26:17.221911] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-17T18:26:17.221966] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-17T18:26:17.563513] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-17T18:26:17.588155] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:18.304320] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:26:18.358010] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-17T18:26:19.158059] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-17T18:26:19.387693] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:26:19.451613] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:26:19.958002] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-17T18:26:20.005936] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T18:26:20.758038] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-17T18:26:21.558070] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-17T18:26:21.818964] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:26:22.203463] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T18:26:22.358005] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-17T18:26:22.532028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:26:23.158031] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-17T18:26:23.722477] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T18:26:23.738837] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T18:26:23.958034] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-17T18:26:24.758101] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-17T18:26:25.038303] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T18:26:25.558009] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-17T18:26:26.358025] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-17T18:26:26.471947] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T18:26:26.592324] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T18:26:27.084572] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T18:26:27.157999] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-17T18:26:27.933817] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T18:26:27.957987] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-17T18:26:28.758006] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-17T18:26:28.782666] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T18:26:29.558045] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-17T18:26:30.257477] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:26:30.259766] [INFO ] [REMOTE ] DKL: Full fetch complete (27856 records). [2025-10-17T18:26:30.259995] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-17T18:26:30.365244] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-17T18:26:30.481879] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T18:26:30.677035] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-17T18:26:30.677110] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-17T18:26:30.677693] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-17T18:26:30.677763] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-17T18:26:30.678603] [DEBUG] [LOCAL ] DKL: Trimmed 27856 records to 17652 (keeping 200 days of data) [2025-10-17T18:26:30.781154] [DEBUG] [LOCAL ] DKL: Primary data saved (17652 records). [2025-10-17T18:26:30.781292] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-17T18:26:30.781368] [INFO ] [MAIN ] Update Progress: 626/2368 symbols completed. DKL took 31.7s. Estimated remaining: 4h 0m 34s. Rate: 7.2 symbols/min [2025-10-17T18:26:30.946826] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:31.002118] [DEBUG] [LOCAL ] DLR: Loaded 51052 existing records from primary storage. [2025-10-17T18:26:31.002438] [INFO ] [MAIN ] DLR: Loaded 51052 existing records. [2025-10-17T18:26:31.170871] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-17T18:26:31.175572] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:31.176104] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-17T18:26:31.176929] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-17T18:26:31.177304] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-17T18:26:31.177346] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-17T18:26:31.530736] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:31.958049] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-17T18:26:32.150884] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:26:32.654831] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T18:26:32.678827] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:26:32.757986] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-17T18:26:33.558414] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-17T18:26:34.036246] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:26:34.358022] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-17T18:26:35.158009] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-17T18:26:35.347501] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:26:35.708407] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:26:35.958044] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-17T18:26:36.651844] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T18:26:36.653436] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T18:26:36.758015] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-17T18:26:37.558086] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-17T18:26:38.358051] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-17T18:26:38.671322] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T18:26:39.158045] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-17T18:26:39.689299] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:26:39.722106] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:26:39.958057] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-17T18:26:40.758004] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-17T18:26:40.832519] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T18:26:41.558039] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-17T18:26:41.620203] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T18:26:41.627801] [INFO ] [REMOTE ] DKS: Full fetch complete (71775 records). [2025-10-17T18:26:41.627971] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-17T18:26:42.016917] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-17T18:26:42.017003] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-17T18:26:42.018009] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-17T18:26:42.018077] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-17T18:26:42.019572] [DEBUG] [LOCAL ] DKS: Trimmed 71775 records to 50372 (keeping 200 days of data) [2025-10-17T18:26:42.276854] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:26:42.358129] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-17T18:26:42.372208] [DEBUG] [LOCAL ] DKS: Primary data saved (50372 records). [2025-10-17T18:26:42.372814] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-17T18:26:42.373118] [INFO ] [MAIN ] Update Progress: 627/2368 symbols completed. DKS took 42.4s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-17T18:26:42.562568] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:42.599551] [DEBUG] [LOCAL ] DLX: Loaded 28520 existing records from primary storage. [2025-10-17T18:26:42.599925] [INFO ] [MAIN ] DLX: Loaded 28520 existing records. [2025-10-17T18:26:42.869021] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:42.869344] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-17T18:26:42.869415] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-17T18:26:42.869895] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-17T18:26:42.869971] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-17T18:26:43.167833] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-17T18:26:43.309208] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:43.479004] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T18:26:43.731721] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:26:43.736516] [INFO ] [REMOTE ] DLB: Full fetch complete (47349 records). [2025-10-17T18:26:43.736601] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-17T18:26:43.916097] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T18:26:43.958969] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-17T18:26:44.119260] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-17T18:26:44.119327] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-17T18:26:44.119978] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-17T18:26:44.120039] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-17T18:26:44.120958] [DEBUG] [LOCAL ] DLB: Trimmed 47349 records to 32746 (keeping 200 days of data) [2025-10-17T18:26:44.317196] [DEBUG] [LOCAL ] DLB: Primary data saved (32746 records). [2025-10-17T18:26:44.317439] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-17T18:26:44.317555] [INFO ] [MAIN ] Update Progress: 628/2368 symbols completed. DLB took 29.1s. Estimated remaining: 4h 0m 9s. Rate: 7.2 symbols/min [2025-10-17T18:26:44.483697] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:44.503704] [DEBUG] [LOCAL ] DLY: Loaded 20735 existing records from primary storage. [2025-10-17T18:26:44.503961] [INFO ] [MAIN ] DLY: Loaded 20735 existing records. [2025-10-17T18:26:44.677156] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:44.677377] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-17T18:26:44.677450] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-17T18:26:44.677745] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-17T18:26:44.677837] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-17T18:26:44.767700] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-17T18:26:45.031689] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:45.273232] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:26:45.558091] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-17T18:26:46.358005] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-17T18:26:46.666865] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:26:47.002435] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:26:47.089902] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:26:47.157991] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-17T18:26:47.958041] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-17T18:26:48.613304] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T18:26:48.758051] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-17T18:26:49.558027] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-17T18:26:49.709374] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T18:26:49.708915] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:26:50.004788] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:26:50.358056] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-17T18:26:51.158041] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-17T18:26:51.958003] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-17T18:26:52.071562] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T18:26:52.126545] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T18:26:52.758010] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-17T18:26:53.326770] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:26:53.558000] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-17T18:26:54.358037] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-17T18:26:54.747111] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T18:26:54.898616] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:26:55.018838] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T18:26:55.158097] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-17T18:26:55.958101] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-17T18:26:56.684691] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T18:26:56.757987] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-17T18:26:57.155280] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:26:57.558059] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-17T18:26:58.041458] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:26:58.330881] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T18:26:58.332315] [INFO ] [REMOTE ] DLNG: Full fetch complete (11656 records). [2025-10-17T18:26:58.332420] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-17T18:26:58.363201] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-17T18:26:58.688331] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-17T18:26:58.688404] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-17T18:26:58.688706] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-17T18:26:58.688766] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-17T18:26:58.689246] [DEBUG] [LOCAL ] DLNG: Trimmed 11656 records to 6256 (keeping 200 days of data) [2025-10-17T18:26:58.724161] [DEBUG] [LOCAL ] DLNG: Primary data saved (6256 records). [2025-10-17T18:26:58.724254] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-17T18:26:58.724327] [INFO ] [MAIN ] Update Progress: 629/2368 symbols completed. DLNG took 41.9s. Estimated remaining: 4h 0m 17s. Rate: 7.2 symbols/min [2025-10-17T18:26:58.899588] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:58.906204] [DEBUG] [LOCAL ] DMA: Loaded 4772 existing records from primary storage. [2025-10-17T18:26:58.906362] [INFO ] [MAIN ] DMA: Loaded 4772 existing records. [2025-10-17T18:26:59.082315] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:59.082533] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-17T18:26:59.082581] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-17T18:26:59.082766] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-17T18:26:59.082824] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-17T18:26:59.163174] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-17T18:26:59.433997] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:59.958035] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-17T18:27:00.231556] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T18:27:00.231205] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T18:27:00.758040] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-17T18:27:00.802204] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T18:27:01.558026] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-17T18:27:02.160428] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:27:02.358092] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-17T18:27:02.643358] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:27:03.158032] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-17T18:27:03.624218] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T18:27:03.958021] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-17T18:27:04.297060] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:27:04.758001] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-17T18:27:05.121568] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T18:27:05.353379] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T18:27:05.558041] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-17T18:27:06.358077] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-17T18:27:07.067193] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T18:27:07.075098] [INFO ] [REMOTE ] DLX: Full fetch complete (41318 records). [2025-10-17T18:27:07.075290] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T18:27:07.076896] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-17T18:27:07.163191] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-17T18:27:07.450012] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-17T18:27:07.450086] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-17T18:27:07.450705] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-17T18:27:07.450767] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-17T18:27:07.451616] [DEBUG] [LOCAL ] DLX: Trimmed 41318 records to 28685 (keeping 200 days of data) [2025-10-17T18:27:07.622542] [DEBUG] [LOCAL ] DLX: Primary data saved (28685 records). [2025-10-17T18:27:07.622715] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-17T18:27:07.622814] [INFO ] [MAIN ] Update Progress: 630/2368 symbols completed. DLX took 25.2s. Estimated remaining: 4h 0m 11s. Rate: 7.2 symbols/min [2025-10-17T18:27:07.793241] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:07.793446] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-17T18:27:07.793500] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-17T18:27:07.793610] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-17T18:27:07.793678] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-17T18:27:07.793743] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-17T18:27:07.793777] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-17T18:27:07.963101] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-17T18:27:08.147794] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:08.439387] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T18:27:08.652624] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T18:27:08.758054] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-17T18:27:09.313381] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T18:27:09.558025] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-17T18:27:10.358085] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-17T18:27:10.453439] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T18:27:11.158031] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-17T18:27:11.922385] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T18:27:11.958082] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-17T18:27:12.223804] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:27:12.520480] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T18:27:12.758060] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-17T18:27:13.210411] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T18:27:13.557996] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-17T18:27:14.358027] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-17T18:27:15.154192] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:27:15.157977] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-17T18:27:15.355332] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:27:15.362367] [INFO ] [REMOTE ] DLR: Full fetch complete (74163 records). [2025-10-17T18:27:15.362521] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-17T18:27:15.757911] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-17T18:27:15.757994] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-17T18:27:15.758967] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-17T18:27:15.759033] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-17T18:27:15.760468] [DEBUG] [LOCAL ] DLR: Trimmed 74163 records to 51423 (keeping 200 days of data) [2025-10-17T18:27:15.890817] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T18:27:15.962976] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-17T18:27:16.103420] [DEBUG] [LOCAL ] DLR: Primary data saved (51423 records). [2025-10-17T18:27:16.103557] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-17T18:27:16.104093] [INFO ] [MAIN ] Update Progress: 631/2368 symbols completed. DLR took 45.3s. Estimated remaining: 4h 0m 3s. Rate: 7.2 symbols/min [2025-10-17T18:27:16.272764] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:16.286193] [DEBUG] [LOCAL ] DMO: Loaded 9999 existing records from primary storage. [2025-10-17T18:27:16.286421] [INFO ] [MAIN ] DMO: Loaded 9999 existing records. [2025-10-17T18:27:16.468775] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:16.468980] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-17T18:27:16.469027] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-17T18:27:16.469188] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-17T18:27:16.469225] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-17T18:27:16.763107] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-17T18:27:16.816332] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:17.065821] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:27:17.398902] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T18:27:17.558043] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-17T18:27:18.358005] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-17T18:27:18.420683] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T18:27:19.158070] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-17T18:27:19.783867] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T18:27:19.788177] [INFO ] [REMOTE ] DLY: Full fetch complete (28504 records). [2025-10-17T18:27:19.788250] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-17T18:27:19.969807] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-17T18:27:20.052938] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T18:27:20.162625] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-17T18:27:20.162723] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-17T18:27:20.163222] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-17T18:27:20.163262] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-17T18:27:20.163962] [DEBUG] [LOCAL ] DLY: Trimmed 28504 records to 20947 (keeping 200 days of data) [2025-10-17T18:27:20.288891] [DEBUG] [LOCAL ] DLY: Primary data saved (20947 records). [2025-10-17T18:27:20.289016] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-17T18:27:20.289096] [INFO ] [MAIN ] Update Progress: 632/2368 symbols completed. DLY took 36.0s. Estimated remaining: 3h 59m 43s. Rate: 7.2 symbols/min [2025-10-17T18:27:20.454575] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:20.498931] [DEBUG] [LOCAL ] DNA: Loaded 48954 existing records from primary storage. [2025-10-17T18:27:20.499250] [INFO ] [MAIN ] DNA: Loaded 48954 existing records. [2025-10-17T18:27:20.678373] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:20.683306] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:27:20.683387] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-17T18:27:20.685475] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-17T18:27:20.685904] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-17T18:27:20.685960] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-17T18:27:20.763094] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-17T18:27:21.031526] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:21.407942] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T18:27:21.557988] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-17T18:27:22.358031] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-17T18:27:22.446585] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:27:23.158063] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-17T18:27:23.847774] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T18:27:23.849008] [INFO ] [REMOTE ] DMA: Full fetch complete (6639 records). [2025-10-17T18:27:23.849077] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-17T18:27:23.849432] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:27:23.849532] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:27:23.849600] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:27:23.849707] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-17T18:27:23.849785] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-17T18:27:23.849823] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-10-17T18:27:23.849975] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-10-17T18:27:23.850062] [INFO ] [MAIN ] Update Progress: 633/2368 symbols completed. DMA took 25.1s. Estimated remaining: 3h 59m 22s. Rate: 7.2 symbols/min [2025-10-17T18:27:23.963133] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-17T18:27:24.024183] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:24.065638] [DEBUG] [LOCAL ] DNOW: Loaded 44124 existing records from primary storage. [2025-10-17T18:27:24.065952] [INFO ] [MAIN ] DNOW: Loaded 44124 existing records. [2025-10-17T18:27:24.251366] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:24.251760] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-17T18:27:24.251830] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-17T18:27:24.252264] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-17T18:27:24.252322] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-17T18:27:24.438506] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T18:27:24.677615] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:24.758005] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-17T18:27:24.947014] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T18:27:25.558026] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-17T18:27:26.324282] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T18:27:26.357984] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-17T18:27:26.522522] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T18:27:27.158043] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-17T18:27:27.209548] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T18:27:27.958083] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-17T18:27:27.969928] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:27:28.758041] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-17T18:27:29.477692] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:27:29.557994] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-17T18:27:29.565346] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T18:27:30.358019] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-17T18:27:30.817170] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T18:27:31.158002] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-17T18:27:31.187330] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T18:27:31.958029] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-17T18:27:32.648011] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:27:32.758000] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-17T18:27:33.558044] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-17T18:27:34.082725] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T18:27:34.356748] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:27:34.360072] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-17T18:27:34.545097] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T18:27:35.158082] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-17T18:27:35.254317] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T18:27:35.958058] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-17T18:27:36.733890] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T18:27:36.763177] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-17T18:27:36.775037] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T18:27:37.558026] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-17T18:27:38.346847] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:27:38.357969] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-17T18:27:38.763125] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T18:27:39.114354] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T18:27:39.157997] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-17T18:27:39.958007] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-17T18:27:40.013054] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T18:27:40.758076] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-17T18:27:41.558062] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-17T18:27:41.614696] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T18:27:42.144116] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-17T18:27:42.358090] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-17T18:27:43.158004] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-17T18:27:43.220522] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:27:43.958006] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-17T18:27:44.028669] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T18:27:44.030321] [INFO ] [REMOTE ] DMO: Full fetch complete (14483 records). [2025-10-17T18:27:44.030391] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-17T18:27:44.030843] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:27:44.030926] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:27:44.030969] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:27:44.031009] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-17T18:27:44.031065] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-17T18:27:44.031106] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-10-17T18:27:44.031353] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-10-17T18:27:44.031441] [INFO ] [MAIN ] Update Progress: 634/2368 symbols completed. DMO took 27.9s. Estimated remaining: 3h 59m 46s. Rate: 7.2 symbols/min [2025-10-17T18:27:44.214346] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:44.246290] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:27:44.283185] [DEBUG] [LOCAL ] DNP: Loaded 33479 existing records from primary storage. [2025-10-17T18:27:44.283462] [INFO ] [MAIN ] DNP: Loaded 33479 existing records. [2025-10-17T18:27:44.458789] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:44.459004] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-17T18:27:44.459051] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-17T18:27:44.459278] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-17T18:27:44.459317] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-17T18:27:44.763125] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-17T18:27:44.807794] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:27:44.821775] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:44.822891] [INFO ] [REMOTE ] DMB: Full fetch complete (14661 records). [2025-10-17T18:27:44.822983] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-17T18:27:44.823455] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:27:44.823537] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:27:44.823584] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:27:44.823670] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-17T18:27:44.823746] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-17T18:27:44.823789] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-17T18:27:44.823831] [DEBUG] [LOCAL ] DMB: No derivative data file found to delete. [2025-10-17T18:27:44.823887] [INFO ] [MAIN ] Update Progress: 635/2368 symbols completed. DMB took 37.2s. Estimated remaining: 3h 59m 18s. Rate: 7.2 symbols/min [2025-10-17T18:27:44.988783] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:45.040044] [DEBUG] [LOCAL ] DOC: Loaded 53944 existing records from primary storage. [2025-10-17T18:27:45.040384] [INFO ] [MAIN ] DOC: Loaded 53944 existing records. [2025-10-17T18:27:45.213846] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:45.214070] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-17T18:27:45.214118] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-17T18:27:45.214436] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-17T18:27:45.214476] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-17T18:27:45.556884] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:45.557997] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-17T18:27:46.357991] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-17T18:27:46.840530] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T18:27:47.158002] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-17T18:27:47.402214] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T18:27:47.813365] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:27:47.958005] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-17T18:27:48.408187] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T18:27:48.758043] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-17T18:27:49.557998] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-17T18:27:49.843714] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T18:27:50.193538] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:27:50.358023] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-17T18:27:51.158012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-17T18:27:51.206138] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T18:27:51.958031] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-17T18:27:52.542459] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-17T18:27:52.626425] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:27:52.758031] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-17T18:27:53.558021] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-17T18:27:53.643335] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:27:54.358019] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-17T18:27:54.621363] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:27:54.877289] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T18:27:55.158030] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-17T18:27:55.963843] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-17T18:27:55.975797] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:27:56.758010] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-17T18:27:57.117123] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:27:57.558059] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-17T18:27:57.891802] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:27:58.005838] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:27:58.012222] [INFO ] [REMOTE ] DNOW: Full fetch complete (63426 records). [2025-10-17T18:27:58.012328] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-17T18:27:58.367494] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-17T18:27:58.404074] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-17T18:27:58.404156] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-17T18:27:58.405856] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-17T18:27:58.406011] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-17T18:27:58.407354] [DEBUG] [LOCAL ] DNOW: Trimmed 63426 records to 44485 (keeping 200 days of data) [2025-10-17T18:27:58.647020] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T18:27:58.700099] [DEBUG] [LOCAL ] DNOW: Primary data saved (44485 records). [2025-10-17T18:27:58.700229] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-17T18:27:58.700803] [INFO ] [MAIN ] Update Progress: 636/2368 symbols completed. DNOW took 34.9s. Estimated remaining: 3h 59m 25s. Rate: 7.2 symbols/min [2025-10-17T18:27:58.881026] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:58.932000] [DEBUG] [LOCAL ] DOCN: Loaded 51421 existing records from primary storage. [2025-10-17T18:27:58.932315] [INFO ] [MAIN ] DOCN: Loaded 51421 existing records. [2025-10-17T18:27:59.105007] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:59.105206] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-17T18:27:59.105252] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-17T18:27:59.105610] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-17T18:27:59.105695] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-17T18:27:59.159323] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-17T18:27:59.454628] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:59.958048] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-17T18:28:00.460516] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T18:28:00.758083] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-17T18:28:01.501119] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T18:28:01.536810] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:28:01.557979] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-17T18:28:02.358035] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-17T18:28:02.512814] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T18:28:03.158084] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-17T18:28:03.519053] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T18:28:03.958037] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-17T18:28:04.324369] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:28:04.758070] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-17T18:28:05.531172] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T18:28:05.538430] [INFO ] [REMOTE ] DNA: Full fetch complete (71311 records). [2025-10-17T18:28:05.538608] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-17T18:28:05.569849] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-17T18:28:05.961993] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-17T18:28:05.962236] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-17T18:28:05.963903] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:28:05.964995] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-17T18:28:05.974159] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-17T18:28:05.975488] [DEBUG] [LOCAL ] DNA: Trimmed 71311 records to 49343 (keeping 200 days of data) [2025-10-17T18:28:06.188634] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:28:06.284726] [DEBUG] [LOCAL ] DNA: Primary data saved (49343 records). [2025-10-17T18:28:06.284855] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-17T18:28:06.284957] [INFO ] [MAIN ] Update Progress: 637/2368 symbols completed. DNA took 46.0s. Estimated remaining: 3h 59m 14s. Rate: 7.2 symbols/min [2025-10-17T18:28:06.357987] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-17T18:28:07.158058] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-17T18:28:07.640933] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T18:28:07.927602] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:28:07.958033] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-17T18:28:08.586859] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T18:28:08.758018] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-17T18:28:09.558079] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-17T18:28:09.967556] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T18:28:10.358158] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-17T18:28:10.494050] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T18:28:11.158127] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-17T18:28:11.332016] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:28:11.761348] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T18:28:11.957994] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-17T18:28:12.524830] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:28:12.758027] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-17T18:28:13.558006] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-17T18:28:13.956360] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-17T18:28:13.963986] [INFO ] [REMOTE ] DOC: Full fetch complete (77570 records). [2025-10-17T18:28:13.964120] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-17T18:28:14.128290] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:28:14.162741] [INFO ] [REMOTE ] DNP: Full fetch complete (48583 records). [2025-10-17T18:28:14.183526] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-17T18:28:14.193974] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:28:14.249542] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:28:14.266021] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:28:14.289293] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-17T18:28:14.291921] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-17T18:28:14.297684] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-10-17T18:28:14.313243] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-10-17T18:28:14.318498] [INFO ] [MAIN ] Update Progress: 638/2368 symbols completed. DNP took 30.3s. Estimated remaining: 3h 59m 5s. Rate: 7.2 symbols/min [2025-10-17T18:28:14.387183] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-17T18:28:14.387285] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-17T18:28:14.388301] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-17T18:28:14.388366] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-17T18:28:14.389796] [DEBUG] [LOCAL ] DOC: Trimmed 77570 records to 54334 (keeping 200 days of data) [2025-10-17T18:28:14.725395] [DEBUG] [LOCAL ] DOC: Primary data saved (54334 records). [2025-10-17T18:28:14.725528] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-17T18:28:14.725612] [INFO ] [MAIN ] Update Progress: 639/2368 symbols completed. DOC took 29.9s. Estimated remaining: 3h 58m 36s. Rate: 7.2 symbols/min [2025-10-17T18:28:15.316735] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:28:15.327135] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-17T18:28:17.108172] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T18:28:17.118892] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-17T18:28:18.845439] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:28:18.856029] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-17T18:28:20.736609] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:28:20.747737] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-17T18:28:22.750054] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T18:28:22.761371] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-17T18:28:24.566421] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T18:28:24.577725] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-17T18:28:26.886767] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T18:28:26.893944] [INFO ] [REMOTE ] DOCN: Full fetch complete (72725 records). [2025-10-17T18:28:26.894099] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-17T18:28:27.287798] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-17T18:28:27.287891] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-17T18:28:27.288769] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-17T18:28:27.288834] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-17T18:28:27.290321] [DEBUG] [LOCAL ] DOCN: Trimmed 72725 records to 51798 (keeping 200 days of data) [2025-10-17T18:28:27.727822] [DEBUG] [LOCAL ] DOCN: Primary data saved (51798 records). [2025-10-17T18:28:27.728085] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-17T18:28:27.728898] [INFO ] [MAIN ] Update Progress: 640/2368 symbols completed. DOCN took 29.0s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-17T18:28:28.560121] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.556574] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.569923] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.599261] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.674312] [DEBUG] [LOCAL ] DOUG: Loaded 34428 existing records from primary storage. [2025-10-17T18:28:28.685352] [INFO ] [MAIN ] DOUG: Loaded 34428 existing records. [2025-10-17T18:28:28.719200] [DEBUG] [LOCAL ] DOLE: Loaded 39478 existing records from primary storage. [2025-10-17T18:28:28.745611] [INFO ] [MAIN ] DOLE: Loaded 39478 existing records. [2025-10-17T18:28:28.747201] [DEBUG] [LOCAL ] DOCS: Loaded 51081 existing records from primary storage. [2025-10-17T18:28:28.777767] [INFO ] [MAIN ] DOCS: Loaded 51081 existing records. [2025-10-17T18:28:28.914415] [DEBUG] [LOCAL ] DOV: Loaded 45966 existing records from primary storage. [2025-10-17T18:28:28.994717] [INFO ] [MAIN ] DOV: Loaded 45966 existing records. [2025-10-17T18:28:29.381908] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.401030] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.401149] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-17T18:28:29.438393] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.462173] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.410603] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.499118] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-17T18:28:29.504450] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.504851] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-17T18:28:29.505128] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-17T18:28:29.505298] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.505427] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-17T18:28:29.505020] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.518264] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-17T18:28:29.543332] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-17T18:28:29.510698] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-17T18:28:29.607117] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-17T18:28:29.646761] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-17T18:28:29.633032] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-17T18:28:29.666013] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-17T18:28:30.744998] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:30.832060] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-17T18:28:30.920259] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:30.927188] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-17T18:28:30.961428] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:31.002381] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-17T18:28:31.042953] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:31.043261] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-17T18:28:32.422824] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T18:28:32.430330] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-17T18:28:32.684857] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T18:28:32.693725] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-17T18:28:32.787252] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:28:32.795196] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-17T18:28:32.855694] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T18:28:32.866233] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-17T18:28:33.372134] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T18:28:33.379722] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-17T18:28:34.032404] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T18:28:34.041142] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-17T18:28:34.212963] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T18:28:34.222787] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-17T18:28:34.392596] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:28:34.401460] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-17T18:28:34.723290] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T18:28:34.733139] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-17T18:28:34.988769] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:28:34.995973] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-17T18:28:35.798053] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T18:28:35.805689] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-17T18:28:36.281881] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T18:28:36.290408] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-17T18:28:36.406946] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T18:28:36.417281] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-17T18:28:36.483863] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T18:28:36.491687] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-17T18:28:37.291448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:28:37.300142] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-17T18:28:37.719338] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:28:37.730384] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-17T18:28:37.797766] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:28:37.805770] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-17T18:28:38.289682] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:28:38.300717] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-17T18:28:38.351462] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:28:38.360179] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-17T18:28:39.312560] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:28:39.321610] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-17T18:28:39.388356] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T18:28:39.396138] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-17T18:28:39.674448] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T18:28:39.685048] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-17T18:28:40.170382] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:28:40.181484] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-17T18:28:40.627136] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T18:28:40.757988] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-17T18:28:40.788961] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T18:28:41.330267] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:28:41.558009] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-17T18:28:42.150252] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T18:28:42.164587] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T18:28:42.357997] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-17T18:28:43.138573] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T18:28:43.157991] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-17T18:28:43.797246] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T18:28:43.958012] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-17T18:28:44.758044] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-17T18:28:45.063705] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T18:28:45.364554] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:28:45.558079] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-17T18:28:46.235817] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:28:46.357992] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-17T18:28:47.122313] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:28:47.157984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-17T18:28:47.958026] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-17T18:28:48.038444] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T18:28:48.758029] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-17T18:28:48.936221] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:28:49.421140] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:28:49.425469] [INFO ] [REMOTE ] DOUG: Full fetch complete (50340 records). [2025-10-17T18:28:49.425564] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-17T18:28:49.567319] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-17T18:28:49.814823] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-17T18:28:49.814974] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-17T18:28:49.815781] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-17T18:28:49.815845] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-17T18:28:49.817245] [DEBUG] [LOCAL ] DOUG: Trimmed 50340 records to 34582 (keeping 200 days of data) [2025-10-17T18:28:50.011003] [DEBUG] [LOCAL ] DOUG: Primary data saved (34582 records). [2025-10-17T18:28:50.011141] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-17T18:28:50.011224] [INFO ] [MAIN ] Update Progress: 641/2368 symbols completed. DOUG took 22.2s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-17T18:28:50.177732] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:50.226357] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-17T18:28:50.226735] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-10-17T18:28:50.364133] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-17T18:28:50.406117] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:50.406586] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-17T18:28:50.406761] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-17T18:28:50.407289] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-17T18:28:50.407349] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-17T18:28:50.721263] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T18:28:50.808756] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:51.158095] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-17T18:28:51.388211] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:28:51.966442] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-17T18:28:51.970590] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T18:28:51.977013] [INFO ] [REMOTE ] DOLE: Full fetch complete (54603 records). [2025-10-17T18:28:51.977135] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-17T18:28:52.356518] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-17T18:28:52.356600] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-17T18:28:52.357351] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-17T18:28:52.357434] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-17T18:28:52.358575] [DEBUG] [LOCAL ] DOLE: Trimmed 54603 records to 39732 (keeping 200 days of data) [2025-10-17T18:28:52.597942] [DEBUG] [LOCAL ] DOLE: Primary data saved (39732 records). [2025-10-17T18:28:52.598090] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-17T18:28:52.598174] [INFO ] [MAIN ] Update Progress: 642/2368 symbols completed. DOLE took 24.9s. Estimated remaining: 3h 58m 46s. Rate: 7.2 symbols/min [2025-10-17T18:28:52.766510] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-17T18:28:52.770256] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:52.785801] [DEBUG] [LOCAL ] DPG: Loaded 13660 existing records from primary storage. [2025-10-17T18:28:52.786033] [INFO ] [MAIN ] DPG: Loaded 13660 existing records. [2025-10-17T18:28:52.904137] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:28:52.934114] [INFO ] [REMOTE ] DOV: Full fetch complete (65876 records). [2025-10-17T18:28:52.962317] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-17T18:28:52.998571] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:53.062493] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-17T18:28:53.079187] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-17T18:28:53.100291] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-17T18:28:53.110832] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-17T18:28:53.693396] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-17T18:28:53.709116] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-17T18:28:53.727015] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-17T18:28:53.737630] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-17T18:28:53.768811] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:53.769298] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-17T18:28:53.770553] [DEBUG] [LOCAL ] DOV: Trimmed 65876 records to 46315 (keeping 200 days of data) [2025-10-17T18:28:54.060411] [DEBUG] [LOCAL ] DOV: Primary data saved (46315 records). [2025-10-17T18:28:54.060543] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-17T18:28:54.061111] [INFO ] [MAIN ] Update Progress: 643/2368 symbols completed. DOV took 26.3s. Estimated remaining: 3h 58m 19s. Rate: 7.2 symbols/min [2025-10-17T18:28:54.232779] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:54.269270] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-17T18:28:54.318533] [DEBUG] [LOCAL ] DQ: Loaded 44086 existing records from primary storage. [2025-10-17T18:28:54.318873] [INFO ] [MAIN ] DQ: Loaded 44086 existing records. [2025-10-17T18:28:54.372123] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-17T18:28:54.515638] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:54.516517] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-17T18:28:54.516762] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-17T18:28:54.517324] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-17T18:28:54.517433] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-17T18:28:54.854983] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:28:54.856499] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:28:54.947305] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:55.158029] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-17T18:28:55.958012] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-17T18:28:56.019927] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T18:28:56.448261] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T18:28:56.758015] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-17T18:28:57.558010] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-17T18:28:57.724569] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:28:58.340833] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:28:58.358005] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-17T18:28:58.656034] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:28:59.158042] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-17T18:28:59.877249] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T18:28:59.957999] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-17T18:29:00.725153] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T18:29:00.731815] [INFO ] [REMOTE ] DOCS: Full fetch complete (73646 records). [2025-10-17T18:29:00.731994] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-17T18:29:00.732870] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:29:00.732962] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:29:00.733006] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:29:00.733085] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-17T18:29:00.733183] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-17T18:29:00.733262] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-17T18:29:00.733439] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-10-17T18:29:00.733532] [INFO ] [MAIN ] Update Progress: 644/2368 symbols completed. DOCS took 33.0s. Estimated remaining: 3h 58m 7s. Rate: 7.2 symbols/min [2025-10-17T18:29:00.766544] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-17T18:29:00.925680] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:00.925842] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-10-17T18:29:00.925880] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-10-17T18:29:00.925994] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-17T18:29:00.926035] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-17T18:29:00.926077] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-17T18:29:00.926110] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-17T18:29:01.300855] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:01.558069] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-17T18:29:01.710021] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:29:02.358042] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-17T18:29:02.871578] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T18:29:02.912200] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:29:03.158055] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-17T18:29:03.679604] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T18:29:03.958038] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-17T18:29:04.414473] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T18:29:04.758038] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-17T18:29:05.558004] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-17T18:29:05.816981] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T18:29:05.957680] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T18:29:06.358030] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-17T18:29:07.158065] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-17T18:29:07.261286] [DEBUG] [REMOTE ] DPG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T18:29:07.261569] [WARN ] [REMOTE ] DPG: No data returned for month 2025-04 [2025-10-17T18:29:07.261702] [FATAL] [REMOTE ] DPG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:29:07.261823] [FATAL] [MAIN ] DPG: Failed to fetch primary data. [2025-10-17T18:29:07.261907] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:29:07.262002] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-17T18:29:07.262084] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-17T18:29:07.262122] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-10-17T18:29:07.262267] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-10-17T18:29:07.262351] [INFO ] [MAIN ] Update Progress: 645/2368 symbols completed. DPG took 14.7s. Estimated remaining: 3h 57m 54s. Rate: 7.2 symbols/min [2025-10-17T18:29:07.435465] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:07.450854] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-17T18:29:07.450952] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-17T18:29:07.461080] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-17T18:29:07.461761] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-17T18:29:07.462868] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-17T18:29:07.462735] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:29:07.463154] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-17T18:29:07.755014] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:29:07.859613] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:07.958033] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-17T18:29:08.758017] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-17T18:29:09.558019] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-17T18:29:09.970747] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:29:10.331925] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T18:29:10.357989] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-17T18:29:11.040439] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T18:29:11.157993] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-17T18:29:11.782547] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:29:11.958012] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-17T18:29:12.758023] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-17T18:29:12.784141] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:29:13.558045] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-17T18:29:13.895159] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T18:29:14.358081] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-17T18:29:14.388836] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:29:15.158022] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-17T18:29:15.215156] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:29:15.958025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-17T18:29:16.283508] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:29:16.710677] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:29:16.758010] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-17T18:29:17.515447] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:29:17.558013] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-17T18:29:18.358007] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-17T18:29:18.408969] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:29:18.895571] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:29:19.158065] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-17T18:29:19.958076] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-17T18:29:20.104682] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:29:20.758047] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-17T18:29:21.002696] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T18:29:21.558040] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-17T18:29:22.065061] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T18:29:22.358021] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-17T18:29:22.531238] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T18:29:23.046603] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T18:29:23.157986] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-17T18:29:23.958018] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-17T18:29:24.406899] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T18:29:24.505371] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T18:29:24.758054] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-17T18:29:25.399884] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T18:29:25.558024] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-17T18:29:26.358035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-17T18:29:26.400225] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:29:26.406407] [INFO ] [REMOTE ] DRD: Full fetch complete (51642 records). [2025-10-17T18:29:26.406510] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-17T18:29:26.783011] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-17T18:29:26.783095] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-17T18:29:26.783803] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-17T18:29:26.783867] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-17T18:29:26.785041] [DEBUG] [LOCAL ] DRD: Trimmed 51642 records to 38427 (keeping 200 days of data) [2025-10-17T18:29:27.016718] [DEBUG] [LOCAL ] DRD: Primary data saved (38427 records). [2025-10-17T18:29:27.016876] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-17T18:29:27.016953] [INFO ] [MAIN ] Update Progress: 646/2368 symbols completed. DRD took 26.3s. Estimated remaining: 3h 58m 16s. Rate: 7.2 symbols/min [2025-10-17T18:29:27.165252] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-17T18:29:27.185541] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:27.185777] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-17T18:29:27.185825] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-17T18:29:27.185938] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-17T18:29:27.185979] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-17T18:29:27.186020] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-17T18:29:27.186053] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-17T18:29:27.576541] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:27.847923] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-17T18:29:27.957994] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-17T18:29:28.046584] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:29:28.053142] [INFO ] [REMOTE ] DQ: Full fetch complete (63581 records). [2025-10-17T18:29:28.053246] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-17T18:29:28.433251] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-17T18:29:28.433327] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-17T18:29:28.434121] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-17T18:29:28.434184] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-17T18:29:28.435370] [DEBUG] [LOCAL ] DQ: Trimmed 63581 records to 44434 (keeping 200 days of data) [2025-10-17T18:29:28.685719] [DEBUG] [LOCAL ] DQ: Primary data saved (44434 records). [2025-10-17T18:29:28.685983] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-17T18:29:28.686693] [INFO ] [MAIN ] Update Progress: 647/2368 symbols completed. DQ took 34.6s. Estimated remaining: 3h 57m 50s. Rate: 7.2 symbols/min [2025-10-17T18:29:28.760998] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-17T18:29:28.888812] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:28.889053] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-17T18:29:28.889115] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-17T18:29:28.889378] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-17T18:29:28.889445] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-17T18:29:28.889528] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-17T18:29:28.889583] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-17T18:29:29.025970] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T18:29:29.277112] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:29.558054] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-17T18:29:29.848544] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T18:29:30.358068] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-17T18:29:30.589810] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:29:31.158021] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-17T18:29:31.348760] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:29:31.957996] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-17T18:29:32.361581] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T18:29:32.520726] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-17T18:29:32.758022] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-17T18:29:33.553640] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T18:29:33.557971] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-17T18:29:33.623526] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:29:34.352304] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T18:29:34.357977] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-17T18:29:35.158056] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-17T18:29:35.958009] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-17T18:29:36.360952] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T18:29:36.758010] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-17T18:29:36.881434] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T18:29:36.924319] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T18:29:37.558064] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-17T18:29:38.358077] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-17T18:29:38.410722] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:29:39.158056] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-17T18:29:39.286396] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T18:29:39.699324] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T18:29:39.706820] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-17T18:29:39.706938] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-17T18:29:39.963175] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-17T18:29:40.088131] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-17T18:29:40.088208] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-17T18:29:40.089048] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-17T18:29:40.089112] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-17T18:29:40.090478] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54513 (keeping 200 days of data) [2025-10-17T18:29:40.417136] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-10-17T18:29:40.417280] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-17T18:29:40.417395] [INFO ] [MAIN ] Update Progress: 648/2368 symbols completed. DOW took 50.4s. Estimated remaining: 3h 57m 51s. Rate: 7.2 symbols/min [2025-10-17T18:29:40.585125] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:40.585415] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-17T18:29:40.585518] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-17T18:29:40.585721] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-17T18:29:40.585811] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-17T18:29:40.585877] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-17T18:29:40.585915] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-17T18:29:40.758128] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-17T18:29:40.958305] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:40.960409] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:29:40.967613] [INFO ] [REMOTE ] DRH: Full fetch complete (72086 records). [2025-10-17T18:29:40.967783] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-17T18:29:41.338975] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T18:29:41.363547] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-17T18:29:41.364001] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-17T18:29:41.364887] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-17T18:29:41.364966] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-17T18:29:41.366244] [DEBUG] [LOCAL ] DRH: Trimmed 72086 records to 51122 (keeping 200 days of data) [2025-10-17T18:29:41.563287] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-17T18:29:41.662744] [DEBUG] [LOCAL ] DRH: Primary data saved (51122 records). [2025-10-17T18:29:41.662968] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-17T18:29:41.663061] [INFO ] [MAIN ] Update Progress: 649/2368 symbols completed. DRH took 34.4s. Estimated remaining: 3h 57m 24s. Rate: 7.2 symbols/min [2025-10-17T18:29:41.835992] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:41.850856] [DEBUG] [LOCAL ] DSM: Loaded 14194 existing records from primary storage. [2025-10-17T18:29:41.851092] [INFO ] [MAIN ] DSM: Loaded 14194 existing records. [2025-10-17T18:29:42.033209] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:29:42.033786] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-17T18:29:42.033840] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-17T18:29:42.034172] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-17T18:29:42.034232] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-17T18:29:42.176672] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-17T18:29:42.363189] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-17T18:29:42.427849] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:43.044113] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T18:29:43.158045] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-17T18:29:43.247345] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T18:29:43.958017] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-17T18:29:44.344821] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T18:29:44.758033] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-17T18:29:45.273304] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T18:29:45.558013] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-17T18:29:45.732738] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:29:46.358031] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-17T18:29:47.150716] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T18:29:47.157975] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-17T18:29:47.196857] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:29:47.875745] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T18:29:47.958036] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-17T18:29:48.673930] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T18:29:48.758039] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-17T18:29:49.558018] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-17T18:29:50.358042] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-17T18:29:50.566882] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:29:50.599008] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T18:29:51.158009] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-17T18:29:51.487885] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:29:51.958022] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-17T18:29:52.758038] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-17T18:29:52.812899] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:29:52.814455] [INFO ] [REMOTE ] DRLL: Full fetch complete (14666 records). [2025-10-17T18:29:52.814523] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-17T18:29:53.189307] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-17T18:29:53.189411] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-17T18:29:53.189911] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-17T18:29:53.189983] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-17T18:29:53.217847] [DEBUG] [LOCAL ] DRLL: Trimmed 14666 records to 9219 (keeping 200 days of data) [2025-10-17T18:29:53.221108] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T18:29:53.286855] [DEBUG] [LOCAL ] DRLL: Primary data saved (9219 records). [2025-10-17T18:29:53.286994] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-17T18:29:53.287071] [INFO ] [MAIN ] Update Progress: 650/2368 symbols completed. DRLL took 24.6s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-17T18:29:53.455094] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:53.455257] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-17T18:29:53.455294] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-17T18:29:53.455409] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-17T18:29:53.455449] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-17T18:29:53.455488] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-17T18:29:53.455519] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-17T18:29:53.563176] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-17T18:29:53.812375] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:53.826691] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:29:54.358057] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-17T18:29:54.930442] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:29:55.158037] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-17T18:29:55.524255] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:29:55.958073] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-17T18:29:56.493221] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:29:56.758041] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-17T18:29:57.318302] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:29:57.478408] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:29:57.558042] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-17T18:29:58.359209] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-17T18:29:58.362175] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T18:29:58.895763] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T18:29:59.158033] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-17T18:29:59.958055] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-17T18:30:00.758007] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-17T18:30:00.862247] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:30:00.905846] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T18:30:01.438178] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T18:30:01.558048] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-17T18:30:02.358037] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-17T18:30:02.846296] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:30:03.158092] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-17T18:30:03.651303] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-17T18:30:03.957992] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-17T18:30:04.035877] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T18:30:04.758034] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-17T18:30:05.550469] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:30:05.557995] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-17T18:30:05.852401] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T18:30:05.859158] [INFO ] [REMOTE ] DRI: Full fetch complete (69520 records). [2025-10-17T18:30:05.859282] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-17T18:30:06.243391] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-17T18:30:06.243472] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-17T18:30:06.244324] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-17T18:30:06.244388] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-17T18:30:06.245769] [DEBUG] [LOCAL ] DRI: Trimmed 69520 records to 48386 (keeping 200 days of data) [2025-10-17T18:30:06.358698] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-17T18:30:06.553669] [DEBUG] [LOCAL ] DRI: Primary data saved (48386 records). [2025-10-17T18:30:06.553820] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-17T18:30:06.553897] [INFO ] [MAIN ] Update Progress: 651/2368 symbols completed. DRI took 39.5s. Estimated remaining: 3h 57m 29s. Rate: 7.2 symbols/min [2025-10-17T18:30:06.681196] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T18:30:06.743407] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:06.749114] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-17T18:30:06.772498] [DEBUG] [LOCAL ] DSU: Loaded 23202 existing records from primary storage. [2025-10-17T18:30:06.772885] [INFO ] [MAIN ] DSU: Loaded 23202 existing records. [2025-10-17T18:30:06.951791] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:06.952048] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-17T18:30:06.952097] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-17T18:30:06.952370] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-17T18:30:06.952427] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-17T18:30:07.163219] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-17T18:30:07.299811] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:07.732272] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T18:30:07.958040] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-17T18:30:08.758030] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-17T18:30:09.096231] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T18:30:09.558021] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-17T18:30:10.305557] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:30:10.357994] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-17T18:30:10.395250] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T18:30:11.158017] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-17T18:30:11.608423] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T18:30:11.782244] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T18:30:11.958012] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-17T18:30:12.758003] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-17T18:30:13.056591] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:30:13.558029] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-17T18:30:13.700264] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:30:14.358021] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-17T18:30:14.645670] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:30:14.808523] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:30:15.158025] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-17T18:30:15.958001] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-17T18:30:16.320417] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:30:16.758046] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-17T18:30:17.280710] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:30:17.558030] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-17T18:30:18.358040] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-17T18:30:18.700228] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:30:19.158046] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-17T18:30:19.368458] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-17T18:30:19.370517] [INFO ] [REMOTE ] DSM: Full fetch complete (23807 records). [2025-10-17T18:30:19.370602] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-17T18:30:19.371327] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:30:19.371447] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:30:19.371491] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:30:19.371533] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-17T18:30:19.371593] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-17T18:30:19.371630] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-17T18:30:19.371838] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-10-17T18:30:19.371937] [INFO ] [MAIN ] Update Progress: 652/2368 symbols completed. DSM took 37.7s. Estimated remaining: 3h 57m 33s. Rate: 7.2 symbols/min [2025-10-17T18:30:19.560373] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:19.584329] [DEBUG] [LOCAL ] DSX: Loaded 24160 existing records from primary storage. [2025-10-17T18:30:19.584603] [INFO ] [MAIN ] DSX: Loaded 24160 existing records. [2025-10-17T18:30:19.704598] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T18:30:19.799820] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:19.800074] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-17T18:30:19.800128] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-17T18:30:19.800393] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-17T18:30:19.800451] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-17T18:30:19.963270] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-17T18:30:20.202240] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:20.202810] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T18:30:20.736213] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:30:20.758030] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-17T18:30:21.558041] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-17T18:30:21.884480] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:30:21.889453] [INFO ] [REMOTE ] DSL: Full fetch complete (41776 records). [2025-10-17T18:30:21.889540] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-17T18:30:22.260256] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-17T18:30:22.260344] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-17T18:30:22.260982] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-17T18:30:22.261043] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-17T18:30:22.261965] [DEBUG] [LOCAL ] DSL: Trimmed 41776 records to 29410 (keeping 200 days of data) [2025-10-17T18:30:22.367855] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-17T18:30:22.449072] [DEBUG] [LOCAL ] DSL: Primary data saved (29410 records). [2025-10-17T18:30:22.449230] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-17T18:30:22.449352] [INFO ] [MAIN ] Update Progress: 653/2368 symbols completed. DSL took 42.0s. Estimated remaining: 3h 57m 11s. Rate: 7.2 symbols/min [2025-10-17T18:30:22.619368] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:22.668784] [DEBUG] [LOCAL ] DT: Loaded 53331 existing records from primary storage. [2025-10-17T18:30:22.669127] [INFO ] [MAIN ] DT: Loaded 53331 existing records. [2025-10-17T18:30:22.787799] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T18:30:22.869083] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:22.871997] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T18:30:22.871889] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-17T18:30:22.872950] [INFO ] [REMOTE ] DSMC: Full fetch complete (2859 records). [2025-10-17T18:30:22.873075] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-17T18:30:22.873157] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-17T18:30:22.952218] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-17T18:30:22.975050] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-17T18:30:23.159233] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-17T18:30:23.648944] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-17T18:30:23.669342] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-17T18:30:23.691631] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-17T18:30:23.691770] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-17T18:30:23.692854] [DEBUG] [LOCAL ] DSMC: Trimmed 2859 records to 1866 (keeping 200 days of data) [2025-10-17T18:30:23.691290] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:23.705808] [DEBUG] [LOCAL ] DSMC: Primary data saved (1866 records). [2025-10-17T18:30:23.705893] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-17T18:30:23.705984] [INFO ] [MAIN ] Update Progress: 654/2368 symbols completed. DSMC took 30.4s. Estimated remaining: 3h 56m 44s. Rate: 7.2 symbols/min [2025-10-17T18:30:23.871953] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:23.883237] [DEBUG] [LOCAL ] DTB: Loaded 5017 existing records from primary storage. [2025-10-17T18:30:23.883448] [INFO ] [MAIN ] DTB: Loaded 5017 existing records. [2025-10-17T18:30:23.963256] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-17T18:30:24.059257] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:24.059471] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-17T18:30:24.059521] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-17T18:30:24.059705] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-17T18:30:24.059762] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-17T18:30:24.413078] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:24.707686] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T18:30:24.758117] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-17T18:30:25.558045] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-17T18:30:25.990593] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T18:30:26.023513] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:30:26.357989] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-17T18:30:26.719004] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:30:27.158047] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-17T18:30:27.578104] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T18:30:27.958033] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-17T18:30:28.050774] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:30:28.758048] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-17T18:30:29.558028] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-17T18:30:29.736884] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:30:29.976286] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:30:30.358083] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-17T18:30:31.019092] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T18:30:31.047246] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T18:30:31.158067] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-17T18:30:31.958036] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-17T18:30:32.443279] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:30:32.756452] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:30:32.765632] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-17T18:30:33.558055] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-17T18:30:34.063148] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T18:30:34.358042] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-17T18:30:34.919455] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:30:34.923760] [INFO ] [REMOTE ] DSU: Full fetch complete (33165 records). [2025-10-17T18:30:34.923909] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-17T18:30:35.030951] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T18:30:35.163174] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-17T18:30:35.313825] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-17T18:30:35.313903] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-17T18:30:35.314455] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-17T18:30:35.314495] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-17T18:30:35.315360] [DEBUG] [LOCAL ] DSU: Trimmed 33165 records to 23392 (keeping 200 days of data) [2025-10-17T18:30:35.451082] [DEBUG] [LOCAL ] DSU: Primary data saved (23392 records). [2025-10-17T18:30:35.451206] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-17T18:30:35.451283] [INFO ] [MAIN ] Update Progress: 655/2368 symbols completed. DSU took 28.9s. Estimated remaining: 3h 56m 45s. Rate: 7.2 symbols/min [2025-10-17T18:30:35.618793] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:35.665163] [DEBUG] [LOCAL ] DTE: Loaded 47720 existing records from primary storage. [2025-10-17T18:30:35.665480] [INFO ] [MAIN ] DTE: Loaded 47720 existing records. [2025-10-17T18:30:35.841052] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:35.841316] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-17T18:30:35.841376] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-17T18:30:35.841734] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-17T18:30:35.841802] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-17T18:30:35.945078] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T18:30:35.960726] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-17T18:30:36.197212] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:36.758062] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-17T18:30:37.392256] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T18:30:37.558026] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-17T18:30:38.358030] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-17T18:30:38.637848] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T18:30:38.738253] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T18:30:38.987169] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T18:30:39.158054] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-17T18:30:39.958039] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-17T18:30:40.758098] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-17T18:30:41.052110] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T18:30:41.402056] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T18:30:41.558003] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-17T18:30:42.046763] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T18:30:42.358020] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-17T18:30:42.700087] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T18:30:43.158116] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-17T18:30:43.958017] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-17T18:30:44.285811] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:30:44.339367] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-17T18:30:44.439896] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T18:30:44.758078] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-17T18:30:45.558045] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-17T18:30:46.364279] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-17T18:30:46.382944] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:30:46.653354] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:30:47.158020] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-17T18:30:47.958012] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-17T18:30:48.104597] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:30:48.333094] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T18:30:48.552981] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:30:48.758047] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-17T18:30:49.545509] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T18:30:49.558023] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-17T18:30:50.358042] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-17T18:30:50.808425] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:30:50.813522] [INFO ] [REMOTE ] DSX: Full fetch complete (35826 records). [2025-10-17T18:30:50.813741] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-17T18:30:51.159117] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-17T18:30:51.203671] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-17T18:30:51.203769] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-17T18:30:51.204362] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-17T18:30:51.204406] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-17T18:30:51.205379] [DEBUG] [LOCAL ] DSX: Trimmed 35826 records to 24294 (keeping 200 days of data) [2025-10-17T18:30:51.343291] [DEBUG] [LOCAL ] DSX: Primary data saved (24294 records). [2025-10-17T18:30:51.343432] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-17T18:30:51.343572] [INFO ] [MAIN ] Update Progress: 656/2368 symbols completed. DSX took 32.0s. Estimated remaining: 3h 56m 56s. Rate: 7.2 symbols/min [2025-10-17T18:30:51.511351] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:51.511544] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-17T18:30:51.511582] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-17T18:30:51.511722] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-17T18:30:51.511771] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-17T18:30:51.511812] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-17T18:30:51.511900] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-17T18:30:51.907868] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:51.957996] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-17T18:30:52.113542] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:30:52.705747] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T18:30:52.758019] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-17T18:30:52.952809] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T18:30:53.558070] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-17T18:30:53.917936] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-17T18:30:54.358039] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-17T18:30:54.404844] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:30:54.712139] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T18:30:55.158034] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-17T18:30:55.958058] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-17T18:30:56.405942] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T18:30:56.758034] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-17T18:30:57.014020] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:30:57.558060] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-17T18:30:58.358034] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-17T18:30:58.562955] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:30:58.797181] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-17T18:30:59.158087] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-17T18:30:59.380980] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:30:59.958092] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-17T18:31:00.504708] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T18:31:00.758004] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-17T18:31:01.179992] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:31:01.249258] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T18:31:01.256180] [INFO ] [REMOTE ] DT: Full fetch complete (76503 records). [2025-10-17T18:31:01.256307] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-17T18:31:01.257165] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:31:01.257259] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:31:01.257301] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:31:01.257392] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-17T18:31:01.257476] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-17T18:31:01.257514] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-10-17T18:31:01.257675] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-10-17T18:31:01.257787] [INFO ] [MAIN ] Update Progress: 657/2368 symbols completed. DT took 38.8s. Estimated remaining: 3h 56m 52s. Rate: 7.2 symbols/min [2025-10-17T18:31:01.435803] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:01.436002] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-17T18:31:01.436063] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-17T18:31:01.436191] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-17T18:31:01.436234] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-17T18:31:01.436278] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-17T18:31:01.436313] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-17T18:31:01.563196] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-17T18:31:01.827272] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:02.195274] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T18:31:02.358063] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-17T18:31:03.158101] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-17T18:31:03.180902] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T18:31:03.708368] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T18:31:03.958083] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-17T18:31:04.676060] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T18:31:04.758048] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-17T18:31:05.487356] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T18:31:05.488472] [INFO ] [REMOTE ] DTB: Full fetch complete (6628 records). [2025-10-17T18:31:05.488541] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-17T18:31:05.563098] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-17T18:31:05.846461] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-17T18:31:05.846556] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-17T18:31:05.846778] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-17T18:31:05.846839] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-17T18:31:05.847252] [DEBUG] [LOCAL ] DTB: Trimmed 6628 records to 5028 (keeping 200 days of data) [2025-10-17T18:31:05.877710] [DEBUG] [LOCAL ] DTB: Primary data saved (5028 records). [2025-10-17T18:31:05.877798] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-17T18:31:05.877874] [INFO ] [MAIN ] Update Progress: 658/2368 symbols completed. DTB took 42.2s. Estimated remaining: 3h 56m 34s. Rate: 7.2 symbols/min [2025-10-17T18:31:06.042818] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:06.042966] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-17T18:31:06.043037] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-17T18:31:06.043153] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-17T18:31:06.043194] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-17T18:31:06.043235] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-17T18:31:06.043267] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-17T18:31:06.304414] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T18:31:06.365320] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-17T18:31:06.406720] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:06.850998] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T18:31:07.158027] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-17T18:31:07.666218] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T18:31:07.666964] [INFO ] [REMOTE ] DTF: Full fetch complete (1746 records). [2025-10-17T18:31:07.667031] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-17T18:31:07.667413] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:31:07.667513] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:31:07.667605] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:31:07.667718] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-17T18:31:07.667789] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-17T18:31:07.667825] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-17T18:31:07.667864] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-17T18:31:07.667915] [INFO ] [MAIN ] Update Progress: 659/2368 symbols completed. DTF took 16.3s. Estimated remaining: 3h 56m 9s. Rate: 7.2 symbols/min [2025-10-17T18:31:07.844429] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:07.887150] [DEBUG] [LOCAL ] DTM: Loaded 44243 existing records from primary storage. [2025-10-17T18:31:07.887467] [INFO ] [MAIN ] DTM: Loaded 44243 existing records. [2025-10-17T18:31:07.963170] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-17T18:31:08.069893] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:08.070083] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-17T18:31:08.070129] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-17T18:31:08.070371] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-17T18:31:08.070428] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-17T18:31:08.424985] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:08.758030] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-17T18:31:09.558010] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-17T18:31:09.697943] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:31:09.792280] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:31:09.792596] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-17T18:31:09.792727] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:31:09.792840] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-17T18:31:09.792907] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:31:09.792980] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-17T18:31:09.793044] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-17T18:31:09.793081] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-17T18:31:09.793118] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-17T18:31:09.793164] [INFO ] [MAIN ] Update Progress: 660/2368 symbols completed. DTK took 3.9s. Estimated remaining: 3h 55m 45s. Rate: 7.2 symbols/min [2025-10-17T18:31:09.965983] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:09.974834] [DEBUG] [LOCAL ] DTW: Loaded 4840 existing records from primary storage. [2025-10-17T18:31:09.975054] [INFO ] [MAIN ] DTW: Loaded 4840 existing records. [2025-10-17T18:31:10.152435] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:10.152732] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-17T18:31:10.152790] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-17T18:31:10.152940] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-17T18:31:10.152996] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-17T18:31:10.363364] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-17T18:31:10.518859] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:10.713074] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T18:31:11.140099] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T18:31:11.157984] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-17T18:31:11.882357] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:31:11.958035] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-17T18:31:12.758036] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-17T18:31:12.872397] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:31:13.558036] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-17T18:31:14.265546] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T18:31:14.358027] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-17T18:31:14.438808] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T18:31:14.981349] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T18:31:15.158059] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-17T18:31:15.958060] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-17T18:31:16.758009] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-17T18:31:17.023296] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T18:31:17.145763] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T18:31:17.565160] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-17T18:31:17.583719] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:31:18.358015] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-17T18:31:19.158023] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-17T18:31:19.329459] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:31:19.738068] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T18:31:19.922321] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T18:31:19.957991] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-17T18:31:20.545249] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T18:31:20.758009] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-17T18:31:21.558037] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-17T18:31:22.164524] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T18:31:22.358085] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-17T18:31:22.670672] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:31:23.125547] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T18:31:23.158078] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-17T18:31:23.539530] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-17T18:31:23.958032] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-17T18:31:24.536267] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:31:24.758061] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-17T18:31:25.558012] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-17T18:31:25.630358] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T18:31:26.358027] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-17T18:31:27.023754] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-17T18:31:27.158082] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-17T18:31:27.356043] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:31:27.958370] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-17T18:31:27.961493] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T18:31:27.963123] [INFO ] [REMOTE ] DTG: Full fetch complete (8648 records). [2025-10-17T18:31:27.963228] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-17T18:31:28.312779] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-17T18:31:28.312858] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-17T18:31:28.313095] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-17T18:31:28.313134] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-17T18:31:28.313607] [DEBUG] [LOCAL ] DTG: Trimmed 8648 records to 5859 (keeping 200 days of data) [2025-10-17T18:31:28.349329] [DEBUG] [LOCAL ] DTG: Primary data saved (5859 records). [2025-10-17T18:31:28.349456] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-17T18:31:28.349530] [INFO ] [MAIN ] Update Progress: 661/2368 symbols completed. DTG took 27.1s. Estimated remaining: 3h 56m 3s. Rate: 7.2 symbols/min [2025-10-17T18:31:28.517611] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:28.570330] [DEBUG] [LOCAL ] DUK: Loaded 53827 existing records from primary storage. [2025-10-17T18:31:28.570682] [INFO ] [MAIN ] DUK: Loaded 53827 existing records. [2025-10-17T18:31:28.750217] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:28.750522] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-17T18:31:28.750587] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-17T18:31:28.750888] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-17T18:31:28.750948] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-17T18:31:28.763682] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-17T18:31:28.886480] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:31:28.947498] [INFO ] [REMOTE ] DTE: Full fetch complete (68961 records). [2025-10-17T18:31:28.978426] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-17T18:31:29.313579] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:29.535221] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-17T18:31:29.535302] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-17T18:31:29.536100] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-17T18:31:29.536163] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-17T18:31:29.537522] [DEBUG] [LOCAL ] DTE: Trimmed 68961 records to 48020 (keeping 200 days of data) [2025-10-17T18:31:29.595300] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-17T18:31:29.837772] [DEBUG] [LOCAL ] DTE: Primary data saved (48020 records). [2025-10-17T18:31:29.837900] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-17T18:31:29.839093] [INFO ] [MAIN ] Update Progress: 662/2368 symbols completed. DTE took 54.4s. Estimated remaining: 3h 55m 37s. Rate: 7.2 symbols/min [2025-10-17T18:31:30.003448] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:30.012826] [DEBUG] [LOCAL ] DUKB: Loaded 6305 existing records from primary storage. [2025-10-17T18:31:30.013048] [INFO ] [MAIN ] DUKB: Loaded 6305 existing records. [2025-10-17T18:31:30.195620] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:30.195973] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-17T18:31:30.196042] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-17T18:31:30.196223] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-17T18:31:30.196280] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-17T18:31:30.311393] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T18:31:30.360394] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-17T18:31:30.575068] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:30.665690] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:31:31.121956] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T18:31:31.158004] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-17T18:31:31.758752] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:31:31.958030] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-17T18:31:32.557548] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T18:31:32.558684] [INFO ] [REMOTE ] DTW: Full fetch complete (7132 records). [2025-10-17T18:31:32.558756] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-17T18:31:32.763125] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-17T18:31:32.922250] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-17T18:31:32.922330] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-17T18:31:32.922525] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-17T18:31:32.922565] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-17T18:31:32.922979] [DEBUG] [LOCAL ] DTW: Trimmed 7132 records to 4872 (keeping 200 days of data) [2025-10-17T18:31:32.951785] [DEBUG] [LOCAL ] DTW: Primary data saved (4872 records). [2025-10-17T18:31:32.951903] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-17T18:31:32.951987] [INFO ] [MAIN ] Update Progress: 663/2368 symbols completed. DTW took 23.2s. Estimated remaining: 3h 55m 16s. Rate: 7.2 symbols/min [2025-10-17T18:31:33.122691] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:33.178230] [DEBUG] [LOCAL ] DV: Loaded 51681 existing records from primary storage. [2025-10-17T18:31:33.178670] [INFO ] [MAIN ] DV: Loaded 51681 existing records. [2025-10-17T18:31:33.356003] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:33.356206] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-17T18:31:33.356255] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-17T18:31:33.356450] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-17T18:31:33.356519] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-17T18:31:33.563104] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-17T18:31:33.710031] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:34.357990] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-17T18:31:34.515962] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T18:31:34.813846] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:31:35.158057] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-17T18:31:35.963202] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-17T18:31:35.977390] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:31:36.682598] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T18:31:36.758003] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-17T18:31:36.826817] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:31:37.558024] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-17T18:31:38.279192] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T18:31:38.357995] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-17T18:31:39.158036] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-17T18:31:39.447570] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T18:31:39.830071] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T18:31:39.950695] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:31:39.959796] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-17T18:31:40.648226] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T18:31:40.758014] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-17T18:31:41.558036] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-17T18:31:42.349954] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:31:42.359167] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-17T18:31:43.110009] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T18:31:43.157984] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-17T18:31:43.221058] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T18:31:43.832610] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T18:31:43.957994] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-17T18:31:44.758001] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-17T18:31:44.775849] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T18:31:45.558129] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-17T18:31:46.358113] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-17T18:31:46.667694] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T18:31:47.158008] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-17T18:31:47.269882] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T18:31:47.958047] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-17T18:31:48.410133] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T18:31:48.757996] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-17T18:31:49.295989] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T18:31:49.558004] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-17T18:31:49.699499] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T18:31:49.705771] [INFO ] [REMOTE ] DTM: Full fetch complete (65068 records). [2025-10-17T18:31:49.705881] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-17T18:31:50.100564] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-17T18:31:50.100664] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-17T18:31:50.101457] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-17T18:31:50.101500] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-17T18:31:50.102713] [DEBUG] [LOCAL ] DTM: Trimmed 65068 records to 44538 (keeping 200 days of data) [2025-10-17T18:31:50.365366] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-17T18:31:50.381429] [DEBUG] [LOCAL ] DTM: Primary data saved (44538 records). [2025-10-17T18:31:50.382686] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-17T18:31:50.383255] [INFO ] [MAIN ] Update Progress: 664/2368 symbols completed. DTM took 42.7s. Estimated remaining: 3h 55m 31s. Rate: 7.2 symbols/min [2025-10-17T18:31:50.554939] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:50.586194] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:31:50.635761] [DEBUG] [LOCAL ] DVA: Loaded 41337 existing records from primary storage. [2025-10-17T18:31:50.636079] [INFO ] [MAIN ] DVA: Loaded 41337 existing records. [2025-10-17T18:31:50.812758] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:50.812994] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-17T18:31:50.813045] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-17T18:31:50.813319] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-17T18:31:50.813359] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-17T18:31:51.180835] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:51.171286] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-17T18:31:51.183792] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T18:31:51.583623] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T18:31:51.958046] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-17T18:31:52.758318] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-17T18:31:52.758245] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T18:31:53.355840] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:31:53.558051] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-17T18:31:53.944165] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:31:54.358011] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-17T18:31:55.111886] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T18:31:55.158030] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-17T18:31:55.263433] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:31:55.958030] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-17T18:31:56.758030] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-17T18:31:56.826355] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T18:31:57.426786] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T18:31:57.428045] [INFO ] [REMOTE ] DUKB: Full fetch complete (9161 records). [2025-10-17T18:31:57.428121] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-17T18:31:57.565529] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-17T18:31:57.796173] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-17T18:31:57.796321] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-17T18:31:57.796701] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-17T18:31:57.796783] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-17T18:31:57.797471] [DEBUG] [LOCAL ] DUKB: Trimmed 9161 records to 6333 (keeping 200 days of data) [2025-10-17T18:31:57.835061] [DEBUG] [LOCAL ] DUKB: Primary data saved (6333 records). [2025-10-17T18:31:57.835145] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-17T18:31:57.835218] [INFO ] [MAIN ] Update Progress: 665/2368 symbols completed. DUKB took 28.0s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-17T18:31:58.005377] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:58.035918] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T18:31:58.093344] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-17T18:31:58.093677] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-10-17T18:31:58.266831] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:58.267020] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-17T18:31:58.267068] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-17T18:31:58.267581] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-17T18:31:58.267636] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-17T18:31:58.363200] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-17T18:31:58.620082] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:59.166874] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-17T18:31:59.169506] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:31:59.958025] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-17T18:32:00.088898] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:32:00.758091] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-17T18:32:01.318726] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-17T18:32:01.558039] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-17T18:32:02.343014] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-17T18:32:02.357994] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-17T18:32:02.894185] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-17T18:32:03.158027] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-17T18:32:03.450270] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T18:32:03.958062] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-17T18:32:04.072479] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T18:32:04.758077] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-17T18:32:05.150850] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:32:05.558039] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-17T18:32:05.707954] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:32:06.357979] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-17T18:32:06.419915] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T18:32:06.427544] [INFO ] [REMOTE ] DUK: Full fetch complete (77568 records). [2025-10-17T18:32:06.427744] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-17T18:32:06.561041] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:32:06.861503] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-17T18:32:06.861631] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-17T18:32:06.862560] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-17T18:32:06.862610] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-17T18:32:06.864188] [DEBUG] [LOCAL ] DUK: Trimmed 77568 records to 54217 (keeping 200 days of data) [2025-10-17T18:32:07.175073] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-17T18:32:07.212570] [DEBUG] [LOCAL ] DUK: Primary data saved (54217 records). [2025-10-17T18:32:07.212743] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-17T18:32:07.212846] [INFO ] [MAIN ] Update Progress: 666/2368 symbols completed. DUK took 38.9s. Estimated remaining: 3h 55m 15s. Rate: 7.2 symbols/min [2025-10-17T18:32:07.400621] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:07.400801] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-17T18:32:07.400842] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-17T18:32:07.400964] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-17T18:32:07.401005] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-17T18:32:07.401046] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-17T18:32:07.401078] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-17T18:32:07.748002] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:07.958012] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-17T18:32:08.180222] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T18:32:08.756904] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:32:08.765472] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-17T18:32:09.558003] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-17T18:32:09.855439] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T18:32:10.358041] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-17T18:32:10.439070] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:32:11.125873] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T18:32:11.157984] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-17T18:32:11.958014] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-17T18:32:12.558944] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T18:32:12.635802] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T18:32:12.758025] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-17T18:32:13.471615] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T18:32:13.558013] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-17T18:32:14.237869] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:32:14.358031] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-17T18:32:15.158091] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-17T18:32:15.457510] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T18:32:15.958036] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-17T18:32:16.189426] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T18:32:16.758004] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-17T18:32:17.173441] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-17T18:32:17.558060] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-17T18:32:18.034570] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T18:32:18.358017] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-17T18:32:18.653467] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:32:19.158002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-17T18:32:19.422516] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:32:19.429919] [INFO ] [REMOTE ] DV: Full fetch complete (73864 records). [2025-10-17T18:32:19.430043] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-17T18:32:19.827864] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-17T18:32:19.827945] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-17T18:32:19.828911] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-17T18:32:19.828975] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-17T18:32:19.830439] [DEBUG] [LOCAL ] DV: Trimmed 73864 records to 52038 (keeping 200 days of data) [2025-10-17T18:32:19.996936] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-17T18:32:20.144475] [DEBUG] [LOCAL ] DV: Primary data saved (52038 records). [2025-10-17T18:32:20.144624] [INFO ] [MAIN ] DV: Full history saved. [2025-10-17T18:32:20.144749] [INFO ] [MAIN ] Update Progress: 667/2368 symbols completed. DV took 47.2s. Estimated remaining: 3h 55m 19s. Rate: 7.2 symbols/min [2025-10-17T18:32:20.319735] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:20.374636] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T18:32:20.401018] [DEBUG] [LOCAL ] DXC: Loaded 50260 existing records from primary storage. [2025-10-17T18:32:20.401322] [INFO ] [MAIN ] DXC: Loaded 50260 existing records. [2025-10-17T18:32:20.582363] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:20.582599] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-17T18:32:20.582686] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-17T18:32:20.583018] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-17T18:32:20.583088] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-17T18:32:20.773240] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-17T18:32:20.987328] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:20.989421] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T18:32:21.558085] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-17T18:32:22.118499] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-17T18:32:22.358037] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-17T18:32:23.095080] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-17T18:32:23.158067] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-17T18:32:23.192799] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:32:23.860068] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:32:23.958141] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-17T18:32:24.758044] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-17T18:32:25.398243] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T18:32:25.403837] [INFO ] [REMOTE ] DVA: Full fetch complete (59722 records). [2025-10-17T18:32:25.403951] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-17T18:32:25.564765] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-17T18:32:25.781300] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-17T18:32:25.781386] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-17T18:32:25.782148] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-17T18:32:25.782212] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-17T18:32:25.783378] [DEBUG] [LOCAL ] DVA: Trimmed 59722 records to 41554 (keeping 200 days of data) [2025-10-17T18:32:26.032023] [DEBUG] [LOCAL ] DVA: Primary data saved (41554 records). [2025-10-17T18:32:26.032208] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-17T18:32:26.033055] [INFO ] [MAIN ] Update Progress: 668/2368 symbols completed. DVA took 35.6s. Estimated remaining: 3h 55m 4s. Rate: 7.2 symbols/min [2025-10-17T18:32:26.225525] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:26.268817] [DEBUG] [LOCAL ] DXYZ: Loaded 37483 existing records from primary storage. [2025-10-17T18:32:26.269385] [INFO ] [MAIN ] DXYZ: Loaded 37483 existing records. [2025-10-17T18:32:26.379428] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:32:26.420809] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-17T18:32:26.508320] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:26.508544] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-17T18:32:26.508593] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-17T18:32:26.508969] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-17T18:32:26.509038] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-17T18:32:26.863858] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:27.158052] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-17T18:32:27.518805] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T18:32:27.922986] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:32:27.958023] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-17T18:32:28.712270] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (5.55 seconds). [2025-10-17T18:32:28.757997] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-17T18:32:29.511052] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T18:32:29.571630] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-17T18:32:29.576851] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-17T18:32:30.358009] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-17T18:32:30.670436] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T18:32:30.738940] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:32:31.158036] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-17T18:32:31.958060] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-17T18:32:32.625752] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-17T18:32:32.758010] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-17T18:32:33.295226] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T18:32:33.558052] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-17T18:32:34.193457] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T18:32:34.358032] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-17T18:32:34.569193] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:32:35.158006] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-17T18:32:35.296676] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T18:32:35.303806] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-17T18:32:35.304014] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-17T18:32:35.305012] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:32:35.305100] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:32:35.305144] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:32:35.305185] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-17T18:32:35.305243] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-17T18:32:35.305282] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-17T18:32:35.305426] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-17T18:32:35.305979] [INFO ] [MAIN ] Update Progress: 669/2368 symbols completed. DVN took 37.5s. Estimated remaining: 3h 54m 58s. Rate: 7.2 symbols/min [2025-10-17T18:32:35.481696] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:35.514814] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:32:35.549048] [DEBUG] [LOCAL ] DY: Loaded 28641 existing records from primary storage. [2025-10-17T18:32:35.549302] [INFO ] [MAIN ] DY: Loaded 28641 existing records. [2025-10-17T18:32:35.721635] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:35.721868] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-17T18:32:35.721923] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-17T18:32:35.722248] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-17T18:32:35.722286] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-17T18:32:35.966848] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-17T18:32:36.069141] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:36.758041] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-17T18:32:37.085668] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T18:32:37.558038] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-17T18:32:38.061358] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-17T18:32:38.358071] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-17T18:32:38.521720] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T18:32:39.157997] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-17T18:32:39.253668] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:32:39.958015] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-17T18:32:40.252950] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:32:40.507167] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:32:40.758044] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-17T18:32:41.557998] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-17T18:32:41.970587] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T18:32:42.358051] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-17T18:32:42.462077] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:32:42.527266] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:32:43.158018] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-17T18:32:43.958034] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-17T18:32:44.344748] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T18:32:44.758063] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-17T18:32:45.054979] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:32:45.558035] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-17T18:32:46.367076] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-17T18:32:46.370076] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-17T18:32:46.380367] [INFO ] [REMOTE ] DX: Full fetch complete (75837 records). [2025-10-17T18:32:46.380542] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-17T18:32:46.771131] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-17T18:32:46.771211] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-17T18:32:46.772091] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-17T18:32:46.772156] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-17T18:32:46.773550] [DEBUG] [LOCAL ] DX: Trimmed 75837 records to 53271 (keeping 200 days of data) [2025-10-17T18:32:47.101940] [DEBUG] [LOCAL ] DX: Primary data saved (53271 records). [2025-10-17T18:32:47.102133] [INFO ] [MAIN ] DX: Full history saved. [2025-10-17T18:32:47.102237] [INFO ] [MAIN ] Update Progress: 670/2368 symbols completed. DX took 39.9s. Estimated remaining: 3h 54m 59s. Rate: 7.2 symbols/min [2025-10-17T18:32:47.271150] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:47.303166] [DEBUG] [LOCAL ] E: Loaded 33514 existing records from primary storage. [2025-10-17T18:32:47.303443] [INFO ] [MAIN ] E: Loaded 33514 existing records. [2025-10-17T18:32:47.478062] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:47.478394] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-17T18:32:47.478567] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-17T18:32:47.478896] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-17T18:32:47.478969] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-17T18:32:47.624445] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-17T18:32:47.688804] [INFO ] [REMOTE ] DXC: Full fetch complete (70142 records). [2025-10-17T18:32:47.739993] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-17T18:32:48.010446] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:48.016675] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-17T18:32:48.348551] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-17T18:32:48.348694] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-17T18:32:48.349898] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-17T18:32:48.349983] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-17T18:32:48.352439] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (3.59 seconds). [2025-10-17T18:32:48.360831] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-17T18:32:48.362914] [DEBUG] [LOCAL ] DXC: Trimmed 70142 records to 50621 (keeping 200 days of data) [2025-10-17T18:32:48.655762] [DEBUG] [LOCAL ] DXC: Primary data saved (50621 records). [2025-10-17T18:32:48.655893] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-17T18:32:48.655996] [INFO ] [MAIN ] Update Progress: 671/2368 symbols completed. DXC took 28.5s. Estimated remaining: 3h 54m 34s. Rate: 7.2 symbols/min [2025-10-17T18:32:48.821196] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:48.860680] [DEBUG] [LOCAL ] EAF: Loaded 41935 existing records from primary storage. [2025-10-17T18:32:48.860986] [INFO ] [MAIN ] EAF: Loaded 41935 existing records. [2025-10-17T18:32:49.035618] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:49.035840] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-17T18:32:49.035889] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-17T18:32:49.036087] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-17T18:32:49.036151] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-17T18:32:49.389158] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:49.389567] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-17T18:32:49.546218] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T18:32:49.557972] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-17T18:32:50.517979] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (4.15 seconds). [2025-10-17T18:32:50.526277] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-17T18:32:51.239502] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T18:32:51.254448] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-17T18:32:51.517043] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-10-17T18:32:51.958052] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-17T18:32:52.463177] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-10-17T18:32:52.501091] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:32:52.758069] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-17T18:32:53.402387] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T18:32:53.514406] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-17T18:32:53.558007] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-17T18:32:53.783008] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T18:32:54.358102] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-17T18:32:55.128120] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:32:55.157983] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-17T18:32:55.805205] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T18:32:55.958060] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-17T18:32:56.752298] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T18:32:56.762001] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-17T18:32:57.082992] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T18:32:57.558028] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-17T18:32:58.358047] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-17T18:32:58.731083] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T18:32:58.819056] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T18:32:59.158027] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-17T18:32:59.925315] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T18:32:59.958075] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-17T18:33:00.563312] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T18:33:00.758057] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-17T18:33:01.558041] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-17T18:33:01.827149] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:33:02.358066] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-17T18:33:02.978185] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T18:33:03.158040] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-17T18:33:03.192082] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:33:03.785505] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:33:03.958065] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-17T18:33:04.758062] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-17T18:33:05.130475] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:33:05.385678] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:33:05.558023] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-17T18:33:06.173772] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:33:06.358004] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-17T18:33:06.921241] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:33:06.924913] [INFO ] [REMOTE ] DY: Full fetch complete (43488 records). [2025-10-17T18:33:06.925003] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-17T18:33:07.168273] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-17T18:33:07.312688] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-17T18:33:07.312804] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-17T18:33:07.313471] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-17T18:33:07.313533] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-17T18:33:07.314507] [DEBUG] [LOCAL ] DY: Trimmed 43488 records to 28800 (keeping 200 days of data) [2025-10-17T18:33:07.493700] [DEBUG] [LOCAL ] DY: Primary data saved (28800 records). [2025-10-17T18:33:07.493862] [INFO ] [MAIN ] DY: Full history saved. [2025-10-17T18:33:07.493952] [INFO ] [MAIN ] Update Progress: 672/2368 symbols completed. DY took 32.2s. Estimated remaining: 3h 54m 52s. Rate: 7.2 symbols/min [2025-10-17T18:33:07.668758] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:07.675128] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-17T18:33:07.675312] [INFO ] [MAIN ] EAI: Loaded 3998 existing records. [2025-10-17T18:33:07.853208] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:33:07.853559] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-17T18:33:07.853672] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-17T18:33:07.853876] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-17T18:33:07.853999] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-17T18:33:07.959108] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-17T18:33:08.169001] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T18:33:08.265270] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:08.758033] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-17T18:33:09.515889] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T18:33:09.560333] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-17T18:33:09.564177] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T18:33:09.586124] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-17T18:33:09.592561] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57163 records). [2025-10-17T18:33:09.592824] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-17T18:33:10.000455] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-17T18:33:10.000576] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-17T18:33:10.001479] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-17T18:33:10.001546] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-17T18:33:10.002909] [DEBUG] [LOCAL ] DXYZ: Trimmed 57163 records to 37760 (keeping 200 days of data) [2025-10-17T18:33:10.237110] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37760 records). [2025-10-17T18:33:10.237252] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-17T18:33:10.237340] [INFO ] [MAIN ] Update Progress: 673/2368 symbols completed. DXYZ took 44.2s. Estimated remaining: 3h 54m 30s. Rate: 7.2 symbols/min [2025-10-17T18:33:10.399532] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-17T18:33:10.481579] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:10.511633] [DEBUG] [LOCAL ] EARN: Loaded 28794 existing records from primary storage. [2025-10-17T18:33:10.511967] [INFO ] [MAIN ] EARN: Loaded 28794 existing records. [2025-10-17T18:33:10.712450] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:33:10.712721] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-17T18:33:10.712784] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-17T18:33:10.713084] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-17T18:33:10.713155] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-17T18:33:11.096226] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:11.157997] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-17T18:33:11.912621] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:33:11.957984] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-17T18:33:12.094432] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-17T18:33:12.147941] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T18:33:12.758041] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-17T18:33:13.318181] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T18:33:13.558026] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-17T18:33:14.327295] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T18:33:14.357996] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-17T18:33:15.015028] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:33:15.019934] [INFO ] [REMOTE ] E: Full fetch complete (47814 records). [2025-10-17T18:33:15.020053] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-17T18:33:15.164584] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-17T18:33:15.402817] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-17T18:33:15.402913] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-17T18:33:15.403699] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-17T18:33:15.403884] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-17T18:33:15.423745] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T18:33:15.431363] [DEBUG] [LOCAL ] E: Trimmed 47814 records to 33728 (keeping 200 days of data) [2025-10-17T18:33:15.640972] [DEBUG] [LOCAL ] E: Primary data saved (33728 records). [2025-10-17T18:33:15.641123] [INFO ] [MAIN ] E: Full history saved. [2025-10-17T18:33:15.641214] [INFO ] [MAIN ] Update Progress: 674/2368 symbols completed. E took 28.5s. Estimated remaining: 3h 54m 14s. Rate: 7.2 symbols/min [2025-10-17T18:33:15.804354] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:15.849582] [DEBUG] [LOCAL ] EAT: Loaded 50215 existing records from primary storage. [2025-10-17T18:33:15.849946] [INFO ] [MAIN ] EAT: Loaded 50215 existing records. [2025-10-17T18:33:15.963123] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-17T18:33:16.027154] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:33:16.027328] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-17T18:33:16.027401] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-17T18:33:16.027590] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-17T18:33:16.027629] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-17T18:33:16.373207] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:16.468562] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T18:33:16.758021] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-17T18:33:17.182203] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:33:17.310592] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T18:33:17.558016] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-17T18:33:18.358092] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-17T18:33:19.134033] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T18:33:19.157998] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-17T18:33:19.160304] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:33:19.853423] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T18:33:19.958078] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-17T18:33:20.431407] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T18:33:20.758055] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-17T18:33:21.558029] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-17T18:33:22.219115] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:33:22.358049] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-17T18:33:22.596391] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T18:33:23.158004] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-17T18:33:23.644279] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:33:23.794909] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T18:33:23.958099] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-17T18:33:24.758038] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-17T18:33:25.557993] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-17T18:33:25.721142] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T18:33:25.725351] [INFO ] [REMOTE ] EAF: Full fetch complete (62295 records). [2025-10-17T18:33:25.725447] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-17T18:33:25.726176] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:33:25.726261] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:33:25.726305] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:33:25.726375] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-17T18:33:25.726455] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-17T18:33:25.726521] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-17T18:33:25.726711] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-10-17T18:33:25.726801] [INFO ] [MAIN ] Update Progress: 675/2368 symbols completed. EAF took 37.1s. Estimated remaining: 3h 54m 10s. Rate: 7.2 symbols/min [2025-10-17T18:33:25.894279] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:25.894447] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-17T18:33:25.894488] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-17T18:33:25.894605] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-17T18:33:25.894680] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-17T18:33:25.894747] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-17T18:33:25.894784] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-17T18:33:26.244992] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:26.358018] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-17T18:33:26.419132] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:33:27.163153] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-17T18:33:27.176360] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:33:27.745301] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T18:33:27.963196] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-17T18:33:27.980372] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:33:28.758028] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-17T18:33:29.023066] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T18:33:29.337551] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T18:33:29.558029] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-17T18:33:30.358063] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-17T18:33:31.078241] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:33:31.158008] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-17T18:33:31.567711] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:33:31.958092] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-17T18:33:32.758011] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-17T18:33:33.117459] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T18:33:33.178405] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T18:33:33.558063] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-17T18:33:33.968630] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:33:34.358051] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-17T18:33:34.614522] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:33:35.158080] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-17T18:33:35.171925] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T18:33:35.173133] [INFO ] [REMOTE ] EAI: Full fetch complete (5981 records). [2025-10-17T18:33:35.173202] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-17T18:33:35.517009] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-17T18:33:35.517088] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-17T18:33:35.517233] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-17T18:33:35.517270] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-17T18:33:35.517677] [DEBUG] [LOCAL ] EAI: Trimmed 5981 records to 4014 (keeping 200 days of data) [2025-10-17T18:33:35.541403] [DEBUG] [LOCAL ] EAI: Primary data saved (4014 records). [2025-10-17T18:33:35.541470] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-17T18:33:35.541541] [INFO ] [MAIN ] Update Progress: 676/2368 symbols completed. EAI took 28.0s. Estimated remaining: 3h 54m 6s. Rate: 7.2 symbols/min [2025-10-17T18:33:35.703742] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:35.703873] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-17T18:33:35.703910] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-17T18:33:35.704014] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-17T18:33:35.704055] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-17T18:33:35.704094] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-17T18:33:35.704126] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-17T18:33:35.964133] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-17T18:33:36.054813] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:36.758010] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-17T18:33:37.028282] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:33:37.368269] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:33:37.558000] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-17T18:33:38.006478] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T18:33:38.358045] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-17T18:33:38.650187] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:33:39.158125] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-17T18:33:39.590540] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T18:33:39.596679] [INFO ] [REMOTE ] EARN: Full fetch complete (45452 records). [2025-10-17T18:33:39.596803] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-17T18:33:39.972051] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-17T18:33:39.974738] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-17T18:33:39.975496] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-17T18:33:39.976195] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-17T18:33:39.976349] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-17T18:33:39.977396] [DEBUG] [LOCAL ] EARN: Trimmed 45452 records to 28956 (keeping 200 days of data) [2025-10-17T18:33:40.138580] [DEBUG] [LOCAL ] EARN: Primary data saved (28956 records). [2025-10-17T18:33:40.138734] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-17T18:33:40.138821] [INFO ] [MAIN ] Update Progress: 677/2368 symbols completed. EARN took 29.9s. Estimated remaining: 3h 53m 48s. Rate: 7.2 symbols/min [2025-10-17T18:33:40.246823] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:33:40.758064] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-17T18:33:41.558048] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-17T18:33:41.700001] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:33:42.358041] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-17T18:33:42.564607] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:33:42.610895] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T18:33:43.158023] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-17T18:33:43.507059] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:33:43.958010] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-17T18:33:44.264607] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:33:44.758032] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-17T18:33:45.558101] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-17T18:33:45.972527] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T18:33:46.300055] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:33:46.357988] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-17T18:33:47.158015] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-17T18:33:47.194165] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T18:33:47.472689] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:33:47.958100] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-17T18:33:48.757996] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-17T18:33:49.050347] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:33:49.108935] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:33:49.546825] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:33:49.557975] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-17T18:33:50.357998] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-17T18:33:50.649030] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:33:51.158030] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-17T18:33:51.653878] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T18:33:51.958024] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-17T18:33:52.758016] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-17T18:33:52.966196] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T18:33:53.056489] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:33:53.558044] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-17T18:33:54.131675] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:33:54.358035] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-17T18:33:54.564631] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T18:33:55.158032] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-17T18:33:55.728132] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:33:55.957997] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-17T18:33:56.210511] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T18:33:56.213903] [INFO ] [REMOTE ] EBF: Full fetch complete (27964 records). [2025-10-17T18:33:56.213979] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-17T18:33:56.582460] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-17T18:33:56.582541] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-17T18:33:56.583063] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-17T18:33:56.583124] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-17T18:33:56.583820] [DEBUG] [LOCAL ] EBF: Trimmed 27964 records to 19324 (keeping 200 days of data) [2025-10-17T18:33:56.699490] [DEBUG] [LOCAL ] EBF: Primary data saved (19324 records). [2025-10-17T18:33:56.699628] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-17T18:33:56.699741] [INFO ] [MAIN ] Update Progress: 678/2368 symbols completed. EBF took 21.2s. Estimated remaining: 3h 54m 0s. Rate: 7.2 symbols/min [2025-10-17T18:33:56.758050] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-17T18:33:57.223011] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T18:33:57.227723] [INFO ] [REMOTE ] EB: Full fetch complete (55189 records). [2025-10-17T18:33:57.227836] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-17T18:33:57.622412] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-17T18:33:57.622495] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-17T18:33:57.623383] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-17T18:33:57.623450] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-17T18:33:57.624633] [DEBUG] [LOCAL ] EB: Trimmed 55189 records to 36946 (keeping 200 days of data) [2025-10-17T18:33:57.833263] [DEBUG] [LOCAL ] EB: Primary data saved (36946 records). [2025-10-17T18:33:57.833427] [INFO ] [MAIN ] EB: Full history saved. [2025-10-17T18:33:57.833508] [INFO ] [MAIN ] Update Progress: 679/2368 symbols completed. EB took 32.1s. Estimated remaining: 3h 53m 34s. Rate: 7.2 symbols/min [2025-10-17T18:33:59.091584] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-17T18:33:59.103373] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-17T18:34:01.484294] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-17T18:34:01.492230] [INFO ] [REMOTE ] EAT: Full fetch complete (72367 records). [2025-10-17T18:34:01.492465] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-17T18:34:01.924775] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-17T18:34:01.924922] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-17T18:34:01.926190] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-17T18:34:01.926270] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-17T18:34:01.928458] [DEBUG] [LOCAL ] EAT: Trimmed 72367 records to 50582 (keeping 200 days of data) [2025-10-17T18:34:02.253440] [DEBUG] [LOCAL ] EAT: Primary data saved (50582 records). [2025-10-17T18:34:02.253679] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-17T18:34:02.253833] [INFO ] [MAIN ] Update Progress: 680/2368 symbols completed. EAT took 46.6s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-17T18:34:02.866594] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:02.966873] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:02.999137] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:03.029043] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:03.029594] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-17T18:34:03.029770] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-17T18:34:03.029910] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-17T18:34:03.029958] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-17T18:34:03.030009] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-17T18:34:03.030048] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-17T18:34:03.319344] [DEBUG] [LOCAL ] EC: Loaded 49335 existing records from primary storage. [2025-10-17T18:34:03.318702] [DEBUG] [LOCAL ] EBR: Loaded 43627 existing records from primary storage. [2025-10-17T18:34:03.337809] [INFO ] [MAIN ] EC: Loaded 49335 existing records. [2025-10-17T18:34:03.346016] [INFO ] [MAIN ] EBR: Loaded 43627 existing records. [2025-10-17T18:34:03.569589] [DEBUG] [LOCAL ] EBS: Loaded 47095 existing records from primary storage. [2025-10-17T18:34:03.629525] [INFO ] [MAIN ] EBS: Loaded 47095 existing records. [2025-10-17T18:34:03.933334] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:03.941519] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:03.957986] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-17T18:34:03.963352] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-17T18:34:03.985859] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-17T18:34:03.995214] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:03.995573] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-17T18:34:04.007303] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-17T18:34:04.001568] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-17T18:34:04.018045] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-17T18:34:04.058946] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-17T18:34:04.064158] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-17T18:34:04.106412] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:04.182334] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-17T18:34:04.246435] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-17T18:34:04.289703] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-17T18:34:04.334947] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-17T18:34:05.141281] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:05.211170] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-17T18:34:05.259204] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:05.272812] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-17T18:34:05.373667] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:05.374219] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-17T18:34:05.515210] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T18:34:05.520878] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-17T18:34:06.728150] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:34:06.734215] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-17T18:34:06.883544] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T18:34:06.893549] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-17T18:34:07.458231] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T18:34:07.467852] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-17T18:34:07.470123] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-17T18:34:07.480401] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-17T18:34:07.601495] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:34:07.607493] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-17T18:34:08.794191] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T18:34:08.803429] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-17T18:34:08.871304] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T18:34:08.885119] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-17T18:34:08.983869] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:34:08.991362] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-17T18:34:09.086197] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:34:09.096273] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-17T18:34:09.873866] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T18:34:09.879982] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-17T18:34:10.183877] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T18:34:10.357989] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-17T18:34:10.632995] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:34:10.788163] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:34:11.158056] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-17T18:34:11.217453] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:34:11.958013] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-17T18:34:12.037535] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T18:34:12.763175] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-17T18:34:12.781247] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T18:34:13.558056] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-17T18:34:13.648969] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T18:34:14.358040] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-17T18:34:14.560787] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T18:34:14.836871] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:34:15.158043] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-17T18:34:15.958018] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-17T18:34:16.403513] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T18:34:16.758058] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-17T18:34:16.864366] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T18:34:17.253693] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:34:17.558036] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-17T18:34:18.358139] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-17T18:34:18.780607] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T18:34:19.158026] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-17T18:34:19.553583] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T18:34:19.814540] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T18:34:19.958008] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-17T18:34:20.599985] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T18:34:20.757992] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-17T18:34:20.869729] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:34:21.558046] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-17T18:34:22.358070] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-17T18:34:22.552152] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:34:22.762860] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T18:34:23.158077] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-17T18:34:23.958021] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-17T18:34:24.018404] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:34:24.431898] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T18:34:24.435981] [INFO ] [REMOTE ] ECAT: Full fetch complete (42984 records). [2025-10-17T18:34:24.436066] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-17T18:34:24.763226] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-17T18:34:24.810261] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-17T18:34:24.810421] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-17T18:34:24.811095] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-17T18:34:24.811156] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-17T18:34:24.812127] [DEBUG] [LOCAL ] ECAT: Trimmed 42984 records to 29841 (keeping 200 days of data) [2025-10-17T18:34:24.994997] [DEBUG] [LOCAL ] ECAT: Primary data saved (29841 records). [2025-10-17T18:34:24.995134] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-17T18:34:24.995206] [INFO ] [MAIN ] Update Progress: 681/2368 symbols completed. ECAT took 22.7s. Estimated remaining: 3h 53m 44s. Rate: 7.2 symbols/min [2025-10-17T18:34:25.164685] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:25.207367] [DEBUG] [LOCAL ] ECC: Loaded 43644 existing records from primary storage. [2025-10-17T18:34:25.207726] [INFO ] [MAIN ] ECC: Loaded 43644 existing records. [2025-10-17T18:34:25.384929] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:25.385265] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-17T18:34:25.385339] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-17T18:34:25.385736] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-17T18:34:25.385805] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-17T18:34:25.527673] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:34:25.569877] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-17T18:34:25.778000] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:26.358028] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-17T18:34:26.590296] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T18:34:26.764345] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:34:27.158085] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-17T18:34:27.958036] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-17T18:34:28.344926] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T18:34:28.758103] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-17T18:34:29.050126] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:34:29.558015] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-17T18:34:29.866223] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:34:30.340506] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T18:34:30.357986] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-17T18:34:31.158010] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-17T18:34:31.335557] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:34:31.958005] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-17T18:34:32.230934] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:34:32.748741] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:34:32.755480] [INFO ] [REMOTE ] EC: Full fetch complete (71899 records). [2025-10-17T18:34:32.755601] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-17T18:34:32.767689] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-17T18:34:33.150145] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-17T18:34:33.150226] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-17T18:34:33.151121] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-17T18:34:33.151185] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-17T18:34:33.155331] [DEBUG] [LOCAL ] EC: Trimmed 71899 records to 49674 (keeping 200 days of data) [2025-10-17T18:34:33.455298] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:34:33.476966] [DEBUG] [LOCAL ] EC: Primary data saved (49674 records). [2025-10-17T18:34:33.477075] [INFO ] [MAIN ] EC: Full history saved. [2025-10-17T18:34:33.477153] [INFO ] [MAIN ] Update Progress: 682/2368 symbols completed. EC took 31.2s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-17T18:34:33.563219] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-17T18:34:33.659285] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:33.659502] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-17T18:34:33.659580] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-17T18:34:33.659767] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-17T18:34:33.659846] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-17T18:34:33.659945] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-17T18:34:33.660022] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-17T18:34:34.047319] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:34.358079] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-17T18:34:34.492366] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:34:34.887032] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T18:34:35.158097] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-17T18:34:35.283186] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T18:34:35.290023] [INFO ] [REMOTE ] EBS: Full fetch complete (67425 records). [2025-10-17T18:34:35.290183] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-17T18:34:35.666948] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-17T18:34:35.667026] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-17T18:34:35.667864] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-17T18:34:35.667928] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-17T18:34:35.669164] [DEBUG] [LOCAL ] EBS: Trimmed 67425 records to 47428 (keeping 200 days of data) [2025-10-17T18:34:35.932997] [DEBUG] [LOCAL ] EBS: Primary data saved (47428 records). [2025-10-17T18:34:35.933125] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-17T18:34:35.933251] [INFO ] [MAIN ] Update Progress: 683/2368 symbols completed. EBS took 33.7s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-17T18:34:35.963316] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-17T18:34:36.102838] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:36.103007] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-17T18:34:36.103045] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-17T18:34:36.103157] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-17T18:34:36.103197] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-17T18:34:36.103237] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-17T18:34:36.103269] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-17T18:34:36.449241] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:36.758031] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-17T18:34:37.070279] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:34:37.243634] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T18:34:37.558006] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-17T18:34:37.766868] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:34:38.358034] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-17T18:34:39.158013] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-17T18:34:39.489566] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:34:39.724791] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T18:34:39.958004] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-17T18:34:39.980997] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T18:34:39.988029] [INFO ] [REMOTE ] EBR: Full fetch complete (62557 records). [2025-10-17T18:34:39.988184] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-17T18:34:40.377695] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-17T18:34:40.377789] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-17T18:34:40.378693] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-17T18:34:40.378758] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-17T18:34:40.380230] [DEBUG] [LOCAL ] EBR: Trimmed 62557 records to 43964 (keeping 200 days of data) [2025-10-17T18:34:40.633907] [DEBUG] [LOCAL ] EBR: Primary data saved (43964 records). [2025-10-17T18:34:40.634040] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-17T18:34:40.634124] [INFO ] [MAIN ] Update Progress: 684/2368 symbols completed. EBR took 38.4s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-10-17T18:34:40.769955] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-17T18:34:40.804489] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:40.804713] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-17T18:34:40.804765] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-17T18:34:40.804881] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-17T18:34:40.804929] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-17T18:34:40.804971] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-17T18:34:40.805027] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-17T18:34:41.173843] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:41.224272] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T18:34:41.543764] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T18:34:41.558003] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-17T18:34:42.358047] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-17T18:34:42.926474] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T18:34:43.112224] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T18:34:43.157990] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-17T18:34:43.768178] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:34:43.958019] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-17T18:34:44.758092] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-17T18:34:44.863835] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:34:45.558040] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-17T18:34:45.884169] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T18:34:46.358042] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-17T18:34:46.484308] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:34:46.827448] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T18:34:47.158051] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-17T18:34:47.468023] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-17T18:34:47.958020] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-17T18:34:48.758025] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-17T18:34:49.088998] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-17T18:34:49.558045] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-17T18:34:49.717572] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:34:49.976440] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T18:34:50.358060] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-17T18:34:50.705054] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-17T18:34:51.158065] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-17T18:34:51.609308] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-17T18:34:51.958082] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-17T18:34:52.440589] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T18:34:52.758150] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-17T18:34:53.275843] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T18:34:53.558035] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-17T18:34:54.015338] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T18:34:54.358036] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-17T18:34:54.780072] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:34:55.158032] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-17T18:34:55.623751] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-17T18:34:55.958028] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-17T18:34:56.407380] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:34:56.758032] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-17T18:34:57.185940] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T18:34:57.558038] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-17T18:34:58.094134] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T18:34:58.358015] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-17T18:34:58.856170] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T18:34:58.856964] [INFO ] [REMOTE ] ECCU: Full fetch complete (4333 records). [2025-10-17T18:34:58.857081] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-17T18:34:59.169843] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-17T18:34:59.211150] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-17T18:34:59.211231] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-17T18:34:59.211432] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-17T18:34:59.211514] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-17T18:34:59.211936] [DEBUG] [LOCAL ] ECCU: Trimmed 4333 records to 2234 (keeping 200 days of data) [2025-10-17T18:34:59.226511] [DEBUG] [LOCAL ] ECCU: Primary data saved (2234 records). [2025-10-17T18:34:59.226590] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-17T18:34:59.226712] [INFO ] [MAIN ] Update Progress: 685/2368 symbols completed. ECCU took 23.3s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-17T18:34:59.390924] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:59.391090] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-17T18:34:59.391126] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-17T18:34:59.391235] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-17T18:34:59.391289] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-17T18:34:59.391356] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-17T18:34:59.391401] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-17T18:34:59.650775] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T18:34:59.745029] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:59.958037] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-17T18:35:00.436239] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T18:35:00.758057] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-17T18:35:01.400222] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T18:35:01.558030] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-17T18:35:01.971396] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T18:35:02.358027] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-17T18:35:03.069954] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:35:03.158053] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-17T18:35:03.494362] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T18:35:03.958089] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-17T18:35:04.758071] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-17T18:35:05.109504] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-17T18:35:05.558057] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-17T18:35:05.824402] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:35:05.977791] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-17T18:35:06.358062] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-17T18:35:07.048308] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T18:35:07.158030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-17T18:35:07.510682] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-17T18:35:07.958069] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-17T18:35:08.421847] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T18:35:08.422879] [INFO ] [REMOTE ] ECCC: Full fetch complete (1292 records). [2025-10-17T18:35:08.422973] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-17T18:35:08.423539] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:35:08.423712] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:35:08.423803] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:35:08.423899] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-17T18:35:08.423983] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-17T18:35:08.424023] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-17T18:35:08.424063] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-17T18:35:08.424119] [INFO ] [MAIN ] Update Progress: 686/2368 symbols completed. ECCC took 34.9s. Estimated remaining: 3h 53m 7s. Rate: 7.2 symbols/min [2025-10-17T18:35:08.627370] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:08.671187] [DEBUG] [LOCAL ] ECG: Loaded 33440 existing records from primary storage. [2025-10-17T18:35:08.671604] [INFO ] [MAIN ] ECG: Loaded 33440 existing records. [2025-10-17T18:35:08.768689] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-17T18:35:08.929395] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:08.929717] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-17T18:35:08.929790] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-17T18:35:08.930034] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-17T18:35:08.930100] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-17T18:35:09.411236] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:09.558045] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-17T18:35:10.358030] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-17T18:35:10.638861] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:35:10.648195] [INFO ] [REMOTE ] ECC: Full fetch complete (61451 records). [2025-10-17T18:35:10.648373] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-17T18:35:10.941778] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T18:35:10.946775] [INFO ] [REMOTE ] ECCW: Full fetch complete (1421 records). [2025-10-17T18:35:10.952731] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-17T18:35:11.117252] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-17T18:35:11.129861] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-17T18:35:11.148096] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-17T18:35:11.157072] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-17T18:35:11.161114] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-17T18:35:11.228948] [DEBUG] [LOCAL ] ECC: Trimmed 61451 records to 43973 (keeping 200 days of data) [2025-10-17T18:35:11.236861] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T18:35:11.333050] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-17T18:35:11.341817] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:35:11.367557] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:35:11.375186] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-17T18:35:11.375520] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-17T18:35:11.381697] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-17T18:35:11.384186] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-17T18:35:11.384279] [INFO ] [MAIN ] Update Progress: 687/2368 symbols completed. ECCW took 30.8s. Estimated remaining: 3h 52m 45s. Rate: 7.2 symbols/min [2025-10-17T18:35:11.570833] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:11.712859] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T18:35:11.719030] [DEBUG] [LOCAL ] ECL: Loaded 47037 existing records from primary storage. [2025-10-17T18:35:11.723164] [INFO ] [MAIN ] ECL: Loaded 47037 existing records. [2025-10-17T18:35:11.956613] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:11.958707] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-17T18:35:11.960051] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-17T18:35:11.961507] [DEBUG] [LOCAL ] ECC: Primary data saved (43973 records). [2025-10-17T18:35:11.961697] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-17T18:35:11.961615] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-17T18:35:11.962968] [INFO ] [MAIN ] Update Progress: 688/2368 symbols completed. ECC took 47.0s. Estimated remaining: 3h 52m 18s. Rate: 7.2 symbols/min [2025-10-17T18:35:11.974636] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-17T18:35:11.999338] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-17T18:35:12.326419] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:12.534027] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:12.534943] [DEBUG] [LOCAL ] ECO: Loaded 18306 existing records from primary storage. [2025-10-17T18:35:12.535346] [INFO ] [MAIN ] ECO: Loaded 18306 existing records. [2025-10-17T18:35:12.707639] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:12.707828] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-17T18:35:12.707873] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-17T18:35:12.708059] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-17T18:35:12.708114] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-17T18:35:12.768336] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-17T18:35:13.088099] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:13.534287] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T18:35:13.557989] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-17T18:35:14.358035] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-17T18:35:14.495994] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T18:35:14.891255] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T18:35:15.049181] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:35:15.157997] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-17T18:35:15.958037] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-17T18:35:16.758010] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-17T18:35:16.914715] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:35:17.253204] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:35:17.558025] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-17T18:35:17.605081] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T18:35:18.358038] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-17T18:35:18.707848] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:35:19.020013] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T18:35:19.158042] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-17T18:35:19.481803] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-17T18:35:19.958030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-17T18:35:20.377389] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T18:35:20.758052] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-17T18:35:21.558034] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-17T18:35:22.179812] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-17T18:35:22.195344] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:35:22.358023] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-17T18:35:23.158046] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-17T18:35:23.572138] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:35:23.958041] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-17T18:35:24.299149] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-17T18:35:24.758063] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-17T18:35:24.784039] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:35:25.558022] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-17T18:35:26.357994] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-17T18:35:26.657350] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:35:26.759349] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T18:35:26.865208] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T18:35:26.865984] [INFO ] [REMOTE ] ECCX: Full fetch complete (1446 records). [2025-10-17T18:35:26.866061] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-17T18:35:26.866414] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:35:26.866501] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:35:26.866546] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:35:26.866615] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-17T18:35:26.866726] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-17T18:35:26.866780] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-17T18:35:26.866826] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-17T18:35:26.866883] [INFO ] [MAIN ] Update Progress: 689/2368 symbols completed. ECCX took 27.6s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-17T18:35:27.036855] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:27.078663] [DEBUG] [LOCAL ] ECVT: Loaded 43630 existing records from primary storage. [2025-10-17T18:35:27.078977] [INFO ] [MAIN ] ECVT: Loaded 43630 existing records. [2025-10-17T18:35:27.163213] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-17T18:35:27.260914] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:27.261161] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-17T18:35:27.261210] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-17T18:35:27.261485] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-17T18:35:27.261544] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-17T18:35:27.606695] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:27.958081] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-17T18:35:28.469910] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:35:28.758033] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-17T18:35:29.561403] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-17T18:35:29.566203] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:35:30.358053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-17T18:35:30.523618] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:35:30.643023] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:35:31.158059] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-17T18:35:31.958018] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-17T18:35:32.425524] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T18:35:32.525205] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:35:32.757996] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-17T18:35:33.152038] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:35:33.558040] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-17T18:35:33.943441] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:35:34.358046] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-17T18:35:34.979600] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T18:35:35.158035] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-17T18:35:35.423953] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T18:35:35.958030] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-17T18:35:36.758025] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-17T18:35:36.944206] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T18:35:37.558055] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-17T18:35:37.956566] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T18:35:38.275087] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T18:35:38.357996] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-17T18:35:39.095515] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:35:39.158017] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-17T18:35:39.651429] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:35:39.958036] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-17T18:35:40.758016] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-17T18:35:40.787959] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:35:41.558036] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-17T18:35:41.707711] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:35:41.750047] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T18:35:42.358032] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-17T18:35:42.629833] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T18:35:43.158056] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-17T18:35:43.957998] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-17T18:35:44.114927] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:35:44.758046] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-17T18:35:44.813546] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T18:35:44.872018] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:35:45.558071] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-17T18:35:46.268838] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T18:35:46.273357] [INFO ] [REMOTE ] ECG: Full fetch complete (50985 records). [2025-10-17T18:35:46.273466] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-17T18:35:46.363147] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-17T18:35:46.652546] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-17T18:35:46.652637] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-17T18:35:46.653432] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-17T18:35:46.653479] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-17T18:35:46.654598] [DEBUG] [LOCAL ] ECG: Trimmed 50985 records to 33657 (keeping 200 days of data) [2025-10-17T18:35:46.859411] [DEBUG] [LOCAL ] ECG: Primary data saved (33657 records). [2025-10-17T18:35:46.859564] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-17T18:35:46.860283] [INFO ] [MAIN ] Update Progress: 690/2368 symbols completed. ECG took 38.4s. Estimated remaining: 3h 52m 46s. Rate: 7.2 symbols/min [2025-10-17T18:35:47.036213] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:47.064333] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:35:47.121175] [DEBUG] [LOCAL ] ED: Loaded 53052 existing records from primary storage. [2025-10-17T18:35:47.121541] [INFO ] [MAIN ] ED: Loaded 53052 existing records. [2025-10-17T18:35:47.163283] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-17T18:35:47.300154] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:47.300360] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-17T18:35:47.300408] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-17T18:35:47.300622] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-17T18:35:47.300715] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-17T18:35:47.656449] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:47.668065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T18:35:47.958030] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-17T18:35:48.758079] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-17T18:35:49.169299] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T18:35:49.557988] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-17T18:35:49.755405] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:35:49.787390] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:35:49.790169] [INFO ] [REMOTE ] ECO: Full fetch complete (28343 records). [2025-10-17T18:35:49.790244] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-17T18:35:50.151461] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-17T18:35:50.151540] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-17T18:35:50.152083] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-17T18:35:50.152145] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-17T18:35:50.152857] [DEBUG] [LOCAL ] ECO: Trimmed 28343 records to 18402 (keeping 200 days of data) [2025-10-17T18:35:50.262093] [DEBUG] [LOCAL ] ECO: Primary data saved (18402 records). [2025-10-17T18:35:50.262225] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-17T18:35:50.262302] [INFO ] [MAIN ] Update Progress: 691/2368 symbols completed. ECO took 38.3s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-17T18:35:50.360360] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-17T18:35:50.430466] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:50.455807] [DEBUG] [LOCAL ] EDD: Loaded 27000 existing records from primary storage. [2025-10-17T18:35:50.456059] [INFO ] [MAIN ] EDD: Loaded 27000 existing records. [2025-10-17T18:35:50.627261] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:50.627494] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-17T18:35:50.627543] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-17T18:35:50.627801] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-17T18:35:50.627856] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-17T18:35:50.981615] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:51.158053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-17T18:35:51.201016] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:35:51.207476] [INFO ] [REMOTE ] ECVT: Full fetch complete (60377 records). [2025-10-17T18:35:51.207634] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-17T18:35:51.586255] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-17T18:35:51.586332] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-17T18:35:51.587102] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-17T18:35:51.587165] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-17T18:35:51.588460] [DEBUG] [LOCAL ] ECVT: Trimmed 60377 records to 43948 (keeping 200 days of data) [2025-10-17T18:35:51.834774] [DEBUG] [LOCAL ] ECVT: Primary data saved (43948 records). [2025-10-17T18:35:51.834906] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-17T18:35:51.835861] [INFO ] [MAIN ] Update Progress: 692/2368 symbols completed. ECVT took 25.0s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-10-17T18:35:51.970843] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-17T18:35:52.003365] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:52.019531] [DEBUG] [LOCAL ] EDF: Loaded 13171 existing records from primary storage. [2025-10-17T18:35:52.019796] [INFO ] [MAIN ] EDF: Loaded 13171 existing records. [2025-10-17T18:35:52.198635] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:52.198974] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-17T18:35:52.199033] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-17T18:35:52.199234] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-17T18:35:52.199291] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-17T18:35:52.588928] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:52.623147] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-17T18:35:52.725129] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:35:52.758047] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-17T18:35:53.558017] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-17T18:35:53.681068] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:35:54.358000] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-17T18:35:54.469251] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T18:35:55.158066] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-17T18:35:55.286250] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T18:35:55.645610] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:35:55.958053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-17T18:35:56.758014] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-17T18:35:56.892371] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:35:57.384482] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T18:35:57.558029] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-17T18:35:57.764498] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:35:57.771224] [INFO ] [REMOTE ] ECL: Full fetch complete (68342 records). [2025-10-17T18:35:57.771419] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-17T18:35:58.181972] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-17T18:35:58.182061] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-17T18:35:58.182896] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-17T18:35:58.182961] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-17T18:35:58.184273] [DEBUG] [LOCAL ] ECL: Trimmed 68342 records to 47419 (keeping 200 days of data) [2025-10-17T18:35:58.366004] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-17T18:35:58.497974] [DEBUG] [LOCAL ] ECL: Primary data saved (47419 records). [2025-10-17T18:35:58.498101] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-17T18:35:58.498611] [INFO ] [MAIN ] Update Progress: 693/2368 symbols completed. ECL took 47.1s. Estimated remaining: 3h 51m 49s. Rate: 7.2 symbols/min [2025-10-17T18:35:58.659044] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:35:58.688851] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:58.707755] [DEBUG] [LOCAL ] EDN: Loaded 19176 existing records from primary storage. [2025-10-17T18:35:58.708014] [INFO ] [MAIN ] EDN: Loaded 19176 existing records. [2025-10-17T18:35:58.882140] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:58.882353] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-17T18:35:58.882400] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-17T18:35:58.882557] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-17T18:35:58.882596] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-17T18:35:59.163202] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-17T18:35:59.239463] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:59.958016] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-17T18:36:00.003873] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:36:00.167234] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T18:36:00.758051] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-17T18:36:01.558144] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-17T18:36:02.011769] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:36:02.358059] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-17T18:36:02.430598] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:36:03.158003] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-17T18:36:03.249345] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:36:03.818100] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T18:36:03.958026] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-17T18:36:04.758025] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-17T18:36:05.113544] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T18:36:05.194732] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T18:36:05.558038] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-17T18:36:05.713375] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T18:36:06.358009] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-17T18:36:06.612427] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:36:07.158017] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-17T18:36:07.473243] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T18:36:07.958022] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-17T18:36:08.374056] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T18:36:08.758016] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-17T18:36:08.994994] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T18:36:09.558028] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-17T18:36:10.357992] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-17T18:36:10.771992] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T18:36:10.773596] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T18:36:11.158021] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-17T18:36:11.263961] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T18:36:11.958037] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-17T18:36:12.342501] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T18:36:12.457426] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T18:36:12.758061] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-17T18:36:13.558041] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-17T18:36:13.751285] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T18:36:14.358041] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-17T18:36:14.856094] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:36:15.158035] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-17T18:36:15.188627] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T18:36:15.958030] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-17T18:36:16.578986] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T18:36:16.757866] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T18:36:16.758555] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-17T18:36:17.557981] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-17T18:36:17.965942] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T18:36:18.358005] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-17T18:36:18.583264] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T18:36:19.158031] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-17T18:36:19.564959] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T18:36:19.958029] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-17T18:36:20.016412] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T18:36:20.758037] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-17T18:36:21.557996] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-17T18:36:21.694583] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:36:21.824715] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:36:21.826744] [INFO ] [REMOTE ] EDF: Full fetch complete (20441 records). [2025-10-17T18:36:21.826817] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-17T18:36:22.181620] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-17T18:36:22.181726] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-17T18:36:22.182156] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-17T18:36:22.182216] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-17T18:36:22.182806] [DEBUG] [LOCAL ] EDF: Trimmed 20441 records to 13279 (keeping 200 days of data) [2025-10-17T18:36:22.257776] [DEBUG] [LOCAL ] EDF: Primary data saved (13279 records). [2025-10-17T18:36:22.257911] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-17T18:36:22.257994] [INFO ] [MAIN ] Update Progress: 694/2368 symbols completed. EDF took 30.4s. Estimated remaining: 3h 52m 18s. Rate: 7.2 symbols/min [2025-10-17T18:36:22.359485] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-17T18:36:22.433940] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:22.473994] [DEBUG] [LOCAL ] EDU: Loaded 45172 existing records from primary storage. [2025-10-17T18:36:22.474339] [INFO ] [MAIN ] EDU: Loaded 45172 existing records. [2025-10-17T18:36:22.653598] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:36:22.653975] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-17T18:36:22.654070] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-17T18:36:22.654368] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-17T18:36:22.654422] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-17T18:36:22.766449] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T18:36:22.814672] [INFO ] [REMOTE ] EDD: Full fetch complete (38458 records). [2025-10-17T18:36:22.825376] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-17T18:36:22.892482] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:36:22.931891] [FATAL] [MAIN ] EDD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:36:22.954722] [WARN ] [MAIN ] EDD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:36:22.954856] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-17T18:36:22.954934] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-17T18:36:22.954974] [INFO ] [LOCAL ] EDD: Starting deletion of derivative data. [2025-10-17T18:36:22.965876] [DEBUG] [LOCAL ] EDD: Deleted derivative data file. [2025-10-17T18:36:22.976292] [INFO ] [MAIN ] Update Progress: 695/2368 symbols completed. EDD took 32.7s. Estimated remaining: 3h 51m 51s. Rate: 7.2 symbols/min [2025-10-17T18:36:23.094217] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:23.166282] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-17T18:36:23.236116] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:23.236537] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-17T18:36:23.236584] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-17T18:36:23.236717] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-17T18:36:23.236764] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-17T18:36:23.236809] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-17T18:36:23.236840] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-17T18:36:23.506869] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T18:36:23.607070] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:23.958024] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-17T18:36:24.758016] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-17T18:36:25.075745] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T18:36:25.118801] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T18:36:25.558030] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-17T18:36:26.358087] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-17T18:36:26.647599] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:36:27.081531] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:36:27.157994] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-17T18:36:27.673474] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T18:36:27.677276] [INFO ] [REMOTE ] EDN: Full fetch complete (30059 records). [2025-10-17T18:36:27.677371] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-17T18:36:27.963133] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-17T18:36:28.040512] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-17T18:36:28.040598] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-17T18:36:28.041152] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-17T18:36:28.041216] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-17T18:36:28.041955] [DEBUG] [LOCAL ] EDN: Trimmed 30059 records to 19338 (keeping 200 days of data) [2025-10-17T18:36:28.153185] [DEBUG] [LOCAL ] EDN: Primary data saved (19338 records). [2025-10-17T18:36:28.153334] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-17T18:36:28.153422] [INFO ] [MAIN ] Update Progress: 696/2368 symbols completed. EDN took 29.7s. Estimated remaining: 3h 51m 35s. Rate: 7.2 symbols/min [2025-10-17T18:36:28.323947] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:28.324232] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-17T18:36:28.324338] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-17T18:36:28.324544] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-17T18:36:28.324758] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-17T18:36:28.338133] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T18:36:28.337721] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-17T18:36:28.342878] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-17T18:36:28.735967] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:28.757988] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-17T18:36:29.465287] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T18:36:29.558025] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-17T18:36:29.729862] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:36:30.358046] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-17T18:36:30.654553] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T18:36:31.158026] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-17T18:36:31.958031] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-17T18:36:32.034823] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:36:32.415029] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T18:36:32.758038] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-17T18:36:33.555416] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T18:36:33.559312] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-17T18:36:34.118343] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T18:36:34.147465] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T18:36:34.358048] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-17T18:36:35.158040] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-17T18:36:35.958000] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-17T18:36:36.268681] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:36:36.647398] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:36:36.758014] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-17T18:36:37.286975] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-17T18:36:37.558006] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-17T18:36:37.798150] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:36:37.805412] [INFO ] [REMOTE ] ED: Full fetch complete (76414 records). [2025-10-17T18:36:37.805559] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-17T18:36:38.194214] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-17T18:36:38.194299] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-17T18:36:38.195303] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-17T18:36:38.195368] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-17T18:36:38.196846] [DEBUG] [LOCAL ] ED: Trimmed 76414 records to 53411 (keeping 200 days of data) [2025-10-17T18:36:38.378501] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-17T18:36:38.537783] [DEBUG] [LOCAL ] ED: Primary data saved (53411 records). [2025-10-17T18:36:38.537925] [INFO ] [MAIN ] ED: Full history saved. [2025-10-17T18:36:38.538525] [INFO ] [MAIN ] Update Progress: 697/2368 symbols completed. ED took 51.7s. Estimated remaining: 3h 51m 32s. Rate: 7.2 symbols/min [2025-10-17T18:36:38.708410] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:38.721560] [DEBUG] [LOCAL ] EEX: Loaded 10294 existing records from primary storage. [2025-10-17T18:36:38.721818] [INFO ] [MAIN ] EEX: Loaded 10294 existing records. [2025-10-17T18:36:38.903031] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:36:38.903280] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-17T18:36:38.903334] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-17T18:36:38.903504] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-17T18:36:38.903560] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-17T18:36:39.084389] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-17T18:36:39.168348] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-17T18:36:39.284276] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:39.316008] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:36:39.763788] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T18:36:39.958061] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-17T18:36:40.479796] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T18:36:40.758057] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-17T18:36:41.558038] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-17T18:36:42.181078] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T18:36:42.358022] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-17T18:36:42.677972] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:36:42.847913] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T18:36:43.158014] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-17T18:36:43.720946] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T18:36:43.958010] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-17T18:36:44.758038] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-17T18:36:45.246632] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T18:36:45.491578] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T18:36:45.558001] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-17T18:36:46.358066] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-17T18:36:47.158036] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-17T18:36:47.213708] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:36:47.639284] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:36:47.958012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-17T18:36:48.120474] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T18:36:48.758046] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-17T18:36:49.456294] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T18:36:49.558016] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-17T18:36:50.358019] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-17T18:36:50.464252] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T18:36:50.958153] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:36:51.158085] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-17T18:36:51.362164] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T18:36:51.721539] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T18:36:51.958034] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-17T18:36:52.409308] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T18:36:52.410127] [INFO ] [REMOTE ] EEA: Full fetch complete (3778 records). [2025-10-17T18:36:52.410195] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-17T18:36:52.588295] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:36:52.588512] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:36:52.588581] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:36:52.588671] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-17T18:36:52.588779] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-17T18:36:52.588835] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-17T18:36:52.588879] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-17T18:36:52.588935] [INFO ] [MAIN ] Update Progress: 698/2368 symbols completed. EEA took 24.4s. Estimated remaining: 3h 51m 38s. Rate: 7.2 symbols/min [2025-10-17T18:36:52.758053] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-17T18:36:52.759555] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:52.805793] [DEBUG] [LOCAL ] EFC: Loaded 46757 existing records from primary storage. [2025-10-17T18:36:52.806116] [INFO ] [MAIN ] EFC: Loaded 46757 existing records. [2025-10-17T18:36:53.003076] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:36:53.003258] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-17T18:36:53.003306] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-17T18:36:53.003683] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-17T18:36:53.003741] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-17T18:36:53.347928] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:53.558031] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-17T18:36:54.142592] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:36:54.358026] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-17T18:36:55.158035] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-17T18:36:55.192095] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T18:36:55.958001] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-17T18:36:56.405254] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:36:56.533930] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:36:56.758072] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-17T18:36:57.558001] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-17T18:36:57.732298] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T18:36:57.773241] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T18:36:58.358083] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-17T18:36:59.153292] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T18:36:59.157975] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-17T18:36:59.181902] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:36:59.958016] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-17T18:37:00.758041] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-17T18:37:01.075260] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:37:01.081836] [INFO ] [REMOTE ] EDU: Full fetch complete (67040 records). [2025-10-17T18:37:01.081953] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-17T18:37:01.291314] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:37:01.499758] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-17T18:37:01.499865] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-17T18:37:01.500721] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-17T18:37:01.500791] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-17T18:37:01.502269] [DEBUG] [LOCAL ] EDU: Trimmed 67040 records to 45507 (keeping 200 days of data) [2025-10-17T18:37:01.564009] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-17T18:37:01.776117] [DEBUG] [LOCAL ] EDU: Primary data saved (45507 records). [2025-10-17T18:37:01.776265] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-17T18:37:01.777171] [INFO ] [MAIN ] Update Progress: 699/2368 symbols completed. EDU took 39.5s. Estimated remaining: 3h 51m 31s. Rate: 7.2 symbols/min [2025-10-17T18:37:01.950051] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:01.969223] [DEBUG] [LOCAL ] EFR: Loaded 15165 existing records from primary storage. [2025-10-17T18:37:01.969474] [INFO ] [MAIN ] EFR: Loaded 15165 existing records. [2025-10-17T18:37:02.158883] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:02.159109] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-17T18:37:02.159192] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-17T18:37:02.159358] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-17T18:37:02.159397] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-17T18:37:02.364527] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-17T18:37:02.464552] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T18:37:02.524097] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:02.639593] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T18:37:03.158004] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-17T18:37:03.928717] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T18:37:03.933672] [INFO ] [REMOTE ] EE: Full fetch complete (44224 records). [2025-10-17T18:37:03.933767] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-17T18:37:03.964206] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-17T18:37:04.315557] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-17T18:37:04.315684] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-17T18:37:04.316417] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-17T18:37:04.316506] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-17T18:37:04.317939] [DEBUG] [LOCAL ] EE: Trimmed 44224 records to 33450 (keeping 200 days of data) [2025-10-17T18:37:04.503140] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:37:04.528730] [DEBUG] [LOCAL ] EE: Primary data saved (33450 records). [2025-10-17T18:37:04.528827] [INFO ] [MAIN ] EE: Full history saved. [2025-10-17T18:37:04.528892] [INFO ] [MAIN ] Update Progress: 700/2368 symbols completed. EE took 41.5s. Estimated remaining: 3h 51m 10s. Rate: 7.2 symbols/min [2025-10-17T18:37:04.692869] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:04.708238] [DEBUG] [LOCAL ] EFT: Loaded 13160 existing records from primary storage. [2025-10-17T18:37:04.708452] [INFO ] [MAIN ] EFT: Loaded 13160 existing records. [2025-10-17T18:37:04.768690] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-17T18:37:04.883303] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:04.883519] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-17T18:37:04.883573] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-17T18:37:04.883837] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-17T18:37:04.883892] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-17T18:37:05.241196] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:05.558038] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-17T18:37:05.657624] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T18:37:05.716072] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:37:06.267380] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:37:06.357994] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-17T18:37:06.880323] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T18:37:07.158025] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-17T18:37:07.958089] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-17T18:37:08.720482] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T18:37:08.757993] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-17T18:37:08.860501] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T18:37:09.558043] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-17T18:37:09.601341] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:37:10.343374] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T18:37:10.345815] [INFO ] [REMOTE ] EEX: Full fetch complete (18546 records). [2025-10-17T18:37:10.345954] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-17T18:37:10.363352] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-17T18:37:10.739465] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-17T18:37:10.739544] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-17T18:37:10.739954] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-17T18:37:10.740014] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-17T18:37:10.740598] [DEBUG] [LOCAL ] EEX: Trimmed 18546 records to 10348 (keeping 200 days of data) [2025-10-17T18:37:10.800738] [DEBUG] [LOCAL ] EEX: Primary data saved (10348 records). [2025-10-17T18:37:10.800896] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-17T18:37:10.800982] [INFO ] [MAIN ] Update Progress: 701/2368 symbols completed. EEX took 32.3s. Estimated remaining: 3h 50m 57s. Rate: 7.2 symbols/min [2025-10-17T18:37:10.968406] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:11.013734] [DEBUG] [LOCAL ] EFX: Loaded 45004 existing records from primary storage. [2025-10-17T18:37:11.014047] [INFO ] [MAIN ] EFX: Loaded 45004 existing records. [2025-10-17T18:37:11.165310] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-17T18:37:11.189258] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:11.189635] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-17T18:37:11.189719] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-17T18:37:11.190018] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-17T18:37:11.190077] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-17T18:37:11.540101] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:11.958023] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-17T18:37:12.053502] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T18:37:12.444683] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T18:37:12.758033] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-17T18:37:13.557997] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-17T18:37:14.110922] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T18:37:14.316391] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:37:14.358001] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-17T18:37:14.439303] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:37:15.158026] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-17T18:37:15.959844] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-17T18:37:15.965147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:37:16.115709] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T18:37:16.758038] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-17T18:37:17.112624] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:37:17.558013] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-17T18:37:17.788837] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T18:37:18.358064] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-17T18:37:19.091549] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T18:37:19.158044] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-17T18:37:19.957997] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-17T18:37:20.023046] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:37:20.758095] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-17T18:37:20.955848] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T18:37:20.991332] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:37:21.546614] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T18:37:21.557980] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-17T18:37:22.358010] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-17T18:37:22.457373] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T18:37:22.982291] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T18:37:23.158005] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-17T18:37:23.958010] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-17T18:37:24.010147] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T18:37:24.758007] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-17T18:37:24.816579] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T18:37:25.558042] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-17T18:37:25.611483] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T18:37:26.358011] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-17T18:37:26.578570] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:37:27.158042] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-17T18:37:27.204519] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T18:37:27.958009] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-17T18:37:28.264765] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T18:37:28.737666] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T18:37:28.740158] [INFO ] [REMOTE ] EFT: Full fetch complete (17955 records). [2025-10-17T18:37:28.740265] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-17T18:37:28.763214] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-17T18:37:29.111804] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-17T18:37:29.111889] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-17T18:37:29.112343] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-17T18:37:29.112386] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-17T18:37:29.112998] [DEBUG] [LOCAL ] EFT: Trimmed 17955 records to 13215 (keeping 200 days of data) [2025-10-17T18:37:29.197597] [DEBUG] [LOCAL ] EFT: Primary data saved (13215 records). [2025-10-17T18:37:29.197766] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-17T18:37:29.197857] [INFO ] [MAIN ] Update Progress: 702/2368 symbols completed. EFT took 24.7s. Estimated remaining: 3h 51m 12s. Rate: 7.2 symbols/min [2025-10-17T18:37:29.372741] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:29.402098] [DEBUG] [LOCAL ] EFXT: Loaded 29940 existing records from primary storage. [2025-10-17T18:37:29.402340] [INFO ] [MAIN ] EFXT: Loaded 29940 existing records. [2025-10-17T18:37:29.572549] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-17T18:37:29.577929] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:29.579199] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-17T18:37:29.579267] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-17T18:37:29.579461] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-17T18:37:29.579514] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-17T18:37:29.940916] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:30.358070] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-17T18:37:30.814460] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T18:37:31.158007] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-17T18:37:31.526375] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T18:37:31.873318] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:37:31.957991] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-17T18:37:32.327615] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T18:37:32.758032] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-17T18:37:33.331333] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:37:33.558057] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-17T18:37:33.841361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T18:37:34.358017] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-17T18:37:34.540377] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T18:37:34.543727] [INFO ] [REMOTE ] EFR: Full fetch complete (19505 records). [2025-10-17T18:37:34.543806] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-17T18:37:34.909339] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-17T18:37:34.909414] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-17T18:37:34.909849] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-17T18:37:34.909910] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-17T18:37:34.910455] [DEBUG] [LOCAL ] EFR: Trimmed 19505 records to 15309 (keeping 200 days of data) [2025-10-17T18:37:35.009132] [DEBUG] [LOCAL ] EFR: Primary data saved (15309 records). [2025-10-17T18:37:35.009302] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-17T18:37:35.009432] [INFO ] [MAIN ] Update Progress: 703/2368 symbols completed. EFR took 33.2s. Estimated remaining: 3h 50m 58s. Rate: 7.2 symbols/min [2025-10-17T18:37:35.170892] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-17T18:37:35.173959] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:35.201129] [DEBUG] [LOCAL ] EG: Loaded 27993 existing records from primary storage. [2025-10-17T18:37:35.201393] [INFO ] [MAIN ] EG: Loaded 27993 existing records. [2025-10-17T18:37:35.374274] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:35.374455] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-17T18:37:35.374502] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-17T18:37:35.374767] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-17T18:37:35.374836] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-17T18:37:35.759481] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:35.957984] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-17T18:37:36.285360] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T18:37:36.758009] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-17T18:37:37.011107] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:37:37.558073] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-17T18:37:37.736376] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:37:37.967254] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:37:38.358083] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-17T18:37:39.022199] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:37:39.158065] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-17T18:37:39.670961] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:37:39.958064] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-17T18:37:40.758042] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-17T18:37:40.936175] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:37:41.282860] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T18:37:41.558010] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-17T18:37:42.028199] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T18:37:42.358034] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-17T18:37:43.114616] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T18:37:43.121342] [INFO ] [REMOTE ] EFX: Full fetch complete (64957 records). [2025-10-17T18:37:43.121492] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-17T18:37:43.167551] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-17T18:37:43.521097] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-17T18:37:43.521190] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-17T18:37:43.522053] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-17T18:37:43.522117] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-17T18:37:43.523425] [DEBUG] [LOCAL ] EFX: Trimmed 64957 records to 45309 (keeping 200 days of data) [2025-10-17T18:37:43.811551] [DEBUG] [LOCAL ] EFX: Primary data saved (45309 records). [2025-10-17T18:37:43.811720] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-17T18:37:43.812267] [INFO ] [MAIN ] Update Progress: 704/2368 symbols completed. EFX took 33.0s. Estimated remaining: 3h 50m 51s. Rate: 7.2 symbols/min [2025-10-17T18:37:43.974245] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-17T18:37:43.976906] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:44.028681] [DEBUG] [LOCAL ] EGO: Loaded 52116 existing records from primary storage. [2025-10-17T18:37:44.029003] [INFO ] [MAIN ] EGO: Loaded 52116 existing records. [2025-10-17T18:37:44.210466] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:44.210786] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-17T18:37:44.210887] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-17T18:37:44.211338] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-17T18:37:44.211397] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-17T18:37:44.455273] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-17T18:37:44.565459] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:37:44.633633] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:44.757990] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-17T18:37:45.492357] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:37:45.558009] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-17T18:37:46.358160] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-17T18:37:46.721258] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T18:37:47.028509] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:37:47.158039] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-17T18:37:47.957997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-17T18:37:48.202449] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:37:48.209149] [INFO ] [REMOTE ] EFC: Full fetch complete (66754 records). [2025-10-17T18:37:48.209261] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-17T18:37:48.594886] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-17T18:37:48.594961] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-17T18:37:48.595788] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-17T18:37:48.595854] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-17T18:37:48.597073] [DEBUG] [LOCAL ] EFC: Trimmed 66754 records to 47042 (keeping 200 days of data) [2025-10-17T18:37:48.775127] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-17T18:37:48.887845] [DEBUG] [LOCAL ] EFC: Primary data saved (47042 records). [2025-10-17T18:37:48.887983] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-17T18:37:48.888982] [INFO ] [MAIN ] Update Progress: 705/2368 symbols completed. EFC took 56.3s. Estimated remaining: 3h 50m 35s. Rate: 7.2 symbols/min [2025-10-17T18:37:49.059740] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T18:37:49.084706] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:49.127938] [DEBUG] [LOCAL ] EGP: Loaded 30655 existing records from primary storage. [2025-10-17T18:37:49.128202] [INFO ] [MAIN ] EGP: Loaded 30655 existing records. [2025-10-17T18:37:49.304515] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:49.304864] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-17T18:37:49.304962] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-17T18:37:49.305536] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-17T18:37:49.305593] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-17T18:37:49.567563] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-17T18:37:49.610526] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:37:49.695997] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:49.916126] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T18:37:50.358092] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-17T18:37:51.158010] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-17T18:37:51.390143] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T18:37:51.958076] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-17T18:37:52.072976] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:37:52.608805] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T18:37:52.758029] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-17T18:37:53.558008] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-17T18:37:53.689364] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:37:54.044563] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T18:37:54.358028] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-17T18:37:54.845999] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T18:37:55.158044] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-17T18:37:55.757517] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:37:55.958040] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-17T18:37:56.558429] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:37:56.758049] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-17T18:37:57.378607] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T18:37:57.558093] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-17T18:37:58.156498] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:37:58.358086] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-17T18:37:59.158036] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-17T18:37:59.546924] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T18:37:59.618912] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T18:37:59.958041] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-17T18:38:00.451697] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:38:00.758057] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-17T18:38:01.283867] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T18:38:01.558025] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-17T18:38:02.358084] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-17T18:38:02.690176] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:38:03.158026] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-17T18:38:03.183518] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:38:03.252620] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T18:38:03.958040] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-17T18:38:04.758049] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-17T18:38:04.832583] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:38:05.204134] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T18:38:05.558021] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-17T18:38:06.257033] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:38:06.261981] [INFO ] [REMOTE ] EFXT: Full fetch complete (44350 records). [2025-10-17T18:38:06.262072] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-17T18:38:06.361865] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-17T18:38:06.648199] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-17T18:38:06.648297] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-17T18:38:06.649101] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-17T18:38:06.649167] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-17T18:38:06.650138] [DEBUG] [LOCAL ] EFXT: Trimmed 44350 records to 30200 (keeping 200 days of data) [2025-10-17T18:38:06.821184] [DEBUG] [LOCAL ] EFXT: Primary data saved (30200 records). [2025-10-17T18:38:06.821315] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-17T18:38:06.821400] [INFO ] [MAIN ] Update Progress: 706/2368 symbols completed. EFXT took 37.6s. Estimated remaining: 3h 50m 49s. Rate: 7.2 symbols/min [2025-10-17T18:38:06.995528] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:07.033717] [DEBUG] [LOCAL ] EGY: Loaded 41864 existing records from primary storage. [2025-10-17T18:38:07.034200] [INFO ] [MAIN ] EGY: Loaded 41864 existing records. [2025-10-17T18:38:07.162662] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-17T18:38:07.218780] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:07.230540] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-17T18:38:07.235995] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-17T18:38:07.249509] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-17T18:38:07.249622] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-17T18:38:07.322441] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:38:07.572138] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:38:07.660515] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:07.958043] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-17T18:38:08.495985] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T18:38:08.500283] [INFO ] [REMOTE ] EG: Full fetch complete (43197 records). [2025-10-17T18:38:08.500439] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-17T18:38:08.765033] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-17T18:38:08.890315] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-17T18:38:08.890395] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-17T18:38:08.891109] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-17T18:38:08.891214] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-17T18:38:08.892203] [DEBUG] [LOCAL ] EG: Trimmed 43197 records to 28182 (keeping 200 days of data) [2025-10-17T18:38:09.070694] [DEBUG] [LOCAL ] EG: Primary data saved (28182 records). [2025-10-17T18:38:09.070830] [INFO ] [MAIN ] EG: Full history saved. [2025-10-17T18:38:09.070910] [INFO ] [MAIN ] Update Progress: 707/2368 symbols completed. EG took 34.1s. Estimated remaining: 3h 50m 26s. Rate: 7.2 symbols/min [2025-10-17T18:38:09.250568] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:09.278517] [DEBUG] [LOCAL ] EHAB: Loaded 29476 existing records from primary storage. [2025-10-17T18:38:09.278831] [INFO ] [MAIN ] EHAB: Loaded 29476 existing records. [2025-10-17T18:38:09.461430] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:09.461821] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-17T18:38:09.461928] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-17T18:38:09.462221] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-17T18:38:09.462328] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-17T18:38:09.562252] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-17T18:38:09.597986] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T18:38:09.854779] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:10.358017] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-17T18:38:10.873612] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T18:38:11.158037] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-17T18:38:11.678550] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:38:11.851559] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T18:38:11.958025] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-17T18:38:12.758029] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-17T18:38:12.918625] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:38:13.569452] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-17T18:38:13.571971] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:38:13.934243] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T18:38:14.358039] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-17T18:38:15.158022] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-17T18:38:15.526533] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T18:38:15.534095] [INFO ] [REMOTE ] EGO: Full fetch complete (74423 records). [2025-10-17T18:38:15.534213] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-17T18:38:15.861175] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:38:15.950343] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-17T18:38:15.950419] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-17T18:38:15.951294] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-17T18:38:15.951357] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-17T18:38:15.952794] [DEBUG] [LOCAL ] EGO: Trimmed 74423 records to 52505 (keeping 200 days of data) [2025-10-17T18:38:16.001482] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-17T18:38:16.262349] [DEBUG] [LOCAL ] EGO: Primary data saved (52505 records). [2025-10-17T18:38:16.262490] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-17T18:38:16.263039] [INFO ] [MAIN ] Update Progress: 708/2368 symbols completed. EGO took 32.5s. Estimated remaining: 3h 50m 15s. Rate: 7.2 symbols/min [2025-10-17T18:38:16.380727] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:38:16.455899] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:16.498106] [DEBUG] [LOCAL ] EHC: Loaded 41314 existing records from primary storage. [2025-10-17T18:38:16.498404] [INFO ] [MAIN ] EHC: Loaded 41314 existing records. [2025-10-17T18:38:16.673017] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:16.673238] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-17T18:38:16.673316] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-17T18:38:16.673857] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-17T18:38:16.673926] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-17T18:38:16.763188] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-17T18:38:17.025201] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:17.557987] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-17T18:38:17.686623] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T18:38:17.732509] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:38:18.358083] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-17T18:38:18.931398] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:38:18.937723] [INFO ] [REMOTE ] EGP: Full fetch complete (45628 records). [2025-10-17T18:38:18.937872] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-17T18:38:19.163125] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-17T18:38:19.319275] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-17T18:38:19.319352] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-17T18:38:19.320075] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-17T18:38:19.320138] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-17T18:38:19.321126] [DEBUG] [LOCAL ] EGP: Trimmed 45628 records to 30899 (keeping 200 days of data) [2025-10-17T18:38:19.518994] [DEBUG] [LOCAL ] EGP: Primary data saved (30899 records). [2025-10-17T18:38:19.519136] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-17T18:38:19.519227] [INFO ] [MAIN ] Update Progress: 709/2368 symbols completed. EGP took 30.6s. Estimated remaining: 3h 49m 55s. Rate: 7.2 symbols/min [2025-10-17T18:38:19.696993] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:19.709228] [DEBUG] [LOCAL ] EHI: Loaded 10710 existing records from primary storage. [2025-10-17T18:38:19.709476] [INFO ] [MAIN ] EHI: Loaded 10710 existing records. [2025-10-17T18:38:19.902955] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:19.903214] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-17T18:38:19.903450] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-17T18:38:19.903787] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-17T18:38:19.903889] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-17T18:38:19.961293] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-17T18:38:20.119864] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:38:20.305451] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:20.757998] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-17T18:38:20.925859] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T18:38:21.074613] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T18:38:21.558019] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-17T18:38:22.358078] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-17T18:38:22.455448] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:38:22.572676] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T18:38:23.158042] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-17T18:38:23.792069] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T18:38:23.958066] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-17T18:38:24.206592] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:38:24.758034] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-17T18:38:25.453876] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:38:25.558020] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-17T18:38:25.622376] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T18:38:26.358068] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-17T18:38:26.957060] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:38:27.158030] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-17T18:38:27.958010] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-17T18:38:28.006479] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:38:28.426383] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T18:38:28.758029] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-17T18:38:29.327214] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T18:38:29.558065] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-17T18:38:29.742190] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T18:38:30.328291] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:38:30.357989] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-17T18:38:31.074517] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:38:31.157997] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-17T18:38:31.958065] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-17T18:38:32.758007] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-17T18:38:32.767253] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:38:32.911620] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T18:38:33.558030] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-17T18:38:33.889525] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T18:38:34.358058] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-17T18:38:35.158031] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-17T18:38:35.271536] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T18:38:35.813215] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T18:38:35.957998] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-17T18:38:36.043669] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T18:38:36.758025] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-17T18:38:37.563288] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-17T18:38:37.566319] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T18:38:37.639587] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T18:38:38.358059] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-17T18:38:39.105310] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:38:39.158017] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-17T18:38:39.966992] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-17T18:38:39.972140] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:38:40.500567] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T18:38:40.758041] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-17T18:38:41.547809] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T18:38:41.557981] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-17T18:38:41.636700] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T18:38:42.358005] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-17T18:38:42.655004] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:38:43.158085] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-17T18:38:43.870391] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T18:38:43.958053] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-17T18:38:44.758066] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-17T18:38:44.810371] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:38:45.267936] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:38:45.276944] [INFO ] [REMOTE ] EGY: Full fetch complete (60962 records). [2025-10-17T18:38:45.277057] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-17T18:38:45.563286] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-17T18:38:45.618981] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T18:38:45.711487] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-17T18:38:45.711568] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-17T18:38:45.712385] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-17T18:38:45.712449] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-17T18:38:45.713629] [DEBUG] [LOCAL ] EGY: Trimmed 60962 records to 42160 (keeping 200 days of data) [2025-10-17T18:38:45.948808] [DEBUG] [LOCAL ] EGY: Primary data saved (42160 records). [2025-10-17T18:38:45.948934] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-17T18:38:45.949011] [INFO ] [MAIN ] Update Progress: 710/2368 symbols completed. EGY took 39.1s. Estimated remaining: 3h 50m 29s. Rate: 7.2 symbols/min [2025-10-17T18:38:46.113101] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:46.136186] [DEBUG] [LOCAL ] EIC: Loaded 23019 existing records from primary storage. [2025-10-17T18:38:46.136427] [INFO ] [MAIN ] EIC: Loaded 23019 existing records. [2025-10-17T18:38:46.321017] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:46.321255] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-17T18:38:46.321302] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-17T18:38:46.321571] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-17T18:38:46.321630] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-17T18:38:46.366204] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-17T18:38:46.685236] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:47.016573] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T18:38:47.158028] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-17T18:38:47.416441] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T18:38:47.418577] [INFO ] [REMOTE ] EHI: Full fetch complete (16002 records). [2025-10-17T18:38:47.418670] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-17T18:38:47.780343] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-17T18:38:47.780440] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-17T18:38:47.780848] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-17T18:38:47.780910] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-17T18:38:47.781455] [DEBUG] [LOCAL ] EHI: Trimmed 16002 records to 10782 (keeping 200 days of data) [2025-10-17T18:38:47.841679] [DEBUG] [LOCAL ] EHI: Primary data saved (10782 records). [2025-10-17T18:38:47.841808] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-17T18:38:47.841888] [INFO ] [MAIN ] Update Progress: 711/2368 symbols completed. EHI took 28.3s. Estimated remaining: 3h 50m 6s. Rate: 7.2 symbols/min [2025-10-17T18:38:47.963182] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-17T18:38:48.015083] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:48.015448] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-17T18:38:48.015501] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-17T18:38:48.015617] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-17T18:38:48.015690] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-17T18:38:48.015750] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-17T18:38:48.015785] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-17T18:38:48.372029] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:48.581417] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:38:48.758033] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-17T18:38:49.310419] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T18:38:49.313970] [INFO ] [REMOTE ] EHAB: Full fetch complete (40921 records). [2025-10-17T18:38:49.314055] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-17T18:38:49.394805] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:38:49.567452] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-17T18:38:49.710137] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-17T18:38:49.710215] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-17T18:38:49.710848] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-17T18:38:49.710912] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-17T18:38:49.711961] [DEBUG] [LOCAL ] EHAB: Trimmed 40921 records to 29656 (keeping 200 days of data) [2025-10-17T18:38:49.874371] [DEBUG] [LOCAL ] EHAB: Primary data saved (29656 records). [2025-10-17T18:38:49.874503] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-17T18:38:49.874583] [INFO ] [MAIN ] Update Progress: 712/2368 symbols completed. EHAB took 40.8s. Estimated remaining: 3h 49m 43s. Rate: 7.2 symbols/min [2025-10-17T18:38:50.040224] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:50.040389] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-17T18:38:50.040426] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-17T18:38:50.040536] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-17T18:38:50.040577] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-17T18:38:50.040625] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-17T18:38:50.040692] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-17T18:38:50.118064] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T18:38:50.363191] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-17T18:38:50.406168] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:51.158052] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-17T18:38:51.484389] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:38:51.704111] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-17T18:38:51.958030] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-17T18:38:52.758048] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-17T18:38:53.272723] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T18:38:53.557999] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-17T18:38:53.633056] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:38:54.358039] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-17T18:38:54.727121] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T18:38:55.148364] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:38:55.156474] [INFO ] [REMOTE ] EHC: Full fetch complete (58817 records). [2025-10-17T18:38:55.156779] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-17T18:38:55.163186] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-17T18:38:55.718949] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T18:38:55.721849] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-17T18:38:55.721982] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-17T18:38:55.723715] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-17T18:38:55.723802] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-17T18:38:55.725781] [DEBUG] [LOCAL ] EHC: Trimmed 58817 records to 41587 (keeping 200 days of data) [2025-10-17T18:38:55.970290] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-17T18:38:56.060536] [DEBUG] [LOCAL ] EHC: Primary data saved (41587 records). [2025-10-17T18:38:56.060720] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-17T18:38:56.060821] [INFO ] [MAIN ] Update Progress: 713/2368 symbols completed. EHC took 39.8s. Estimated remaining: 3h 49m 30s. Rate: 7.2 symbols/min [2025-10-17T18:38:56.250550] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:56.250782] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-17T18:38:56.250828] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-17T18:38:56.250945] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-17T18:38:56.250988] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-17T18:38:56.251029] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-17T18:38:56.251062] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-17T18:38:56.539496] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T18:38:56.657225] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:56.758019] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-17T18:38:57.558078] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-17T18:38:57.595329] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T18:38:57.936363] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-17T18:38:58.358055] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-17T18:38:59.158053] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-17T18:38:59.714884] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T18:38:59.740493] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:38:59.957987] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-17T18:39:00.573435] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T18:39:00.758058] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-17T18:39:01.558070] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-17T18:39:01.646272] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T18:39:02.358102] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-17T18:39:02.845889] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:39:02.866111] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:39:03.158035] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-17T18:39:03.506380] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T18:39:03.958035] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-17T18:39:04.556568] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T18:39:04.758024] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-17T18:39:05.395663] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T18:39:05.558028] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-17T18:39:05.926515] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T18:39:06.358023] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-17T18:39:07.158014] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-17T18:39:07.494382] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T18:39:07.571686] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T18:39:07.958028] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-17T18:39:08.758048] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-17T18:39:09.075943] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T18:39:09.558027] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-17T18:39:09.881813] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-17T18:39:10.112329] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T18:39:10.358082] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-17T18:39:10.950506] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T18:39:11.158073] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-17T18:39:11.877423] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T18:39:11.958055] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-17T18:39:12.743690] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T18:39:12.757988] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-17T18:39:13.479202] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T18:39:13.558027] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-17T18:39:14.358068] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-17T18:39:14.864465] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T18:39:14.914364] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:39:15.158017] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-17T18:39:15.957995] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-17T18:39:16.275015] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T18:39:16.610079] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T18:39:16.611534] [INFO ] [REMOTE ] EICC: Full fetch complete (8454 records). [2025-10-17T18:39:16.611603] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-17T18:39:16.612037] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:39:16.612122] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:16.612163] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:16.612206] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-17T18:39:16.612261] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-17T18:39:16.612295] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-17T18:39:16.612332] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-17T18:39:16.612381] [INFO ] [MAIN ] Update Progress: 714/2368 symbols completed. EICC took 20.6s. Estimated remaining: 3h 49m 50s. Rate: 7.2 symbols/min [2025-10-17T18:39:16.759404] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-17T18:39:16.777706] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:16.798235] [DEBUG] [LOCAL ] EIG: Loaded 20357 existing records from primary storage. [2025-10-17T18:39:16.798466] [INFO ] [MAIN ] EIG: Loaded 20357 existing records. [2025-10-17T18:39:16.969251] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:16.969446] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-17T18:39:16.969493] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-17T18:39:16.969890] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-17T18:39:16.969947] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-17T18:39:17.313926] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:17.365853] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T18:39:17.366477] [INFO ] [REMOTE ] EICA: Full fetch complete (1275 records). [2025-10-17T18:39:17.366543] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-17T18:39:17.537085] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-17T18:39:17.537265] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:17.537349] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:17.537400] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-17T18:39:17.537459] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-17T18:39:17.537493] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-17T18:39:17.537530] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-17T18:39:17.537584] [INFO ] [MAIN ] Update Progress: 715/2368 symbols completed. EICA took 29.7s. Estimated remaining: 3h 49m 24s. Rate: 7.2 symbols/min [2025-10-17T18:39:17.565152] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-17T18:39:17.706468] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:17.768579] [DEBUG] [LOCAL ] EIX: Loaded 53763 existing records from primary storage. [2025-10-17T18:39:17.769062] [INFO ] [MAIN ] EIX: Loaded 53763 existing records. [2025-10-17T18:39:17.947636] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:17.947851] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-17T18:39:17.947898] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-17T18:39:17.948185] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-17T18:39:17.948239] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-17T18:39:18.056946] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T18:39:18.300574] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:18.357981] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-17T18:39:19.158061] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-17T18:39:19.958020] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-17T18:39:20.220609] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T18:39:20.373623] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:39:20.446601] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:39:20.758042] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-17T18:39:21.195690] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T18:39:21.558030] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-17T18:39:22.358003] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-17T18:39:22.538674] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T18:39:22.809374] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:39:23.158047] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-17T18:39:23.603709] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:39:23.958053] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-17T18:39:24.758050] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-17T18:39:25.558059] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-17T18:39:25.751435] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T18:39:25.935382] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T18:39:26.358031] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-17T18:39:26.658403] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T18:39:26.661408] [INFO ] [REMOTE ] EIC: Full fetch complete (34347 records). [2025-10-17T18:39:26.661502] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-17T18:39:27.019366] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-17T18:39:27.019440] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-17T18:39:27.019973] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-17T18:39:27.020035] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-17T18:39:27.020778] [DEBUG] [LOCAL ] EIC: Trimmed 34347 records to 23126 (keeping 200 days of data) [2025-10-17T18:39:27.158121] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-17T18:39:27.162958] [DEBUG] [LOCAL ] EIC: Primary data saved (23126 records). [2025-10-17T18:39:27.163049] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-17T18:39:27.163176] [INFO ] [MAIN ] Update Progress: 716/2368 symbols completed. EIC took 41.2s. Estimated remaining: 3h 49m 19s. Rate: 7.2 symbols/min [2025-10-17T18:39:27.331059] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:27.380464] [DEBUG] [LOCAL ] EL: Loaded 53766 existing records from primary storage. [2025-10-17T18:39:27.380837] [INFO ] [MAIN ] EL: Loaded 53766 existing records. [2025-10-17T18:39:27.557605] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:27.557961] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-17T18:39:27.558016] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-17T18:39:27.558426] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-17T18:39:27.558483] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-17T18:39:27.913723] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:27.957990] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-17T18:39:28.099378] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T18:39:28.197169] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T18:39:28.758053] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-17T18:39:29.558027] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-17T18:39:29.869694] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:39:30.153069] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T18:39:30.236967] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T18:39:30.237891] [INFO ] [REMOTE ] EICB: Full fetch complete (2720 records). [2025-10-17T18:39:30.237984] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-17T18:39:30.363126] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-17T18:39:30.420801] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T18:39:30.421008] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:30.421054] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:30.421120] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-17T18:39:30.421183] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-17T18:39:30.421233] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-17T18:39:30.421338] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-17T18:39:30.421404] [INFO ] [MAIN ] Update Progress: 717/2368 symbols completed. EICB took 40.5s. Estimated remaining: 3h 48m 59s. Rate: 7.2 symbols/min [2025-10-17T18:39:31.158045] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-17T18:39:31.553253] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T18:39:31.957998] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-17T18:39:32.758086] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-17T18:39:33.082231] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T18:39:33.134305] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T18:39:33.558017] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-17T18:39:34.358078] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-17T18:39:34.683711] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:39:35.158032] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-17T18:39:35.330965] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T18:39:35.706432] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T18:39:35.958040] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-17T18:39:36.758002] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-17T18:39:37.030522] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:39:37.066743] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T18:39:37.558035] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-17T18:39:38.358040] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-17T18:39:38.839877] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T18:39:39.012812] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T18:39:39.157993] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-17T18:39:39.958010] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-17T18:39:40.167249] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:39:40.758078] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-17T18:39:40.956889] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T18:39:41.316012] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T18:39:41.558028] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-17T18:39:42.358016] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-17T18:39:42.635073] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:39:43.158044] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-17T18:39:43.557855] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T18:39:43.560741] [INFO ] [REMOTE ] EIG: Full fetch complete (27214 records). [2025-10-17T18:39:43.560841] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-17T18:39:43.940051] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-17T18:39:43.940158] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-17T18:39:43.940812] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-17T18:39:43.940918] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-17T18:39:43.942189] [DEBUG] [LOCAL ] EIG: Trimmed 27214 records to 20485 (keeping 200 days of data) [2025-10-17T18:39:44.029409] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-17T18:39:44.073256] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-17T18:39:44.103233] [DEBUG] [LOCAL ] EIG: Primary data saved (20485 records). [2025-10-17T18:39:44.103358] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-17T18:39:44.103464] [INFO ] [MAIN ] Update Progress: 718/2368 symbols completed. EIG took 27.5s. Estimated remaining: 3h 49m 3s. Rate: 7.2 symbols/min [2025-10-17T18:39:44.953588] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:39:44.965400] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-17T18:39:45.887222] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T18:39:45.898152] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-17T18:39:46.774425] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T18:39:46.785944] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-17T18:39:48.042102] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T18:39:48.055734] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-17T18:39:48.189815] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T18:39:48.205784] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-17T18:39:48.917073] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T18:39:48.923981] [INFO ] [REMOTE ] EIX: Full fetch complete (77050 records). [2025-10-17T18:39:48.924104] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-17T18:39:48.924823] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:39:48.924908] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:48.924972] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:48.925057] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-17T18:39:48.925140] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-17T18:39:48.925191] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-10-17T18:39:48.925380] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-10-17T18:39:48.926049] [INFO ] [MAIN ] Update Progress: 719/2368 symbols completed. EIX took 31.4s. Estimated remaining: 3h 48m 46s. Rate: 7.2 symbols/min [2025-10-17T18:39:49.899635] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:39:49.910936] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-17T18:39:51.907438] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T18:39:51.918761] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-17T18:39:52.812770] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T18:39:52.820101] [INFO ] [REMOTE ] EL: Full fetch complete (77435 records). [2025-10-17T18:39:52.820215] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-17T18:39:53.199104] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-17T18:39:53.199196] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-17T18:39:53.200112] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-17T18:39:53.200184] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-17T18:39:53.201721] [DEBUG] [LOCAL ] EL: Trimmed 77435 records to 54155 (keeping 200 days of data) [2025-10-17T18:39:53.531682] [DEBUG] [LOCAL ] EL: Primary data saved (54155 records). [2025-10-17T18:39:53.531896] [INFO ] [MAIN ] EL: Full history saved. [2025-10-17T18:39:53.532021] [INFO ] [MAIN ] Update Progress: 720/2368 symbols completed. EL took 26.4s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-17T18:39:54.314032] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.316122] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.310178] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.290478] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.317436] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-17T18:39:54.317984] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-17T18:39:54.318202] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-17T18:39:54.318287] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-17T18:39:54.318435] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-17T18:39:54.321054] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-17T18:39:54.369883] [DEBUG] [LOCAL ] ELC: Loaded 3525 existing records from primary storage. [2025-10-17T18:39:54.377287] [INFO ] [MAIN ] ELC: Loaded 3525 existing records. [2025-10-17T18:39:54.731685] [DEBUG] [LOCAL ] ELAN: Loaded 53690 existing records from primary storage. [2025-10-17T18:39:54.873963] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:54.847869] [INFO ] [MAIN ] ELAN: Loaded 53690 existing records. [2025-10-17T18:39:54.904007] [DEBUG] [LOCAL ] ELF: Loaded 52376 existing records from primary storage. [2025-10-17T18:39:54.890456] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-17T18:39:54.968996] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-17T18:39:54.999475] [INFO ] [MAIN ] ELF: Loaded 52376 existing records. [2025-10-17T18:39:55.024633] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-17T18:39:55.033935] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:55.044501] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-17T18:39:55.089012] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-17T18:39:55.339694] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:55.448272] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-17T18:39:55.498851] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-17T18:39:55.501951] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:55.544490] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-17T18:39:55.544575] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-17T18:39:55.586884] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-17T18:39:55.611878] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-17T18:39:55.734209] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-17T18:39:55.780360] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-17T18:39:56.164371] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:56.211442] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-17T18:39:56.454212] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:56.459254] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-17T18:39:56.541088] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:56.541387] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-17T18:39:56.717125] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:39:56.725317] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-17T18:39:57.116819] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:39:57.118515] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-17T18:39:57.756754] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T18:39:57.758291] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-17T18:39:58.058403] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T18:39:58.065817] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-17T18:39:58.162433] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T18:39:58.173207] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-17T18:39:58.279211] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T18:39:58.280539] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-17T18:39:58.504841] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T18:39:58.516146] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-17T18:39:58.703427] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T18:39:59.158057] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-17T18:39:59.212989] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:39:59.502813] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T18:39:59.815474] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:39:59.957997] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-17T18:40:00.473930] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:40:00.758028] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-17T18:40:01.558016] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-17T18:40:01.594094] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:40:02.358030] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-17T18:40:02.583304] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:40:02.584772] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:40:03.158028] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-17T18:40:03.957999] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-17T18:40:04.411154] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T18:40:04.694299] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:40:04.757994] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-17T18:40:05.558059] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-17T18:40:06.101912] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-17T18:40:06.215673] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:40:06.358029] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-17T18:40:06.502512] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T18:40:07.158041] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-17T18:40:07.958036] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-17T18:40:08.127067] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T18:40:08.491882] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T18:40:08.758039] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-17T18:40:08.993109] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:40:09.104911] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T18:40:09.558034] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-17T18:40:10.358020] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-17T18:40:10.958267] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:40:11.158034] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-17T18:40:11.219451] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:40:11.958025] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-17T18:40:12.578850] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T18:40:12.579830] [INFO ] [REMOTE ] ELC: Full fetch complete (4998 records). [2025-10-17T18:40:12.579898] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-17T18:40:12.760734] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-17T18:40:12.956823] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-17T18:40:12.956906] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-17T18:40:12.957328] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-17T18:40:12.957392] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-17T18:40:12.957855] [DEBUG] [LOCAL ] ELC: Trimmed 4998 records to 3542 (keeping 200 days of data) [2025-10-17T18:40:12.979757] [DEBUG] [LOCAL ] ELC: Primary data saved (3542 records). [2025-10-17T18:40:12.979835] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-17T18:40:12.979922] [INFO ] [MAIN ] Update Progress: 721/2368 symbols completed. ELC took 19.4s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-17T18:40:13.147627] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:13.181320] [DEBUG] [LOCAL ] ELP: Loaded 25881 existing records from primary storage. [2025-10-17T18:40:13.181568] [INFO ] [MAIN ] ELP: Loaded 25881 existing records. [2025-10-17T18:40:13.363384] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:13.363951] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-17T18:40:13.364111] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-17T18:40:13.364410] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-17T18:40:13.364475] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-17T18:40:13.529699] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T18:40:13.561053] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-17T18:40:13.793787] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:14.358257] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-17T18:40:15.158028] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-17T18:40:15.406215] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-17T18:40:15.582423] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:40:15.958042] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-17T18:40:16.228897] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-17T18:40:16.466569] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T18:40:16.758069] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-17T18:40:17.104016] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T18:40:17.558040] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-17T18:40:18.358004] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-17T18:40:18.852423] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-17T18:40:18.922837] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T18:40:19.158030] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-17T18:40:19.459975] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:40:19.958040] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-17T18:40:20.758001] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-17T18:40:20.980538] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:40:21.556180] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:40:21.561041] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-17T18:40:21.694025] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:40:22.358029] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-17T18:40:23.158073] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-17T18:40:23.224290] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T18:40:23.230405] [INFO ] [REMOTE ] ELME: Full fetch complete (56076 records). [2025-10-17T18:40:23.230531] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-17T18:40:23.614405] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-17T18:40:23.614501] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-17T18:40:23.615349] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-17T18:40:23.615417] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-17T18:40:23.616949] [DEBUG] [LOCAL ] ELME: Trimmed 56076 records to 39953 (keeping 200 days of data) [2025-10-17T18:40:23.860048] [DEBUG] [LOCAL ] ELME: Primary data saved (39953 records). [2025-10-17T18:40:23.860194] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-17T18:40:23.860268] [INFO ] [MAIN ] Update Progress: 722/2368 symbols completed. ELME took 30.3s. Estimated remaining: 3h 48m 44s. Rate: 7.2 symbols/min [2025-10-17T18:40:23.960625] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-17T18:40:24.038222] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:24.038586] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-17T18:40:24.038669] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-17T18:40:24.038788] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-17T18:40:24.038832] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-17T18:40:24.038874] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-17T18:40:24.038948] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-17T18:40:24.357021] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T18:40:24.420217] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:24.451503] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:40:24.758027] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-17T18:40:25.558036] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-17T18:40:26.171801] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-17T18:40:26.358012] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-17T18:40:26.701746] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:40:26.838742] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T18:40:27.158032] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-17T18:40:27.958036] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-17T18:40:28.529181] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T18:40:28.530896] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-17T18:40:28.758000] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-17T18:40:29.076954] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:40:29.084315] [INFO ] [REMOTE ] ELAN: Full fetch complete (77081 records). [2025-10-17T18:40:29.084454] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-17T18:40:29.464809] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-17T18:40:29.464894] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-17T18:40:29.465822] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-17T18:40:29.465884] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-17T18:40:29.467344] [DEBUG] [LOCAL ] ELAN: Trimmed 77081 records to 54080 (keeping 200 days of data) [2025-10-17T18:40:29.559850] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-17T18:40:29.780243] [DEBUG] [LOCAL ] ELAN: Primary data saved (54080 records). [2025-10-17T18:40:29.780383] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-17T18:40:29.781196] [INFO ] [MAIN ] Update Progress: 723/2368 symbols completed. ELAN took 36.2s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-17T18:40:29.943736] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:29.991055] [DEBUG] [LOCAL ] ELS: Loaded 50226 existing records from primary storage. [2025-10-17T18:40:29.991380] [INFO ] [MAIN ] ELS: Loaded 50226 existing records. [2025-10-17T18:40:30.166790] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:30.167059] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-17T18:40:30.167132] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-17T18:40:30.167610] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-17T18:40:30.167697] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-17T18:40:30.367004] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-17T18:40:30.515471] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:30.710332] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:40:30.952266] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T18:40:30.968836] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:40:31.158082] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-17T18:40:31.958002] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-17T18:40:32.223543] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-17T18:40:32.378965] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T18:40:32.758062] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-17T18:40:33.558031] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-17T18:40:33.922843] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T18:40:34.018107] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:40:34.358031] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-17T18:40:35.157990] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-17T18:40:35.554860] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T18:40:35.958064] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-17T18:40:36.454790] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:40:36.757993] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-17T18:40:36.817960] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:40:37.115151] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-17T18:40:37.558034] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-17T18:40:37.896432] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T18:40:38.358053] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-17T18:40:38.808722] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T18:40:39.158057] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-17T18:40:39.481242] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T18:40:39.958024] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-17T18:40:40.269909] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-17T18:40:40.758049] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-17T18:40:41.558054] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-17T18:40:42.358041] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-17T18:40:42.811276] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T18:40:42.918154] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T18:40:42.925165] [INFO ] [REMOTE ] ELF: Full fetch complete (75477 records). [2025-10-17T18:40:42.925334] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-17T18:40:43.163272] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-17T18:40:43.310845] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-17T18:40:43.310947] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-17T18:40:43.311888] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-17T18:40:43.311954] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-17T18:40:43.313805] [DEBUG] [LOCAL ] ELF: Trimmed 75477 records to 52711 (keeping 200 days of data) [2025-10-17T18:40:43.636035] [DEBUG] [LOCAL ] ELF: Primary data saved (52711 records). [2025-10-17T18:40:43.636206] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-17T18:40:43.636309] [INFO ] [MAIN ] Update Progress: 724/2368 symbols completed. ELF took 50.1s. Estimated remaining: 3h 48m 34s. Rate: 7.2 symbols/min [2025-10-17T18:40:43.805586] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:43.851846] [DEBUG] [LOCAL ] ELV: Loaded 51042 existing records from primary storage. [2025-10-17T18:40:43.852235] [INFO ] [MAIN ] ELV: Loaded 51042 existing records. [2025-10-17T18:40:43.936451] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T18:40:43.950019] [INFO ] [REMOTE ] ELPC: Full fetch complete (1396 records). [2025-10-17T18:40:43.971532] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-17T18:40:43.968231] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-17T18:40:44.158886] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:44.159327] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-17T18:40:44.159508] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-17T18:40:44.189847] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-17T18:40:44.213581] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-17T18:40:44.334580] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-17T18:40:44.346558] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:40:44.366269] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:40:44.371441] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:40:44.369878] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-17T18:40:44.401542] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-17T18:40:44.420958] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-17T18:40:44.426165] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-17T18:40:44.426370] [INFO ] [MAIN ] Update Progress: 725/2368 symbols completed. ELPC took 20.6s. Estimated remaining: 3h 48m 9s. Rate: 7.2 symbols/min [2025-10-17T18:40:44.758867] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-17T18:40:44.793004] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:44.815839] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-17T18:40:44.815960] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-17T18:40:44.815736] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:44.816859] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-17T18:40:44.817139] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-17T18:40:44.817206] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-17T18:40:44.817242] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-17T18:40:45.170417] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:45.223318] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:40:45.226890] [INFO ] [REMOTE ] ELP: Full fetch complete (36864 records). [2025-10-17T18:40:45.226972] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-17T18:40:45.564099] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-17T18:40:45.586388] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-17T18:40:45.586589] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-17T18:40:45.587205] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-17T18:40:45.587267] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-17T18:40:45.588192] [DEBUG] [LOCAL ] ELP: Trimmed 36864 records to 26040 (keeping 200 days of data) [2025-10-17T18:40:45.728928] [DEBUG] [LOCAL ] ELP: Primary data saved (26040 records). [2025-10-17T18:40:45.729059] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-17T18:40:45.729139] [INFO ] [MAIN ] Update Progress: 726/2368 symbols completed. ELP took 32.7s. Estimated remaining: 3h 47m 45s. Rate: 7.2 symbols/min [2025-10-17T18:40:45.894281] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:45.914171] [DEBUG] [LOCAL ] EMD: Loaded 21065 existing records from primary storage. [2025-10-17T18:40:45.914398] [INFO ] [MAIN ] EMD: Loaded 21065 existing records. [2025-10-17T18:40:46.089267] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:46.089517] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-17T18:40:46.089564] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-17T18:40:46.089765] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-17T18:40:46.089822] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-17T18:40:46.364045] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-17T18:40:46.447863] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:46.473934] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T18:40:46.633540] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:40:46.633838] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-17T18:40:46.633923] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:40:46.633996] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-17T18:40:46.634061] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:40:46.634133] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-17T18:40:46.634198] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-17T18:40:46.634234] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-17T18:40:46.634273] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-17T18:40:46.634318] [INFO ] [MAIN ] Update Progress: 727/2368 symbols completed. EMA took 2.2s. Estimated remaining: 3h 47m 20s. Rate: 7.2 symbols/min [2025-10-17T18:40:46.798675] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:46.830508] [DEBUG] [LOCAL ] EME: Loaded 31206 existing records from primary storage. [2025-10-17T18:40:46.830812] [INFO ] [MAIN ] EME: Loaded 31206 existing records. [2025-10-17T18:40:47.001089] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:47.001360] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-17T18:40:47.001409] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-17T18:40:47.001730] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-17T18:40:47.001791] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-17T18:40:47.169407] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-17T18:40:47.352389] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:47.628943] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T18:40:47.958077] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-17T18:40:48.341943] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:40:48.758083] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-17T18:40:49.386398] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T18:40:49.558068] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-17T18:40:50.358073] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-17T18:40:50.460029] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T18:40:51.158045] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-17T18:40:51.334964] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:40:51.877397] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T18:40:51.957998] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-17T18:40:52.204310] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T18:40:52.758062] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-17T18:40:53.182765] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:40:53.558001] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-17T18:40:53.624172] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:40:54.358032] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-17T18:40:55.158004] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-17T18:40:55.214392] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T18:40:55.958006] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-17T18:40:56.041469] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:40:56.272912] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:40:56.758115] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-17T18:40:57.514024] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:40:57.558021] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-17T18:40:58.358050] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-17T18:40:58.418212] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:40:59.094843] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T18:40:59.157990] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-17T18:40:59.510821] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:40:59.958141] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-17T18:41:00.392372] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T18:41:00.758065] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-17T18:41:01.429615] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T18:41:01.558042] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-17T18:41:02.358054] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-17T18:41:02.929566] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T18:41:03.059688] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-17T18:41:03.158036] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-17T18:41:03.958001] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-17T18:41:04.225541] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:41:04.301218] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:41:04.757993] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-17T18:41:04.914087] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T18:41:05.558023] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-17T18:41:05.675502] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T18:41:06.358060] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-17T18:41:07.158001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-17T18:41:07.358410] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T18:41:07.958002] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-17T18:41:08.087556] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:41:08.277793] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T18:41:08.758046] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-17T18:41:09.558016] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-17T18:41:09.870573] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T18:41:10.358032] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-17T18:41:10.419501] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:41:11.129447] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T18:41:11.158046] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-17T18:41:11.958027] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-17T18:41:12.097783] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:41:12.758018] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-17T18:41:12.949850] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:41:13.421618] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:41:13.425062] [INFO ] [REMOTE ] EMD: Full fetch complete (32112 records). [2025-10-17T18:41:13.425161] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-17T18:41:13.563166] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-17T18:41:13.825912] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-17T18:41:13.826005] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-17T18:41:13.826634] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-17T18:41:13.826717] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-17T18:41:13.827558] [DEBUG] [LOCAL ] EMD: Trimmed 32112 records to 21209 (keeping 200 days of data) [2025-10-17T18:41:13.958670] [DEBUG] [LOCAL ] EMD: Primary data saved (21209 records). [2025-10-17T18:41:13.958812] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-17T18:41:13.958892] [INFO ] [MAIN ] Update Progress: 728/2368 symbols completed. EMD took 28.2s. Estimated remaining: 3h 47m 54s. Rate: 7.2 symbols/min [2025-10-17T18:41:14.148999] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:14.155146] [DEBUG] [LOCAL ] EMF: Loaded 3235 existing records from primary storage. [2025-10-17T18:41:14.155367] [INFO ] [MAIN ] EMF: Loaded 3235 existing records. [2025-10-17T18:41:14.355826] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:14.361209] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-17T18:41:14.370772] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T18:41:14.369108] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-17T18:41:14.375627] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-17T18:41:14.376001] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-17T18:41:14.376070] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-17T18:41:14.390017] [INFO ] [REMOTE ] EME: Full fetch complete (46906 records). [2025-10-17T18:41:14.410560] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-17T18:41:14.438150] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:41:14.454522] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:41:14.479535] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:41:14.491913] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-17T18:41:14.492067] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-17T18:41:14.492133] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-10-17T18:41:14.497888] [DEBUG] [LOCAL ] EME: Deleted derivative data file. [2025-10-17T18:41:14.508285] [INFO ] [MAIN ] Update Progress: 729/2368 symbols completed. EME took 27.9s. Estimated remaining: 3h 47m 28s. Rate: 7.2 symbols/min [2025-10-17T18:41:14.884828] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:14.975222] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:15.014796] [DEBUG] [LOCAL ] EMN: Loaded 51134 existing records from primary storage. [2025-10-17T18:41:15.015136] [INFO ] [MAIN ] EMN: Loaded 51134 existing records. [2025-10-17T18:41:15.158151] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-17T18:41:15.194979] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:15.195379] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-17T18:41:15.195439] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-17T18:41:15.195807] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-17T18:41:15.195864] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-17T18:41:15.548863] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:15.672029] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:41:15.969944] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-17T18:41:15.978255] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:41:16.271856] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T18:41:16.758120] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-17T18:41:17.558059] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-17T18:41:17.809441] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:41:18.358049] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-17T18:41:18.632250] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T18:41:19.159716] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-17T18:41:19.166056] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T18:41:19.958052] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-17T18:41:20.198917] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:41:20.557676] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T18:41:20.758066] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-17T18:41:21.558047] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-17T18:41:21.798921] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:41:21.806099] [INFO ] [REMOTE ] ELS: Full fetch complete (71245 records). [2025-10-17T18:41:21.806250] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-17T18:41:22.202268] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-17T18:41:22.202356] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-17T18:41:22.203227] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-17T18:41:22.203293] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-17T18:41:22.204746] [DEBUG] [LOCAL ] ELS: Trimmed 71245 records to 50599 (keeping 200 days of data) [2025-10-17T18:41:22.381421] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-17T18:41:22.532784] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:41:22.553323] [DEBUG] [LOCAL ] ELS: Primary data saved (50599 records). [2025-10-17T18:41:22.553442] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-17T18:41:22.554313] [INFO ] [MAIN ] Update Progress: 730/2368 symbols completed. ELS took 52.8s. Estimated remaining: 3h 47m 19s. Rate: 7.2 symbols/min [2025-10-17T18:41:22.719977] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:22.735630] [DEBUG] [LOCAL ] EMO: Loaded 13368 existing records from primary storage. [2025-10-17T18:41:22.735894] [INFO ] [MAIN ] EMO: Loaded 13368 existing records. [2025-10-17T18:41:22.920488] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:22.920716] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-17T18:41:22.920772] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-17T18:41:22.920925] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-17T18:41:22.920964] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-17T18:41:23.099396] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T18:41:23.168365] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-17T18:41:23.317361] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:23.429224] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:41:23.436296] [INFO ] [REMOTE ] ELV: Full fetch complete (73267 records). [2025-10-17T18:41:23.436428] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-17T18:41:23.826165] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-17T18:41:23.826264] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-17T18:41:23.827138] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-17T18:41:23.827202] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-17T18:41:23.828741] [DEBUG] [LOCAL ] ELV: Trimmed 73267 records to 51393 (keeping 200 days of data) [2025-10-17T18:41:23.958058] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-17T18:41:24.062301] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T18:41:24.170977] [DEBUG] [LOCAL ] ELV: Primary data saved (51393 records). [2025-10-17T18:41:24.171127] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-17T18:41:24.171748] [INFO ] [MAIN ] Update Progress: 731/2368 symbols completed. ELV took 40.5s. Estimated remaining: 3h 46m 56s. Rate: 7.2 symbols/min [2025-10-17T18:41:24.345600] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:24.352360] [DEBUG] [LOCAL ] EMP: Loaded 3045 existing records from primary storage. [2025-10-17T18:41:24.352732] [INFO ] [MAIN ] EMP: Loaded 3045 existing records. [2025-10-17T18:41:24.539433] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:24.539694] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-17T18:41:24.539754] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-17T18:41:24.539963] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-17T18:41:24.540021] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-17T18:41:24.766330] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-17T18:41:24.929819] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:25.449574] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T18:41:25.557982] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-17T18:41:25.648149] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:41:26.026475] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T18:41:26.358002] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-17T18:41:26.940500] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:41:27.158038] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-17T18:41:27.911327] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T18:41:27.958008] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-17T18:41:28.426752] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T18:41:28.758052] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-17T18:41:29.558038] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-17T18:41:30.075681] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T18:41:30.332179] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T18:41:30.357993] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-17T18:41:31.158060] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-17T18:41:31.640746] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-17T18:41:31.958036] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-17T18:41:32.209662] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T18:41:32.596206] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:41:32.758047] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-17T18:41:33.187789] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T18:41:33.558014] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-17T18:41:34.358035] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-17T18:41:34.827463] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T18:41:35.158026] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-17T18:41:35.279187] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:41:35.843794] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T18:41:35.958000] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-17T18:41:36.757997] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-17T18:41:36.850473] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T18:41:37.558022] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-17T18:41:38.184781] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T18:41:38.358007] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-17T18:41:38.443510] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T18:41:39.044456] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T18:41:39.158001] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-17T18:41:39.920051] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:41:39.958023] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-17T18:41:40.723751] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:41:40.758058] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-17T18:41:41.328508] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T18:41:41.329502] [INFO ] [REMOTE ] EMF: Full fetch complete (6274 records). [2025-10-17T18:41:41.329570] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-17T18:41:41.565578] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-17T18:41:41.687799] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-17T18:41:41.687875] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-17T18:41:41.688055] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-17T18:41:41.688095] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-17T18:41:41.688471] [DEBUG] [LOCAL ] EMF: Trimmed 6274 records to 3246 (keeping 200 days of data) [2025-10-17T18:41:41.709341] [DEBUG] [LOCAL ] EMF: Primary data saved (3246 records). [2025-10-17T18:41:41.709459] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-17T18:41:41.709541] [INFO ] [MAIN ] Update Progress: 732/2368 symbols completed. EMF took 27.8s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-10-17T18:41:41.880198] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:41.932681] [DEBUG] [LOCAL ] EMR: Loaded 53592 existing records from primary storage. [2025-10-17T18:41:41.932984] [INFO ] [MAIN ] EMR: Loaded 53592 existing records. [2025-10-17T18:41:42.112123] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:42.112324] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-17T18:41:42.112371] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-17T18:41:42.112735] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-17T18:41:42.112792] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-17T18:41:42.363893] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-17T18:41:42.466211] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:43.157993] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-17T18:41:43.394360] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T18:41:43.416402] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T18:41:43.679931] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T18:41:43.958001] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-17T18:41:44.758029] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-17T18:41:44.856458] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T18:41:45.558030] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-17T18:41:46.357997] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-17T18:41:46.389403] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T18:41:46.546005] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:41:46.835250] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T18:41:47.158012] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-17T18:41:47.958084] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-17T18:41:48.758018] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-17T18:41:48.917839] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T18:41:49.143745] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T18:41:49.353292] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:41:49.558071] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-17T18:41:50.119819] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T18:41:50.358039] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-17T18:41:51.158050] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-17T18:41:51.939294] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T18:41:51.958030] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-17T18:41:52.152502] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T18:41:52.758054] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-17T18:41:52.907988] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T18:41:53.558068] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-17T18:41:54.358045] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-17T18:41:54.595668] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T18:41:54.598581] [INFO ] [REMOTE ] EMO: Full fetch complete (17703 records). [2025-10-17T18:41:54.598687] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-17T18:41:54.888501] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T18:41:54.916491] [INFO ] [REMOTE ] EMP: Full fetch complete (4182 records). [2025-10-17T18:41:54.919250] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T18:41:54.917507] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-17T18:41:55.115848] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-17T18:41:55.121607] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-17T18:41:55.122114] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-17T18:41:55.132446] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-17T18:41:55.161031] [DEBUG] [LOCAL ] EMO: Trimmed 17703 records to 13445 (keeping 200 days of data) [2025-10-17T18:41:55.160661] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-17T18:41:55.458756] [DEBUG] [LOCAL ] EMO: Primary data saved (13445 records). [2025-10-17T18:41:55.464877] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-17T18:41:55.464979] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-17T18:41:55.465031] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-17T18:41:55.465216] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-17T18:41:55.465335] [INFO ] [MAIN ] Update Progress: 733/2368 symbols completed. EMO took 32.9s. Estimated remaining: 3h 47m 12s. Rate: 7.2 symbols/min [2025-10-17T18:41:55.465420] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-17T18:41:55.528593] [DEBUG] [LOCAL ] EMP: Trimmed 4182 records to 3057 (keeping 200 days of data) [2025-10-17T18:41:55.601597] [DEBUG] [LOCAL ] EMP: Primary data saved (3057 records). [2025-10-17T18:41:55.611959] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-17T18:41:55.625825] [INFO ] [MAIN ] Update Progress: 734/2368 symbols completed. EMP took 31.5s. Estimated remaining: 3h 46m 46s. Rate: 7.2 symbols/min [2025-10-17T18:41:55.732426] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:55.830258] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:55.881457] [DEBUG] [LOCAL ] ENB: Loaded 53902 existing records from primary storage. [2025-10-17T18:41:55.881924] [INFO ] [MAIN ] ENB: Loaded 53902 existing records. [2025-10-17T18:41:55.961726] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-17T18:41:56.005459] [DEBUG] [LOCAL ] ENIC: Loaded 36937 existing records from primary storage. [2025-10-17T18:41:56.078717] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:56.078966] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-17T18:41:56.079049] [INFO ] [MAIN ] ENIC: Loaded 36937 existing records. [2025-10-17T18:41:56.079152] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-17T18:41:56.109812] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-17T18:41:56.147066] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-17T18:41:56.427355] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:56.489688] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-17T18:41:56.515485] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-17T18:41:56.546402] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-17T18:41:56.546543] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-17T18:41:56.731702] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:56.765595] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-17T18:41:56.990728] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:57.035672] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:41:57.042935] [INFO ] [REMOTE ] EMN: Full fetch complete (72367 records). [2025-10-17T18:41:57.043056] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-17T18:41:57.433227] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-17T18:41:57.433326] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-17T18:41:57.434203] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-17T18:41:57.434267] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-17T18:41:57.435683] [DEBUG] [LOCAL ] EMN: Trimmed 72367 records to 51488 (keeping 200 days of data) [2025-10-17T18:41:57.557995] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-17T18:41:57.746447] [DEBUG] [LOCAL ] EMN: Primary data saved (51488 records). [2025-10-17T18:41:57.746750] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-17T18:41:57.746890] [INFO ] [MAIN ] Update Progress: 735/2368 symbols completed. EMN took 43.2s. Estimated remaining: 3h 46m 24s. Rate: 7.2 symbols/min [2025-10-17T18:41:57.939970] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T18:41:57.942234] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:57.955836] [DEBUG] [LOCAL ] ENO: Loaded 1865 existing records from primary storage. [2025-10-17T18:41:57.955971] [INFO ] [MAIN ] ENO: Loaded 1865 existing records. [2025-10-17T18:41:58.132983] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:58.133182] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-17T18:41:58.133227] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-17T18:41:58.133387] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-17T18:41:58.133437] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-17T18:41:58.373890] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-17T18:41:58.487802] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:58.588023] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:41:58.767810] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T18:41:59.158034] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-17T18:41:59.958034] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-17T18:42:00.013226] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:42:00.070382] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T18:42:00.758037] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-17T18:42:01.558036] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-17T18:42:01.936806] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:42:02.105467] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T18:42:02.358041] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-17T18:42:03.158027] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-17T18:42:03.958015] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-17T18:42:04.138230] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-17T18:42:04.215871] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T18:42:04.345052] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:42:04.435036] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T18:42:04.758079] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-17T18:42:05.558069] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-17T18:42:06.358057] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-17T18:42:06.601567] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:42:06.830530] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T18:42:07.158034] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-17T18:42:07.473389] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T18:42:07.958054] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-17T18:42:08.757996] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-17T18:42:09.085122] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:42:09.557957] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-17T18:42:09.666172] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T18:42:09.820993] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T18:42:09.922269] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T18:42:10.358011] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-17T18:42:10.912712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-17T18:42:11.158046] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-17T18:42:11.958039] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-17T18:42:12.758071] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-17T18:42:13.495091] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T18:42:13.557997] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-17T18:42:13.566329] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:42:14.036170] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-17T18:42:14.051039] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T18:42:14.358036] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-17T18:42:15.158035] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-17T18:42:15.958045] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-17T18:42:16.042367] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:42:16.758011] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-17T18:42:16.942845] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:42:17.266140] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T18:42:17.466085] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:42:17.558065] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-17T18:42:18.358044] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-17T18:42:19.158057] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-17T18:42:19.453574] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:42:19.842606] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T18:42:19.957990] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-17T18:42:20.758048] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-17T18:42:21.330020] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-17T18:42:21.512543] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T18:42:21.558003] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-17T18:42:22.358094] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-17T18:42:22.628566] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:42:22.870895] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T18:42:22.892491] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T18:42:23.158040] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-17T18:42:23.958045] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-17T18:42:24.758003] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-17T18:42:24.917440] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:42:25.153305] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T18:42:25.557998] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-17T18:42:25.873179] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:42:25.880543] [INFO ] [REMOTE ] EMR: Full fetch complete (77233 records). [2025-10-17T18:42:25.880751] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-17T18:42:26.273582] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-17T18:42:26.273709] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-17T18:42:26.274749] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-17T18:42:26.274817] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-17T18:42:26.276445] [DEBUG] [LOCAL ] EMR: Trimmed 77233 records to 53972 (keeping 200 days of data) [2025-10-17T18:42:26.367181] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-17T18:42:26.615088] [DEBUG] [LOCAL ] EMR: Primary data saved (53972 records). [2025-10-17T18:42:26.615216] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-17T18:42:26.615296] [INFO ] [MAIN ] Update Progress: 736/2368 symbols completed. EMR took 44.9s. Estimated remaining: 3h 47m 1s. Rate: 7.2 symbols/min [2025-10-17T18:42:26.786537] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:26.829109] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T18:42:26.829814] [DEBUG] [LOCAL ] ENOV: Loaded 45134 existing records from primary storage. [2025-10-17T18:42:26.830848] [INFO ] [REMOTE ] ENO: Full fetch complete (3016 records). [2025-10-17T18:42:26.830944] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-17T18:42:26.862127] [INFO ] [MAIN ] ENOV: Loaded 45134 existing records. [2025-10-17T18:42:27.167496] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-17T18:42:27.119178] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:42:27.273885] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:27.290282] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-17T18:42:27.290405] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-17T18:42:27.325015] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-17T18:42:27.328554] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-17T18:42:27.510314] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-17T18:42:27.515861] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-17T18:42:27.526350] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-17T18:42:27.526448] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-17T18:42:27.549778] [DEBUG] [LOCAL ] ENO: Trimmed 3016 records to 1872 (keeping 200 days of data) [2025-10-17T18:42:27.645852] [DEBUG] [LOCAL ] ENO: Primary data saved (1872 records). [2025-10-17T18:42:27.677499] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-17T18:42:27.682808] [INFO ] [MAIN ] Update Progress: 737/2368 symbols completed. ENO took 29.9s. Estimated remaining: 3h 46m 36s. Rate: 7.2 symbols/min [2025-10-17T18:42:27.919416] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:27.948342] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:27.958011] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-17T18:42:27.988240] [DEBUG] [LOCAL ] ENR: Loaded 44023 existing records from primary storage. [2025-10-17T18:42:27.988556] [INFO ] [MAIN ] ENR: Loaded 44023 existing records. [2025-10-17T18:42:28.161117] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:28.161314] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-17T18:42:28.161361] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-17T18:42:28.161537] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-17T18:42:28.161573] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-17T18:42:28.506204] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:28.758039] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-17T18:42:29.198446] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T18:42:29.558032] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-17T18:42:29.753165] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:42:30.063628] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:42:30.068390] [INFO ] [REMOTE ] ENIC: Full fetch complete (51524 records). [2025-10-17T18:42:30.068476] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-17T18:42:30.363154] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-17T18:42:30.443828] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-17T18:42:30.443905] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-17T18:42:30.444600] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-17T18:42:30.444669] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-17T18:42:30.445803] [DEBUG] [LOCAL ] ENIC: Trimmed 51524 records to 37209 (keeping 200 days of data) [2025-10-17T18:42:30.649243] [DEBUG] [LOCAL ] ENIC: Primary data saved (37209 records). [2025-10-17T18:42:30.649364] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-17T18:42:30.649448] [INFO ] [MAIN ] Update Progress: 738/2368 symbols completed. ENIC took 35.0s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-17T18:42:30.846753] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:30.876114] [DEBUG] [LOCAL ] ENS: Loaded 29991 existing records from primary storage. [2025-10-17T18:42:30.876368] [INFO ] [MAIN ] ENS: Loaded 29991 existing records. [2025-10-17T18:42:31.051795] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:31.052013] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-17T18:42:31.052070] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-17T18:42:31.052327] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-17T18:42:31.052383] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-17T18:42:31.163180] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-17T18:42:31.400791] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:31.878633] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-17T18:42:31.886464] [INFO ] [REMOTE ] ENB: Full fetch complete (77658 records). [2025-10-17T18:42:31.886626] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-17T18:42:31.961682] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-17T18:42:32.062858] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T18:42:32.316428] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-17T18:42:32.316676] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-17T18:42:32.318928] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-17T18:42:32.319066] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-17T18:42:32.339019] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:42:32.346501] [DEBUG] [LOCAL ] ENB: Trimmed 77658 records to 54292 (keeping 200 days of data) [2025-10-17T18:42:32.674496] [DEBUG] [LOCAL ] ENB: Primary data saved (54292 records). [2025-10-17T18:42:32.674697] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-17T18:42:32.675589] [INFO ] [MAIN ] Update Progress: 739/2368 symbols completed. ENB took 37.2s. Estimated remaining: 3h 45m 54s. Rate: 7.2 symbols/min [2025-10-17T18:42:32.764363] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-17T18:42:32.848716] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:32.879546] [DEBUG] [LOCAL ] ENVA: Loaded 25627 existing records from primary storage. [2025-10-17T18:42:32.879847] [INFO ] [MAIN ] ENVA: Loaded 25627 existing records. [2025-10-17T18:42:33.057768] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:33.057967] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-17T18:42:33.058013] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-17T18:42:33.058264] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-17T18:42:33.058306] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-17T18:42:33.428622] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:33.444354] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T18:42:33.558070] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-17T18:42:34.107826] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T18:42:34.358054] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-17T18:42:34.908691] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:42:35.158033] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-17T18:42:35.612508] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:42:35.958033] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-17T18:42:36.646153] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:42:36.758029] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-17T18:42:37.317510] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T18:42:37.558025] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-17T18:42:38.184904] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:42:38.290194] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:42:38.357994] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-17T18:42:39.158063] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-17T18:42:39.616076] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T18:42:39.958038] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-17T18:42:40.758047] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-17T18:42:40.834945] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:42:41.450599] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:42:41.558093] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-17T18:42:42.157745] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:42:42.358032] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-17T18:42:42.688803] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T18:42:43.158053] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-17T18:42:43.744360] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T18:42:43.958029] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-17T18:42:44.758078] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-17T18:42:44.875258] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:42:45.351096] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T18:42:45.558062] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-17T18:42:46.156349] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T18:42:46.358066] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-17T18:42:47.160471] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-17T18:42:47.161844] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:42:47.908989] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T18:42:47.957994] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-17T18:42:48.350003] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T18:42:48.758091] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-17T18:42:49.304574] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:42:49.558060] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-17T18:42:50.358014] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-17T18:42:50.428343] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:42:50.707831] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:42:51.158077] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-17T18:42:51.670564] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T18:42:51.958069] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-17T18:42:52.758018] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-17T18:42:52.824137] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:42:53.202485] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T18:42:53.558054] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-17T18:42:53.941034] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T18:42:54.358045] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-17T18:42:54.722941] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:42:55.158028] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-17T18:42:55.963561] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-17T18:42:55.981604] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:42:56.385997] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T18:42:56.758029] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-17T18:42:57.557999] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-17T18:42:57.655637] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:42:57.729580] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T18:42:58.358038] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-17T18:42:58.720591] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T18:42:58.724137] [INFO ] [REMOTE ] ENVA: Full fetch complete (36649 records). [2025-10-17T18:42:58.724214] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-17T18:42:59.099049] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-17T18:42:59.099121] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-17T18:42:59.099703] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-17T18:42:59.099764] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-17T18:42:59.100529] [DEBUG] [LOCAL ] ENVA: Trimmed 36649 records to 25790 (keeping 200 days of data) [2025-10-17T18:42:59.182291] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-17T18:42:59.249243] [DEBUG] [LOCAL ] ENVA: Primary data saved (25790 records). [2025-10-17T18:42:59.249365] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-17T18:42:59.249441] [INFO ] [MAIN ] Update Progress: 740/2368 symbols completed. ENVA took 26.6s. Estimated remaining: 3h 46m 26s. Rate: 7.2 symbols/min [2025-10-17T18:42:59.413276] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:59.413448] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-17T18:42:59.413485] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-17T18:42:59.413596] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-17T18:42:59.413636] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-17T18:42:59.413722] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-17T18:42:59.413760] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-17T18:42:59.762659] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:59.930289] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T18:42:59.936103] [INFO ] [REMOTE ] ENR: Full fetch complete (59483 records). [2025-10-17T18:42:59.936198] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-17T18:42:59.966216] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-17T18:43:00.311335] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-17T18:43:00.311477] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-17T18:43:00.312269] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-17T18:43:00.312330] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-17T18:43:00.313780] [DEBUG] [LOCAL ] ENR: Trimmed 59483 records to 44323 (keeping 200 days of data) [2025-10-17T18:43:00.569505] [DEBUG] [LOCAL ] ENR: Primary data saved (44323 records). [2025-10-17T18:43:00.569629] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-17T18:43:00.569758] [INFO ] [MAIN ] Update Progress: 741/2368 symbols completed. ENR took 32.9s. Estimated remaining: 3h 46m 2s. Rate: 7.2 symbols/min [2025-10-17T18:43:00.735613] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:00.772197] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-17T18:43:00.806431] [DEBUG] [LOCAL ] EOG: Loaded 53763 existing records from primary storage. [2025-10-17T18:43:00.806955] [INFO ] [MAIN ] EOG: Loaded 53763 existing records. [2025-10-17T18:43:01.004173] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:01.004392] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-17T18:43:01.004483] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-17T18:43:01.005040] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-17T18:43:01.005099] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-17T18:43:01.386313] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:01.414385] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-17T18:43:01.558013] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-17T18:43:01.787085] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T18:43:02.358064] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-17T18:43:02.645407] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T18:43:03.158034] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-17T18:43:03.620013] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T18:43:03.624856] [INFO ] [REMOTE ] ENS: Full fetch complete (42465 records). [2025-10-17T18:43:03.625000] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-17T18:43:03.625623] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:43:03.625735] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:43:03.625779] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:43:03.625819] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-17T18:43:03.625876] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-17T18:43:03.625911] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-17T18:43:03.626096] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-10-17T18:43:03.626186] [INFO ] [MAIN ] Update Progress: 742/2368 symbols completed. ENS took 33.0s. Estimated remaining: 3h 45m 42s. Rate: 7.2 symbols/min [2025-10-17T18:43:03.795920] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:03.808122] [DEBUG] [LOCAL ] EOI: Loaded 10738 existing records from primary storage. [2025-10-17T18:43:03.808325] [INFO ] [MAIN ] EOI: Loaded 10738 existing records. [2025-10-17T18:43:03.966184] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-17T18:43:03.986078] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:03.987765] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-17T18:43:03.987871] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-17T18:43:03.988134] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-17T18:43:03.988314] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-17T18:43:04.194748] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-17T18:43:04.401755] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:04.758002] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-17T18:43:04.964759] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T18:43:05.146284] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T18:43:05.558008] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-17T18:43:05.979600] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:43:06.358034] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-17T18:43:07.048221] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T18:43:07.158013] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-17T18:43:07.371284] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T18:43:07.958004] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-17T18:43:08.120247] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T18:43:08.758023] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-17T18:43:09.557997] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-17T18:43:09.650978] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:43:09.655448] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T18:43:10.358027] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-17T18:43:11.070739] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:43:11.158008] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-17T18:43:11.958071] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-17T18:43:12.332390] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T18:43:12.758125] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-17T18:43:12.840988] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:43:12.860283] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T18:43:13.558027] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-17T18:43:14.358016] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-17T18:43:14.659570] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:43:14.750709] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T18:43:14.756283] [INFO ] [REMOTE ] ENOV: Full fetch complete (63403 records). [2025-10-17T18:43:14.756394] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-17T18:43:14.936823] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T18:43:15.146369] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-17T18:43:15.146451] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-17T18:43:15.147295] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-17T18:43:15.147359] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-17T18:43:15.148633] [DEBUG] [LOCAL ] ENOV: Trimmed 63403 records to 45385 (keeping 200 days of data) [2025-10-17T18:43:15.196119] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-17T18:43:15.406534] [DEBUG] [LOCAL ] ENOV: Primary data saved (45385 records). [2025-10-17T18:43:15.406686] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-17T18:43:15.406782] [INFO ] [MAIN ] Update Progress: 743/2368 symbols completed. ENOV took 48.8s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-17T18:43:15.574951] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:15.590983] [DEBUG] [LOCAL ] EOS: Loaded 15236 existing records from primary storage. [2025-10-17T18:43:15.591204] [INFO ] [MAIN ] EOS: Loaded 15236 existing records. [2025-10-17T18:43:15.771189] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:15.771398] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-17T18:43:15.771446] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-17T18:43:15.771684] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-17T18:43:15.771767] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-17T18:43:15.963202] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-17T18:43:16.134675] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:16.758036] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-17T18:43:16.975146] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T18:43:17.186819] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:43:17.558048] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-17T18:43:18.165915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T18:43:18.358000] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-17T18:43:18.438577] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:43:19.158132] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-17T18:43:19.292941] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T18:43:19.958034] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-17T18:43:20.747992] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T18:43:20.757979] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-17T18:43:20.914445] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:43:21.558008] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-17T18:43:21.738960] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T18:43:22.358002] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-17T18:43:22.397096] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T18:43:23.158071] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-17T18:43:23.460606] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:43:23.958100] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-17T18:43:24.137104] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T18:43:24.722553] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T18:43:24.758025] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-17T18:43:25.558008] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-17T18:43:25.596108] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T18:43:26.358026] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-17T18:43:26.565423] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T18:43:27.158032] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-17T18:43:27.957944] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T18:43:27.957997] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-17T18:43:28.613959] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T18:43:28.758007] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-17T18:43:28.809482] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T18:43:29.558010] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-17T18:43:30.358083] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-17T18:43:31.011279] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T18:43:31.017537] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-17T18:43:31.035696] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T18:43:31.158028] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-17T18:43:31.910928] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:43:31.958015] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-17T18:43:32.758025] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-17T18:43:33.558071] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-17T18:43:33.746351] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T18:43:33.749505] [INFO ] [REMOTE ] EOD: Full fetch complete (21065 records). [2025-10-17T18:43:33.749586] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-17T18:43:34.123598] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T18:43:34.161768] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-17T18:43:34.162009] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-17T18:43:34.162627] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-17T18:43:34.162942] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-17T18:43:34.164484] [DEBUG] [LOCAL ] EOD: Trimmed 21065 records to 15256 (keeping 200 days of data) [2025-10-17T18:43:34.219502] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T18:43:34.269557] [DEBUG] [LOCAL ] EOD: Primary data saved (15256 records). [2025-10-17T18:43:34.269729] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-17T18:43:34.269815] [INFO ] [MAIN ] Update Progress: 744/2368 symbols completed. EOD took 35.0s. Estimated remaining: 3h 45m 56s. Rate: 7.2 symbols/min [2025-10-17T18:43:34.364459] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-17T18:43:34.439851] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:34.449203] [DEBUG] [LOCAL ] EOT: Loaded 7040 existing records from primary storage. [2025-10-17T18:43:34.449388] [INFO ] [MAIN ] EOT: Loaded 7040 existing records. [2025-10-17T18:43:34.624013] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:34.624221] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-17T18:43:34.624268] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-17T18:43:34.624488] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-17T18:43:34.624553] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-17T18:43:35.005542] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:35.158099] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-17T18:43:35.958061] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-17T18:43:36.064200] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:43:36.241929] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T18:43:36.249460] [INFO ] [REMOTE ] EOG: Full fetch complete (77462 records). [2025-10-17T18:43:36.249577] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-17T18:43:36.654300] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-17T18:43:36.654375] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-17T18:43:36.655278] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-17T18:43:36.655342] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-17T18:43:36.656764] [DEBUG] [LOCAL ] EOG: Trimmed 77462 records to 54152 (keeping 200 days of data) [2025-10-17T18:43:36.761699] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-17T18:43:36.993966] [DEBUG] [LOCAL ] EOG: Primary data saved (54152 records). [2025-10-17T18:43:36.994194] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-17T18:43:36.994287] [INFO ] [MAIN ] Update Progress: 745/2368 symbols completed. EOG took 36.4s. Estimated remaining: 3h 45m 35s. Rate: 7.2 symbols/min [2025-10-17T18:43:37.081533] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:43:37.172738] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:37.197950] [DEBUG] [LOCAL ] EPAC: Loaded 26765 existing records from primary storage. [2025-10-17T18:43:37.198197] [INFO ] [MAIN ] EPAC: Loaded 26765 existing records. [2025-10-17T18:43:37.372811] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:37.373022] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-17T18:43:37.373072] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-17T18:43:37.373266] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-17T18:43:37.373322] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-17T18:43:37.566071] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-17T18:43:37.666505] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T18:43:37.742624] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:38.358002] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-17T18:43:38.529254] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T18:43:39.090090] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:43:39.158042] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-17T18:43:39.957999] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-17T18:43:40.266608] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T18:43:40.269342] [INFO ] [REMOTE ] EOS: Full fetch complete (22950 records). [2025-10-17T18:43:40.269429] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-17T18:43:40.629036] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-17T18:43:40.629112] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-17T18:43:40.629564] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-17T18:43:40.629612] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-17T18:43:40.630246] [DEBUG] [LOCAL ] EOS: Trimmed 22950 records to 15294 (keeping 200 days of data) [2025-10-17T18:43:40.723233] [DEBUG] [LOCAL ] EOS: Primary data saved (15294 records). [2025-10-17T18:43:40.723376] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-17T18:43:40.723459] [INFO ] [MAIN ] Update Progress: 746/2368 symbols completed. EOS took 25.3s. Estimated remaining: 3h 45m 17s. Rate: 7.2 symbols/min [2025-10-17T18:43:40.766759] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-17T18:43:40.899740] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:40.937965] [DEBUG] [LOCAL ] EPAM: Loaded 39697 existing records from primary storage. [2025-10-17T18:43:40.938260] [INFO ] [MAIN ] EPAM: Loaded 39697 existing records. [2025-10-17T18:43:41.124314] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:41.124530] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-17T18:43:41.124603] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-17T18:43:41.124921] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-17T18:43:41.124994] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-17T18:43:41.485200] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:41.495680] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T18:43:41.557974] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-17T18:43:41.798386] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T18:43:42.358065] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-17T18:43:42.493427] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T18:43:43.158052] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-17T18:43:43.958022] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-17T18:43:44.027790] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:43:44.089395] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:43:44.091569] [INFO ] [REMOTE ] EOI: Full fetch complete (16205 records). [2025-10-17T18:43:44.091639] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-17T18:43:44.456454] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-17T18:43:44.456569] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-17T18:43:44.457118] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-17T18:43:44.457181] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-17T18:43:44.457848] [DEBUG] [LOCAL ] EOI: Trimmed 16205 records to 10809 (keeping 200 days of data) [2025-10-17T18:43:44.524727] [DEBUG] [LOCAL ] EOI: Primary data saved (10809 records). [2025-10-17T18:43:44.524873] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-17T18:43:44.524956] [INFO ] [MAIN ] Update Progress: 747/2368 symbols completed. EOI took 40.9s. Estimated remaining: 3h 44m 59s. Rate: 7.2 symbols/min [2025-10-17T18:43:44.698326] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:44.736736] [DEBUG] [LOCAL ] EPC: Loaded 40042 existing records from primary storage. [2025-10-17T18:43:44.737056] [INFO ] [MAIN ] EPC: Loaded 40042 existing records. [2025-10-17T18:43:44.760684] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-17T18:43:44.852779] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:43:44.936156] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:44.936389] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-17T18:43:44.936462] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-17T18:43:44.936943] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-17T18:43:44.937013] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-17T18:43:45.286697] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:45.558016] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-17T18:43:46.172489] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:43:46.315512] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T18:43:46.357991] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-17T18:43:47.158056] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-17T18:43:47.177108] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T18:43:47.958018] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-17T18:43:48.285912] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:43:48.758036] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-17T18:43:49.418373] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T18:43:49.558027] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-17T18:43:49.907624] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T18:43:50.358041] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-17T18:43:50.955008] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:43:51.158035] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-17T18:43:51.898001] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T18:43:51.957989] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-17T18:43:52.455768] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:43:52.757990] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-17T18:43:53.222499] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T18:43:53.351113] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T18:43:53.558013] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-17T18:43:54.225439] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T18:43:54.358051] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-17T18:43:55.158033] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-17T18:43:55.448243] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T18:43:55.882105] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T18:43:55.958007] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-17T18:43:56.739002] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T18:43:56.758019] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-17T18:43:57.558036] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-17T18:43:58.358017] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-17T18:43:58.366788] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T18:43:58.476775] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:43:59.158022] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-17T18:43:59.504052] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:43:59.958053] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-17T18:44:00.629449] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:44:00.758022] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-17T18:44:01.558004] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-17T18:44:01.886195] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T18:44:02.358014] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-17T18:44:02.407090] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T18:44:02.409261] [INFO ] [REMOTE ] EOT: Full fetch complete (10780 records). [2025-10-17T18:44:02.409361] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-17T18:44:02.818403] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-17T18:44:02.818562] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-17T18:44:02.818918] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-17T18:44:02.818982] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-17T18:44:02.819678] [DEBUG] [LOCAL ] EOT: Trimmed 10780 records to 7100 (keeping 200 days of data) [2025-10-17T18:44:02.866027] [DEBUG] [LOCAL ] EOT: Primary data saved (7100 records). [2025-10-17T18:44:02.866171] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-17T18:44:02.866267] [INFO ] [MAIN ] Update Progress: 748/2368 symbols completed. EOT took 28.6s. Estimated remaining: 3h 45m 12s. Rate: 7.2 symbols/min [2025-10-17T18:44:03.058380] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:03.111028] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-10-17T18:44:03.111343] [INFO ] [MAIN ] EPD: Loaded 54001 existing records. [2025-10-17T18:44:03.171715] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-17T18:44:03.317126] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:03.317348] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-17T18:44:03.317402] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-17T18:44:03.317801] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-17T18:44:03.317860] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-17T18:44:03.713008] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:03.957998] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-17T18:44:04.155931] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-17T18:44:04.399867] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:44:04.758010] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-17T18:44:04.793151] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:44:05.558005] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-17T18:44:05.787555] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:44:06.349615] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:44:06.358064] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-17T18:44:07.004096] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T18:44:07.157990] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-17T18:44:07.483727] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:44:07.958043] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-17T18:44:08.631594] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T18:44:08.758045] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-17T18:44:09.557994] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-17T18:44:09.921530] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:44:09.996205] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T18:44:10.358059] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-17T18:44:11.058526] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:44:11.157993] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-17T18:44:11.805603] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T18:44:11.958030] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-17T18:44:12.698677] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T18:44:12.702670] [INFO ] [REMOTE ] EPAC: Full fetch complete (38842 records). [2025-10-17T18:44:12.702785] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-17T18:44:12.764084] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-17T18:44:13.069459] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-17T18:44:13.069536] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-17T18:44:13.070158] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-17T18:44:13.070219] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-17T18:44:13.071078] [DEBUG] [LOCAL ] EPAC: Trimmed 38842 records to 27001 (keeping 200 days of data) [2025-10-17T18:44:13.239667] [DEBUG] [LOCAL ] EPAC: Primary data saved (27001 records). [2025-10-17T18:44:13.239816] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-17T18:44:13.239904] [INFO ] [MAIN ] Update Progress: 749/2368 symbols completed. EPAC took 36.2s. Estimated remaining: 3h 45m 8s. Rate: 7.2 symbols/min [2025-10-17T18:44:13.413348] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:13.453996] [DEBUG] [LOCAL ] EPR: Loaded 44181 existing records from primary storage. [2025-10-17T18:44:13.454381] [INFO ] [MAIN ] EPR: Loaded 44181 existing records. [2025-10-17T18:44:13.563147] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-17T18:44:13.635438] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:13.635724] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-17T18:44:13.635779] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-17T18:44:13.635955] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-17T18:44:13.635993] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-17T18:44:13.889847] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T18:44:13.929594] [INFO ] [REMOTE ] EPAM: Full fetch complete (56389 records). [2025-10-17T18:44:13.931962] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-17T18:44:14.117188] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:14.363107] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-17T18:44:14.421103] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-17T18:44:14.421205] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-17T18:44:14.422025] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-17T18:44:14.422125] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-17T18:44:14.426819] [DEBUG] [LOCAL ] EPAM: Trimmed 56389 records to 39978 (keeping 200 days of data) [2025-10-17T18:44:14.672614] [DEBUG] [LOCAL ] EPAM: Primary data saved (39978 records). [2025-10-17T18:44:14.672775] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-17T18:44:14.672862] [INFO ] [MAIN ] Update Progress: 750/2368 symbols completed. EPAM took 33.9s. Estimated remaining: 3h 44m 45s. Rate: 7.2 symbols/min [2025-10-17T18:44:14.876531] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:14.882220] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T18:44:14.935763] [DEBUG] [LOCAL ] EPRT: Loaded 48889 existing records from primary storage. [2025-10-17T18:44:14.936144] [INFO ] [MAIN ] EPRT: Loaded 48889 existing records. [2025-10-17T18:44:15.140612] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:15.140953] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-17T18:44:15.141070] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-17T18:44:15.141494] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-17T18:44:15.141564] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-17T18:44:15.165998] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-17T18:44:15.327698] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:44:15.548190] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:15.958008] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-17T18:44:16.074066] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:44:16.728824] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T18:44:16.757984] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-17T18:44:17.453734] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T18:44:17.558042] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-17T18:44:18.358045] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-17T18:44:19.158052] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-17T18:44:19.271497] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:44:19.320876] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-17T18:44:19.604593] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:44:19.958056] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-17T18:44:20.753889] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:44:20.762539] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-17T18:44:21.558082] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-17T18:44:21.654664] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T18:44:22.358067] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-17T18:44:22.627414] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:44:23.010614] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T18:44:23.158059] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-17T18:44:23.895194] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:44:23.958031] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-17T18:44:24.758011] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-17T18:44:25.189579] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T18:44:25.557999] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-17T18:44:25.776839] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:44:25.906183] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:44:26.358018] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-17T18:44:27.062796] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:44:27.068456] [INFO ] [REMOTE ] EPC: Full fetch complete (57250 records). [2025-10-17T18:44:27.068660] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-17T18:44:27.163151] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-17T18:44:27.464428] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-17T18:44:27.464512] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-17T18:44:27.465274] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-17T18:44:27.465360] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-17T18:44:27.466557] [DEBUG] [LOCAL ] EPC: Trimmed 57250 records to 40316 (keeping 200 days of data) [2025-10-17T18:44:27.712898] [DEBUG] [LOCAL ] EPC: Primary data saved (40316 records). [2025-10-17T18:44:27.713062] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-17T18:44:27.713907] [INFO ] [MAIN ] Update Progress: 751/2368 symbols completed. EPC took 43.2s. Estimated remaining: 3h 44m 47s. Rate: 7.2 symbols/min [2025-10-17T18:44:27.882859] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:27.896528] [DEBUG] [LOCAL ] EQBK: Loaded 11396 existing records from primary storage. [2025-10-17T18:44:27.896821] [INFO ] [MAIN ] EQBK: Loaded 11396 existing records. [2025-10-17T18:44:27.960071] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-17T18:44:28.078812] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:28.079013] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-17T18:44:28.079072] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-17T18:44:28.079303] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-17T18:44:28.079369] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-17T18:44:28.438166] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:28.470360] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:44:28.758003] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-17T18:44:28.846441] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T18:44:29.452540] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:44:29.557992] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-17T18:44:30.358062] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-17T18:44:30.530239] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:44:30.952565] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T18:44:31.158086] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-17T18:44:31.862240] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:44:31.958044] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-17T18:44:32.399391] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:44:32.758075] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-17T18:44:33.558005] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-17T18:44:33.589892] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:44:33.629792] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:44:34.358070] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-17T18:44:35.158083] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-17T18:44:35.683563] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:44:35.958001] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-17T18:44:35.991003] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T18:44:36.280911] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T18:44:36.758039] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-17T18:44:37.500480] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T18:44:37.536787] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:44:37.557975] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-17T18:44:38.319403] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T18:44:38.357991] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-17T18:44:39.158006] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-17T18:44:39.534613] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T18:44:39.958055] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-17T18:44:40.678607] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:44:40.758081] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-17T18:44:40.911492] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:44:41.558032] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-17T18:44:42.358058] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-17T18:44:42.666864] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T18:44:42.675051] [INFO ] [REMOTE ] EPD: Full fetch complete (77780 records). [2025-10-17T18:44:42.675287] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-17T18:44:43.063480] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-17T18:44:43.063766] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-17T18:44:43.064784] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-17T18:44:43.064935] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-17T18:44:43.066514] [DEBUG] [LOCAL ] EPD: Trimmed 77780 records to 54391 (keeping 200 days of data) [2025-10-17T18:44:43.153117] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T18:44:43.181006] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-17T18:44:43.377588] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:44:43.548037] [DEBUG] [LOCAL ] EPD: Primary data saved (54391 records). [2025-10-17T18:44:43.548261] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-17T18:44:43.549413] [INFO ] [MAIN ] Update Progress: 752/2368 symbols completed. EPD took 40.7s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-17T18:44:43.809152] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:43.873164] [DEBUG] [LOCAL ] EQH: Loaded 53088 existing records from primary storage. [2025-10-17T18:44:43.873533] [INFO ] [MAIN ] EQH: Loaded 53088 existing records. [2025-10-17T18:44:43.963399] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-17T18:44:44.088698] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:44.088924] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-17T18:44:44.088972] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-17T18:44:44.089251] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-17T18:44:44.089307] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-17T18:44:44.464809] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:44.758014] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-17T18:44:45.014894] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T18:44:45.558000] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-17T18:44:45.657127] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:44:46.358035] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-17T18:44:46.541852] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:44:46.582870] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T18:44:47.158036] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-17T18:44:47.926513] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T18:44:47.932589] [INFO ] [REMOTE ] EPR: Full fetch complete (63233 records). [2025-10-17T18:44:47.932761] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-17T18:44:47.964930] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-17T18:44:48.325087] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-17T18:44:48.325177] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-17T18:44:48.326008] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-17T18:44:48.326079] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-17T18:44:48.327491] [DEBUG] [LOCAL ] EPR: Trimmed 63233 records to 44473 (keeping 200 days of data) [2025-10-17T18:44:48.594191] [DEBUG] [LOCAL ] EPR: Primary data saved (44473 records). [2025-10-17T18:44:48.594328] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-17T18:44:48.594418] [INFO ] [MAIN ] Update Progress: 753/2368 symbols completed. EPR took 35.4s. Estimated remaining: 3h 44m 39s. Rate: 7.2 symbols/min [2025-10-17T18:44:48.763583] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-17T18:44:48.763453] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:48.813848] [DEBUG] [LOCAL ] EQNR: Loaded 53437 existing records from primary storage. [2025-10-17T18:44:48.814189] [INFO ] [MAIN ] EQNR: Loaded 53437 existing records. [2025-10-17T18:44:48.995963] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:48.996221] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-17T18:44:48.996296] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-17T18:44:48.996798] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-17T18:44:48.996896] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-17T18:44:49.129454] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T18:44:49.396671] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:49.424916] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:44:49.558030] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-17T18:44:49.577296] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T18:44:50.358051] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-17T18:44:51.117712] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T18:44:51.157122] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:44:51.166372] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-17T18:44:51.958057] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-17T18:44:52.758016] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-17T18:44:52.879302] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T18:44:52.881677] [INFO ] [REMOTE ] EQBK: Full fetch complete (15690 records). [2025-10-17T18:44:52.881746] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-17T18:44:53.313474] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-17T18:44:53.313663] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-17T18:44:53.314049] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-17T18:44:53.314214] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-17T18:44:53.316050] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T18:44:53.327159] [DEBUG] [LOCAL ] EQBK: Trimmed 15690 records to 11534 (keeping 200 days of data) [2025-10-17T18:44:53.395224] [DEBUG] [LOCAL ] EQBK: Primary data saved (11534 records). [2025-10-17T18:44:53.395357] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-17T18:44:53.395437] [INFO ] [MAIN ] Update Progress: 754/2368 symbols completed. EQBK took 25.7s. Estimated remaining: 3h 44m 23s. Rate: 7.2 symbols/min [2025-10-17T18:44:53.560925] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-17T18:44:53.562617] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:53.614863] [DEBUG] [LOCAL ] EQR: Loaded 52109 existing records from primary storage. [2025-10-17T18:44:53.615212] [INFO ] [MAIN ] EQR: Loaded 52109 existing records. [2025-10-17T18:44:53.793291] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:53.793615] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-17T18:44:53.793702] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-17T18:44:53.793988] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-17T18:44:53.794052] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-17T18:44:54.133530] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:54.357993] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-17T18:44:54.559093] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:44:54.566111] [INFO ] [REMOTE ] EPRT: Full fetch complete (69375 records). [2025-10-17T18:44:54.566221] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-17T18:44:54.950603] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-17T18:44:54.950715] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-17T18:44:54.951546] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-17T18:44:54.951608] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-17T18:44:54.953112] [DEBUG] [LOCAL ] EPRT: Trimmed 69375 records to 49233 (keeping 200 days of data) [2025-10-17T18:44:55.164354] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-17T18:44:55.256220] [DEBUG] [LOCAL ] EPRT: Primary data saved (49233 records). [2025-10-17T18:44:55.256348] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-17T18:44:55.256432] [INFO ] [MAIN ] Update Progress: 755/2368 symbols completed. EPRT took 40.6s. Estimated remaining: 3h 44m 1s. Rate: 7.2 symbols/min [2025-10-17T18:44:55.427732] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:55.427909] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-17T18:44:55.428020] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-17T18:44:55.428211] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-17T18:44:55.428271] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-17T18:44:55.428339] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-17T18:44:55.428410] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-17T18:44:55.617053] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:44:55.840224] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:55.869696] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T18:44:55.957984] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-17T18:44:56.565604] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T18:44:56.758039] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-17T18:44:57.042373] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:44:57.558065] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-17T18:44:57.934636] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-17T18:44:58.229408] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:44:58.358055] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-17T18:44:59.158051] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-17T18:44:59.489629] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T18:44:59.958042] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-17T18:45:00.271328] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:45:00.758025] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-17T18:45:01.558027] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-17T18:45:01.797636] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T18:45:02.358100] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-17T18:45:03.100252] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T18:45:03.158039] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-17T18:45:03.813245] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T18:45:03.968043] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-17T18:45:03.987681] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (3.23 seconds). [2025-10-17T18:45:04.329423] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-17T18:45:04.758014] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-17T18:45:05.010219] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T18:45:05.104063] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:45:05.558027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-17T18:45:05.946398] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T18:45:06.358022] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-17T18:45:07.158021] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-17T18:45:07.734476] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T18:45:07.957994] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-17T18:45:08.289730] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:45:08.599336] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T18:45:08.758018] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-17T18:45:09.347105] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T18:45:09.557997] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-17T18:45:10.358081] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-17T18:45:11.158037] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-17T18:45:11.451665] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:45:11.665529] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:45:11.794349] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T18:45:11.795260] [INFO ] [REMOTE ] EQS: Full fetch complete (2396 records). [2025-10-17T18:45:11.795329] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-17T18:45:11.965207] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-17T18:45:11.971352] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-17T18:45:11.971667] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:45:11.972279] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:45:11.972352] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-17T18:45:11.972425] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-17T18:45:11.972488] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-17T18:45:11.972531] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-17T18:45:11.972584] [INFO ] [MAIN ] Update Progress: 756/2368 symbols completed. EQS took 16.7s. Estimated remaining: 3h 44m 11s. Rate: 7.2 symbols/min [2025-10-17T18:45:12.139933] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:12.187927] [DEBUG] [LOCAL ] EQT: Loaded 54075 existing records from primary storage. [2025-10-17T18:45:12.188227] [INFO ] [MAIN ] EQT: Loaded 54075 existing records. [2025-10-17T18:45:12.361219] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:12.361421] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-17T18:45:12.361472] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-17T18:45:12.361696] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-17T18:45:12.361754] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-17T18:45:12.709364] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:12.757982] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-17T18:45:13.558030] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-17T18:45:13.917041] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T18:45:14.358040] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-17T18:45:14.867810] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T18:45:14.991819] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T18:45:15.157993] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-17T18:45:15.958001] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-17T18:45:16.379989] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:45:16.611890] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T18:45:16.758056] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-17T18:45:17.558040] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-17T18:45:17.728965] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T18:45:18.358013] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-17T18:45:18.639584] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:45:19.158007] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-17T18:45:19.367163] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T18:45:19.958015] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-17T18:45:20.199537] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:45:20.758007] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-17T18:45:20.885378] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:45:21.558006] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-17T18:45:21.974682] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:45:22.149309] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T18:45:22.358047] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-17T18:45:23.158012] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-17T18:45:23.534724] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T18:45:23.958048] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-17T18:45:24.136115] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:45:24.757998] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-17T18:45:25.254281] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T18:45:25.558015] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-17T18:45:26.087719] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T18:45:26.094988] [INFO ] [REMOTE ] EQNR: Full fetch complete (77006 records). [2025-10-17T18:45:26.095115] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-17T18:45:26.365617] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-17T18:45:26.496779] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-17T18:45:26.496965] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-17T18:45:26.498047] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-17T18:45:26.498135] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-17T18:45:26.528505] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T18:45:26.527026] [DEBUG] [LOCAL ] EQNR: Trimmed 77006 records to 53821 (keeping 200 days of data) [2025-10-17T18:45:26.861497] [DEBUG] [LOCAL ] EQNR: Primary data saved (53821 records). [2025-10-17T18:45:26.861636] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-17T18:45:26.861762] [INFO ] [MAIN ] Update Progress: 757/2368 symbols completed. EQNR took 38.3s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-17T18:45:27.158073] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-17T18:45:27.522801] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T18:45:27.958033] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-17T18:45:28.195832] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T18:45:28.686220] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T18:45:28.693892] [INFO ] [REMOTE ] EQH: Full fetch complete (76633 records). [2025-10-17T18:45:28.694060] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-17T18:45:28.768117] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-17T18:45:29.079872] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-17T18:45:29.079955] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-17T18:45:29.080875] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-17T18:45:29.080941] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-17T18:45:29.082427] [DEBUG] [LOCAL ] EQH: Trimmed 76633 records to 53475 (keeping 200 days of data) [2025-10-17T18:45:29.403826] [DEBUG] [LOCAL ] EQH: Primary data saved (53475 records). [2025-10-17T18:45:29.403972] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-17T18:45:29.404816] [INFO ] [MAIN ] Update Progress: 758/2368 symbols completed. EQH took 45.9s. Estimated remaining: 3h 43m 55s. Rate: 7.2 symbols/min [2025-10-17T18:45:29.763776] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:45:29.776254] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-17T18:45:30.719705] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:45:30.733086] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-17T18:45:31.544418] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T18:45:31.555470] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-17T18:45:32.668062] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T18:45:32.676457] [INFO ] [REMOTE ] EQR: Full fetch complete (74507 records). [2025-10-17T18:45:32.676684] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-17T18:45:33.060971] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-17T18:45:33.061065] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-17T18:45:33.062069] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-17T18:45:33.062136] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-17T18:45:33.063626] [DEBUG] [LOCAL ] EQR: Trimmed 74507 records to 52498 (keeping 200 days of data) [2025-10-17T18:45:33.388919] [DEBUG] [LOCAL ] EQR: Primary data saved (52498 records). [2025-10-17T18:45:33.389054] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-17T18:45:33.389714] [INFO ] [MAIN ] Update Progress: 759/2368 symbols completed. EQR took 40.0s. Estimated remaining: 3h 43m 38s. Rate: 7.2 symbols/min [2025-10-17T18:45:33.715119] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T18:45:33.727013] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-17T18:45:35.689170] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:45:35.701827] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-17T18:45:37.696554] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:45:37.708011] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-17T18:45:39.873117] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-17T18:45:39.880443] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-17T18:45:39.880562] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-17T18:45:40.274145] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-17T18:45:40.274225] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-17T18:45:40.275133] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-17T18:45:40.275197] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-17T18:45:40.276635] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54465 (keeping 200 days of data) [2025-10-17T18:45:40.603631] [DEBUG] [LOCAL ] EQT: Primary data saved (54465 records). [2025-10-17T18:45:40.603806] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-17T18:45:40.603891] [INFO ] [MAIN ] Update Progress: 760/2368 symbols completed. EQT took 28.6s. Estimated remaining: 3h 43m 27s. Rate: 7.2 symbols/min [2025-10-17T18:45:41.181291] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.303475] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.279484] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.326085] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.330740] [DEBUG] [LOCAL ] EQV: Loaded 2745 existing records from primary storage. [2025-10-17T18:45:41.331277] [INFO ] [MAIN ] EQV: Loaded 2745 existing records. [2025-10-17T18:45:41.557098] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:41.569419] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-17T18:45:41.570488] [DEBUG] [LOCAL ] ERO: Loaded 42256 existing records from primary storage. [2025-10-17T18:45:41.570703] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-17T18:45:41.571099] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-17T18:45:41.571061] [INFO ] [MAIN ] ERO: Loaded 42256 existing records. [2025-10-17T18:45:41.576732] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-17T18:45:41.789336] [DEBUG] [LOCAL ] ERJ: Loaded 50694 existing records from primary storage. [2025-10-17T18:45:41.830553] [INFO ] [MAIN ] ERJ: Loaded 50694 existing records. [2025-10-17T18:45:41.997433] [DEBUG] [LOCAL ] ES: Loaded 53077 existing records from primary storage. [2025-10-17T18:45:42.025059] [INFO ] [MAIN ] ES: Loaded 53077 existing records. [2025-10-17T18:45:42.169321] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:42.381100] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-17T18:45:42.396622] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:42.409079] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-17T18:45:42.409869] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-17T18:45:42.418747] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-17T18:45:42.453325] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-17T18:45:42.463669] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-17T18:45:42.496118] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:42.489367] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-17T18:45:42.507080] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-17T18:45:42.496297] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-17T18:45:42.701765] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:42.736735] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-17T18:45:42.788854] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-17T18:45:42.805561] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-17T18:45:42.815996] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-17T18:45:43.616586] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:43.583504] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T18:45:43.637690] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-17T18:45:43.640830] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:43.653246] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-17T18:45:43.653533] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-17T18:45:43.736811] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:43.737089] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-17T18:45:44.468020] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:45:44.470684] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-17T18:45:45.231096] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:45:45.233067] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-17T18:45:45.261065] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:45:45.269968] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-17T18:45:45.453022] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T18:45:45.464074] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-17T18:45:45.571891] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T18:45:45.580958] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-17T18:45:45.607126] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T18:45:45.608452] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-17T18:45:46.086012] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T18:45:46.087370] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-17T18:45:46.660234] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T18:45:46.662897] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-17T18:45:46.662620] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T18:45:46.671394] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-17T18:45:47.207166] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:45:47.217100] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-17T18:45:47.246107] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:45:47.257199] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-17T18:45:47.320065] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:45:47.321627] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-17T18:45:47.799462] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T18:45:47.893967] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:45:47.958070] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-17T18:45:48.528887] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T18:45:48.757992] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-17T18:45:48.902447] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:45:49.037470] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T18:45:49.558079] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-17T18:45:50.358010] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-17T18:45:50.617859] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:45:51.017454] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T18:45:51.158031] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-17T18:45:51.345878] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T18:45:51.958047] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-17T18:45:52.461286] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-17T18:45:52.721079] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:45:52.757991] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-17T18:45:53.558023] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-17T18:45:54.085044] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T18:45:54.086219] [INFO ] [REMOTE ] EQV: Full fetch complete (5135 records). [2025-10-17T18:45:54.086303] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-17T18:45:54.086818] [FATAL] [VALIDATOR ] EQV: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:45:54.086929] [FATAL] [MAIN ] EQV: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:45:54.086983] [WARN ] [MAIN ] EQV: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:45:54.087035] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-17T18:45:54.087106] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-10-17T18:45:54.087152] [INFO ] [LOCAL ] EQV: Starting deletion of derivative data. [2025-10-17T18:45:54.087382] [DEBUG] [LOCAL ] EQV: Deleted derivative data file. [2025-10-17T18:45:54.087493] [INFO ] [MAIN ] Update Progress: 761/2368 symbols completed. EQV took 13.5s. Estimated remaining: 3h 43m 30s. Rate: 7.2 symbols/min [2025-10-17T18:45:54.272300] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:54.303838] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:45:54.342273] [DEBUG] [LOCAL ] ESAB: Loaded 26243 existing records from primary storage. [2025-10-17T18:45:54.342626] [INFO ] [MAIN ] ESAB: Loaded 26243 existing records. [2025-10-17T18:45:54.363171] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-17T18:45:54.520334] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:54.520544] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-17T18:45:54.520591] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-17T18:45:54.520826] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-17T18:45:54.520883] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-17T18:45:54.874676] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:55.158041] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-17T18:45:55.953119] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:45:55.960923] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-17T18:45:56.758058] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-17T18:45:57.171488] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T18:45:57.318601] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T18:45:57.558037] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-17T18:45:58.358010] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-17T18:45:58.387566] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T18:45:59.158078] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-17T18:45:59.306083] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:45:59.957992] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-17T18:46:00.037888] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T18:46:00.187453] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:46:00.758010] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-17T18:46:01.506111] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:46:01.558036] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-17T18:46:02.358029] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-17T18:46:03.158055] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-17T18:46:04.071685] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T18:46:04.082139] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-17T18:46:04.509716] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (3.75 seconds). [2025-10-17T18:46:04.746367] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T18:46:04.758624] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-17T18:46:05.558037] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-17T18:46:05.966745] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T18:46:06.056272] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T18:46:06.358028] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-17T18:46:06.744792] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (5.19 seconds). [2025-10-17T18:46:07.158020] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-17T18:46:07.452160] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:46:07.459133] [INFO ] [REMOTE ] ERO: Full fetch complete (60475 records). [2025-10-17T18:46:07.459254] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-17T18:46:07.862394] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-17T18:46:07.862506] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-17T18:46:07.863509] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-17T18:46:07.863634] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-17T18:46:07.865252] [DEBUG] [LOCAL ] ERO: Trimmed 60475 records to 42618 (keeping 200 days of data) [2025-10-17T18:46:07.952529] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:46:07.978621] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-17T18:46:08.167971] [DEBUG] [LOCAL ] ERO: Primary data saved (42618 records). [2025-10-17T18:46:08.168123] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-17T18:46:08.168286] [INFO ] [MAIN ] Update Progress: 762/2368 symbols completed. ERO took 27.6s. Estimated remaining: 3h 43m 33s. Rate: 7.2 symbols/min [2025-10-17T18:46:08.340700] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:08.357927] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:46:08.378009] [DEBUG] [LOCAL ] ESE: Loaded 16630 existing records from primary storage. [2025-10-17T18:46:08.378242] [INFO ] [MAIN ] ESE: Loaded 16630 existing records. [2025-10-17T18:46:08.552617] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:08.552875] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-17T18:46:08.552924] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-17T18:46:08.553192] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-17T18:46:08.553250] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-17T18:46:08.763835] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-17T18:46:08.922557] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:09.558055] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-17T18:46:09.698259] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:46:09.927043] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T18:46:10.358019] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-17T18:46:10.576237] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T18:46:11.158068] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-17T18:46:11.957999] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-17T18:46:12.042250] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:46:12.214362] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T18:46:12.758108] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-17T18:46:13.558033] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-17T18:46:13.772479] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T18:46:13.835327] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T18:46:14.095343] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T18:46:14.358034] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-17T18:46:15.158102] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-17T18:46:15.901228] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T18:46:15.958021] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-17T18:46:16.194498] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T18:46:16.758085] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-17T18:46:17.046030] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:46:17.558063] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-17T18:46:17.785602] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T18:46:18.358080] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-17T18:46:19.158008] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-17T18:46:19.273744] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:46:19.958036] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-17T18:46:20.142242] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T18:46:20.164311] [INFO ] [REMOTE ] ERJ: Full fetch complete (72889 records). [2025-10-17T18:46:20.165231] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T18:46:20.165382] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-17T18:46:20.562887] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-17T18:46:20.562987] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-17T18:46:20.563922] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-17T18:46:20.563988] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-17T18:46:20.566100] [DEBUG] [LOCAL ] ERJ: Trimmed 72889 records to 51052 (keeping 200 days of data) [2025-10-17T18:46:20.778515] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-17T18:46:20.886247] [DEBUG] [LOCAL ] ERJ: Primary data saved (51052 records). [2025-10-17T18:46:20.886373] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-17T18:46:20.887323] [INFO ] [MAIN ] Update Progress: 763/2368 symbols completed. ERJ took 40.3s. Estimated remaining: 3h 43m 34s. Rate: 7.2 symbols/min [2025-10-17T18:46:21.070902] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:21.127144] [DEBUG] [LOCAL ] ESI: Loaded 51027 existing records from primary storage. [2025-10-17T18:46:21.127505] [INFO ] [MAIN ] ESI: Loaded 51027 existing records. [2025-10-17T18:46:21.312447] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:21.312812] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-17T18:46:21.312897] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-17T18:46:21.324419] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-17T18:46:21.324586] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-17T18:46:21.400545] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T18:46:21.431616] [INFO ] [REMOTE ] ESAB: Full fetch complete (36250 records). [2025-10-17T18:46:21.437546] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-17T18:46:21.574066] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-17T18:46:22.001764] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:22.087761] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-17T18:46:22.087828] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-17T18:46:22.088399] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-17T18:46:22.088439] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-17T18:46:22.089281] [DEBUG] [LOCAL ] ESAB: Trimmed 36250 records to 26444 (keeping 200 days of data) [2025-10-17T18:46:22.255569] [DEBUG] [LOCAL ] ESAB: Primary data saved (26444 records). [2025-10-17T18:46:22.255761] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-17T18:46:22.255943] [INFO ] [MAIN ] Update Progress: 764/2368 symbols completed. ESAB took 28.2s. Estimated remaining: 3h 43m 11s. Rate: 7.2 symbols/min [2025-10-17T18:46:22.368324] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-17T18:46:22.434259] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:22.470034] [DEBUG] [LOCAL ] ESNT: Loaded 38566 existing records from primary storage. [2025-10-17T18:46:22.470319] [INFO ] [MAIN ] ESNT: Loaded 38566 existing records. [2025-10-17T18:46:22.648303] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:22.648761] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-17T18:46:22.648906] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-17T18:46:22.649202] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-17T18:46:22.649290] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-17T18:46:22.787992] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T18:46:22.804168] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T18:46:23.049348] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:23.157988] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-17T18:46:23.958006] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-17T18:46:24.005280] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T18:46:24.613783] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T18:46:24.657591] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T18:46:24.757995] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-17T18:46:25.558007] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-17T18:46:25.710178] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:46:25.717601] [INFO ] [REMOTE ] ES: Full fetch complete (76473 records). [2025-10-17T18:46:25.717815] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-17T18:46:26.115928] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-17T18:46:26.116021] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-17T18:46:26.116956] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-17T18:46:26.117020] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-17T18:46:26.118717] [DEBUG] [LOCAL ] ES: Trimmed 76473 records to 53462 (keeping 200 days of data) [2025-10-17T18:46:26.358195] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-17T18:46:26.450290] [DEBUG] [LOCAL ] ES: Primary data saved (53462 records). [2025-10-17T18:46:26.450414] [INFO ] [MAIN ] ES: Full history saved. [2025-10-17T18:46:26.451261] [INFO ] [MAIN ] Update Progress: 765/2368 symbols completed. ES took 45.8s. Estimated remaining: 3h 42m 54s. Rate: 7.2 symbols/min [2025-10-17T18:46:26.616467] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:26.658312] [DEBUG] [LOCAL ] ESRT: Loaded 46834 existing records from primary storage. [2025-10-17T18:46:26.658714] [INFO ] [MAIN ] ESRT: Loaded 46834 existing records. [2025-10-17T18:46:26.831058] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:26.831247] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-17T18:46:26.831317] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-17T18:46:26.831683] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-17T18:46:26.831753] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-17T18:46:27.185912] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:27.158675] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-17T18:46:27.223501] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:46:27.830932] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:46:27.958053] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-17T18:46:28.393156] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T18:46:28.758144] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-17T18:46:29.405501] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T18:46:29.558012] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-17T18:46:29.814726] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:46:30.358030] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-17T18:46:31.105576] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:46:31.157994] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-17T18:46:31.958006] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-17T18:46:32.008225] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:46:32.696076] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T18:46:32.757991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-17T18:46:32.970348] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T18:46:33.558024] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-17T18:46:34.272130] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:46:34.357991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-17T18:46:35.158074] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-17T18:46:35.201588] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:46:35.958104] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-17T18:46:36.345393] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T18:46:36.655413] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:46:36.658090] [INFO ] [REMOTE ] ESE: Full fetch complete (22765 records). [2025-10-17T18:46:36.658190] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-17T18:46:36.758434] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-17T18:46:37.040369] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-17T18:46:37.052294] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-17T18:46:37.058168] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-17T18:46:37.068286] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-17T18:46:37.074225] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T18:46:37.083794] [DEBUG] [LOCAL ] ESE: Trimmed 22765 records to 16777 (keeping 200 days of data) [2025-10-17T18:46:37.190289] [DEBUG] [LOCAL ] ESE: Primary data saved (16777 records). [2025-10-17T18:46:37.190420] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-17T18:46:37.190521] [INFO ] [MAIN ] Update Progress: 766/2368 symbols completed. ESE took 29.0s. Estimated remaining: 3h 42m 51s. Rate: 7.2 symbols/min [2025-10-17T18:46:37.357579] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:37.388301] [DEBUG] [LOCAL ] ESS: Loaded 30383 existing records from primary storage. [2025-10-17T18:46:37.388560] [INFO ] [MAIN ] ESS: Loaded 30383 existing records. [2025-10-17T18:46:37.559147] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-17T18:46:37.562799] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:37.564173] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-17T18:46:37.564243] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-17T18:46:37.564532] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-17T18:46:37.564588] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-17T18:46:37.912511] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:38.358027] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-17T18:46:38.416429] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:46:38.605193] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:46:39.158050] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-17T18:46:39.958007] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-17T18:46:40.126476] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:46:40.643467] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T18:46:40.757991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-17T18:46:41.070794] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T18:46:41.558026] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-17T18:46:42.300793] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T18:46:42.358003] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-17T18:46:43.075218] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:46:43.158034] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-17T18:46:43.960375] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-17T18:46:43.965698] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:46:44.644355] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:46:44.758029] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-17T18:46:45.558086] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-17T18:46:45.757539] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:46:46.103376] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T18:46:46.358083] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-17T18:46:47.158048] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-17T18:46:47.384281] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:46:47.907493] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:46:47.958067] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-17T18:46:48.468265] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:46:48.758059] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-17T18:46:49.492837] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T18:46:49.558005] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-17T18:46:50.255283] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:46:50.358077] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-17T18:46:51.119926] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:46:51.158026] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-17T18:46:51.781202] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T18:46:51.958032] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-17T18:46:52.758027] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-17T18:46:52.852833] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:46:53.518725] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:46:53.558001] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-17T18:46:54.175950] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T18:46:54.181711] [INFO ] [REMOTE ] ESNT: Full fetch complete (57231 records). [2025-10-17T18:46:54.181846] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-17T18:46:54.363981] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-17T18:46:54.581511] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-17T18:46:54.581614] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-17T18:46:54.582467] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-17T18:46:54.582534] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-17T18:46:54.583852] [DEBUG] [LOCAL ] ESNT: Trimmed 57231 records to 38819 (keeping 200 days of data) [2025-10-17T18:46:54.821606] [DEBUG] [LOCAL ] ESNT: Primary data saved (38819 records). [2025-10-17T18:46:54.821799] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-17T18:46:54.821902] [INFO ] [MAIN ] Update Progress: 767/2368 symbols completed. ESNT took 32.6s. Estimated remaining: 3h 43m 2s. Rate: 7.2 symbols/min [2025-10-17T18:46:54.994168] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:55.042259] [DEBUG] [LOCAL ] ESTC: Loaded 50722 existing records from primary storage. [2025-10-17T18:46:55.042587] [INFO ] [MAIN ] ESTC: Loaded 50722 existing records. [2025-10-17T18:46:55.158765] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-17T18:46:55.223896] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:55.240901] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-17T18:46:55.242092] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T18:46:55.242350] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-17T18:46:55.248884] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-17T18:46:55.248982] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-17T18:46:55.254227] [INFO ] [REMOTE ] ESRT: Full fetch complete (66604 records). [2025-10-17T18:46:55.292207] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-17T18:46:56.007677] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:56.049702] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-17T18:46:56.072795] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-17T18:46:56.072946] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-17T18:46:56.074029] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-17T18:46:56.074121] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-17T18:46:56.076265] [DEBUG] [LOCAL ] ESRT: Trimmed 66604 records to 47197 (keeping 200 days of data) [2025-10-17T18:46:56.330161] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:46:56.426201] [DEBUG] [LOCAL ] ESRT: Primary data saved (47197 records). [2025-10-17T18:46:56.426489] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-17T18:46:56.427531] [INFO ] [MAIN ] Update Progress: 768/2368 symbols completed. ESRT took 30.0s. Estimated remaining: 3h 42m 39s. Rate: 7.2 symbols/min [2025-10-17T18:46:56.624027] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:56.690823] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-17T18:46:56.691271] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-10-17T18:46:56.767545] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-17T18:46:56.881600] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:56.882259] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-17T18:46:56.882434] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-17T18:46:56.893146] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-17T18:46:56.906258] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-17T18:46:56.975102] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T18:46:57.271428] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:57.558011] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-17T18:46:57.895701] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T18:46:57.929207] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:46:58.358047] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-17T18:46:59.158066] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-17T18:46:59.559611] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:46:59.970728] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-17T18:46:59.998196] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-17T18:47:00.758038] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-17T18:47:01.468259] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-17T18:47:01.558015] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-17T18:47:02.044614] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T18:47:02.358096] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-17T18:47:03.158115] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-17T18:47:03.798848] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-17T18:47:03.957997] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-17T18:47:04.182192] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:47:04.388098] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-17T18:47:04.758021] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-17T18:47:05.056616] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T18:47:05.064860] [INFO ] [REMOTE ] ESI: Full fetch complete (73196 records). [2025-10-17T18:47:05.065085] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-17T18:47:05.472859] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-17T18:47:05.473004] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-17T18:47:05.474226] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-17T18:47:05.474297] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-17T18:47:05.476328] [DEBUG] [LOCAL ] ESI: Trimmed 73196 records to 51407 (keeping 200 days of data) [2025-10-17T18:47:05.573464] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-17T18:47:05.812396] [DEBUG] [LOCAL ] ESI: Primary data saved (51407 records). [2025-10-17T18:47:05.812621] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-17T18:47:05.813890] [INFO ] [MAIN ] Update Progress: 769/2368 symbols completed. ESI took 44.9s. Estimated remaining: 3h 42m 33s. Rate: 7.2 symbols/min [2025-10-17T18:47:05.990843] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:06.037199] [DEBUG] [LOCAL ] ETB: Loaded 12026 existing records from primary storage. [2025-10-17T18:47:06.040113] [INFO ] [MAIN ] ETB: Loaded 12026 existing records. [2025-10-17T18:47:06.039880] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T18:47:06.124896] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:47:06.293227] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:06.293443] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-17T18:47:06.293490] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-17T18:47:06.293689] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-17T18:47:06.293745] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-17T18:47:06.367168] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-17T18:47:06.644404] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:07.158104] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-17T18:47:07.243130] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:47:07.710454] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T18:47:07.958030] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-17T18:47:08.161303] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T18:47:08.758040] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-17T18:47:09.558047] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-17T18:47:09.709105] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T18:47:10.172920] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T18:47:10.177411] [INFO ] [REMOTE ] ESS: Full fetch complete (43707 records). [2025-10-17T18:47:10.177513] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-17T18:47:10.366167] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-17T18:47:10.396935] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:47:10.580713] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-17T18:47:10.580809] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-17T18:47:10.581575] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-17T18:47:10.581619] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-17T18:47:10.582505] [DEBUG] [LOCAL ] ESS: Trimmed 43707 records to 30619 (keeping 200 days of data) [2025-10-17T18:47:10.767813] [DEBUG] [LOCAL ] ESS: Primary data saved (30619 records). [2025-10-17T18:47:10.767951] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-17T18:47:10.768033] [INFO ] [MAIN ] Update Progress: 770/2368 symbols completed. ESS took 33.6s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-10-17T18:47:10.931120] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:10.956695] [DEBUG] [LOCAL ] ETD: Loaded 27518 existing records from primary storage. [2025-10-17T18:47:10.956951] [INFO ] [MAIN ] ETD: Loaded 27518 existing records. [2025-10-17T18:47:11.127849] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:11.128073] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-17T18:47:11.128120] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-17T18:47:11.128308] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-17T18:47:11.128364] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-17T18:47:11.163972] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-17T18:47:11.475628] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:11.958039] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-17T18:47:12.221681] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:47:12.758026] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-17T18:47:13.081567] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:47:13.511847] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-17T18:47:13.558030] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-17T18:47:14.358136] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-17T18:47:14.561469] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T18:47:14.619834] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T18:47:15.158025] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-17T18:47:15.958040] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-17T18:47:16.718053] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T18:47:16.758005] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-17T18:47:17.004245] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:47:17.032449] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T18:47:17.558037] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-17T18:47:18.358038] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-17T18:47:18.614983] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:47:19.085748] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T18:47:19.157999] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-17T18:47:19.723855] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:47:19.958042] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-17T18:47:20.758127] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-17T18:47:21.326720] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-17T18:47:21.558030] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-17T18:47:21.867240] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:47:21.917618] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:47:22.358016] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-17T18:47:23.158004] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-17T18:47:23.304617] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T18:47:23.921595] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T18:47:23.957995] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-17T18:47:24.164605] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T18:47:24.758103] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-17T18:47:25.020783] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T18:47:25.558016] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-17T18:47:26.075892] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T18:47:26.358032] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-17T18:47:27.158032] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-17T18:47:27.435390] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T18:47:27.442687] [INFO ] [REMOTE ] ESTC: Full fetch complete (72477 records). [2025-10-17T18:47:27.442806] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-17T18:47:27.831731] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-17T18:47:27.831814] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-17T18:47:27.832821] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-17T18:47:27.832885] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-17T18:47:27.834210] [DEBUG] [LOCAL ] ESTC: Trimmed 72477 records to 51091 (keeping 200 days of data) [2025-10-17T18:47:27.995385] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-17T18:47:28.123192] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T18:47:28.146948] [DEBUG] [LOCAL ] ESTC: Primary data saved (51091 records). [2025-10-17T18:47:28.147093] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-17T18:47:28.147180] [INFO ] [MAIN ] Update Progress: 771/2368 symbols completed. ESTC took 33.3s. Estimated remaining: 3h 42m 28s. Rate: 7.2 symbols/min [2025-10-17T18:47:28.315485] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:28.332721] [DEBUG] [LOCAL ] ETG: Loaded 16789 existing records from primary storage. [2025-10-17T18:47:28.333032] [INFO ] [MAIN ] ETG: Loaded 16789 existing records. [2025-10-17T18:47:28.512614] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:28.512884] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-17T18:47:28.513050] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-17T18:47:28.513322] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-17T18:47:28.513430] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-17T18:47:28.758218] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-17T18:47:28.822439] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-17T18:47:28.913415] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:29.203616] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:47:29.558019] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-17T18:47:29.604823] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T18:47:30.358087] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-17T18:47:31.158062] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-17T18:47:31.691131] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T18:47:31.878778] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-17T18:47:31.905611] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:47:31.958036] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-17T18:47:32.757997] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-17T18:47:33.211328] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:47:33.535096] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T18:47:33.557976] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-17T18:47:34.313906] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T18:47:34.358047] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-17T18:47:35.127758] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:47:35.157989] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-17T18:47:35.958097] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-17T18:47:36.205322] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T18:47:36.207687] [INFO ] [REMOTE ] ETB: Full fetch complete (18279 records). [2025-10-17T18:47:36.207762] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-17T18:47:36.557437] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-17T18:47:36.557510] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-17T18:47:36.557881] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-17T18:47:36.557945] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-17T18:47:36.558470] [DEBUG] [LOCAL ] ETB: Trimmed 18279 records to 12085 (keeping 200 days of data) [2025-10-17T18:47:36.636203] [DEBUG] [LOCAL ] ETB: Primary data saved (12085 records). [2025-10-17T18:47:36.636313] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-17T18:47:36.636394] [INFO ] [MAIN ] Update Progress: 772/2368 symbols completed. ETB took 30.8s. Estimated remaining: 3h 42m 20s. Rate: 7.2 symbols/min [2025-10-17T18:47:36.772850] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-17T18:47:36.806110] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:36.823274] [DEBUG] [LOCAL ] ETJ: Loaded 16898 existing records from primary storage. [2025-10-17T18:47:36.823551] [INFO ] [MAIN ] ETJ: Loaded 16898 existing records. [2025-10-17T18:47:36.998808] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:36.999041] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-17T18:47:36.999088] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-17T18:47:36.999279] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-17T18:47:36.999334] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-17T18:47:37.345087] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:37.558025] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-17T18:47:37.963816] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T18:47:38.114627] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T18:47:38.122238] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-17T18:47:38.122369] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-17T18:47:38.363162] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-17T18:47:38.525972] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-17T18:47:38.526082] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-17T18:47:38.527141] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-17T18:47:38.527220] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-17T18:47:38.528731] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54569 (keeping 200 days of data) [2025-10-17T18:47:38.636243] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T18:47:38.892976] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-17T18:47:38.893162] [INFO ] [MAIN ] ET: Full history saved. [2025-10-17T18:47:38.893743] [INFO ] [MAIN ] Update Progress: 773/2368 symbols completed. ET took 42.5s. Estimated remaining: 3h 41m 59s. Rate: 7.2 symbols/min [2025-10-17T18:47:39.071513] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:39.122270] [DEBUG] [LOCAL ] ETN: Loaded 53020 existing records from primary storage. [2025-10-17T18:47:39.122578] [INFO ] [MAIN ] ETN: Loaded 53020 existing records. [2025-10-17T18:47:39.164743] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-17T18:47:39.305285] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:39.305515] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-17T18:47:39.305563] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-17T18:47:39.305823] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-17T18:47:39.305881] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-17T18:47:39.661566] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:39.816715] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T18:47:39.958001] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-17T18:47:40.042945] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:47:40.758025] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-17T18:47:41.558065] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-17T18:47:41.727620] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:47:41.885697] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T18:47:42.233448] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T18:47:42.358009] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-17T18:47:43.158036] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-17T18:47:43.421988] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:47:43.879202] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:47:43.958013] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-17T18:47:44.758073] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-17T18:47:44.884883] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T18:47:45.558086] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-17T18:47:46.053845] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:47:46.057817] [INFO ] [REMOTE ] ETD: Full fetch complete (38664 records). [2025-10-17T18:47:46.057918] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-17T18:47:46.363114] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-17T18:47:46.434256] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-17T18:47:46.434329] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-17T18:47:46.434938] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-17T18:47:46.435002] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-17T18:47:46.435826] [DEBUG] [LOCAL ] ETD: Trimmed 38664 records to 27663 (keeping 200 days of data) [2025-10-17T18:47:46.556943] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T18:47:46.624708] [DEBUG] [LOCAL ] ETD: Primary data saved (27663 records). [2025-10-17T18:47:46.624832] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-17T18:47:46.624910] [INFO ] [MAIN ] Update Progress: 774/2368 symbols completed. ETD took 35.9s. Estimated remaining: 3h 41m 49s. Rate: 7.2 symbols/min [2025-10-17T18:47:46.790071] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:46.798705] [DEBUG] [LOCAL ] ETO: Loaded 7024 existing records from primary storage. [2025-10-17T18:47:46.798884] [INFO ] [MAIN ] ETO: Loaded 7024 existing records. [2025-10-17T18:47:46.970007] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:46.970166] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-17T18:47:46.970215] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-17T18:47:46.970370] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-17T18:47:46.970429] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-17T18:47:47.166509] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-17T18:47:47.322190] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:47.958026] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-17T18:47:48.260846] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T18:47:48.423350] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T18:47:48.455396] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T18:47:48.758015] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-17T18:47:49.558037] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-17T18:47:49.762251] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:47:50.358028] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-17T18:47:51.104538] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T18:47:51.157999] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-17T18:47:51.486202] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T18:47:51.790386] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T18:47:51.958059] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-17T18:47:52.758019] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-17T18:47:53.021437] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:47:53.558009] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-17T18:47:53.640631] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T18:47:54.358084] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-17T18:47:54.386814] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T18:47:55.158038] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-17T18:47:55.958005] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-17T18:47:55.997064] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T18:47:56.414089] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:47:56.478243] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T18:47:56.758002] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-17T18:47:57.558027] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-17T18:47:58.357998] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-17T18:47:58.553235] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T18:47:58.556049] [INFO ] [REMOTE ] ETG: Full fetch complete (24813 records). [2025-10-17T18:47:58.556122] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-17T18:47:58.881326] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T18:47:58.982338] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-17T18:47:58.982489] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-17T18:47:58.983289] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-17T18:47:58.983353] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-17T18:47:58.984027] [DEBUG] [LOCAL ] ETG: Trimmed 24813 records to 16892 (keeping 200 days of data) [2025-10-17T18:47:59.087151] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T18:47:59.127636] [DEBUG] [LOCAL ] ETG: Primary data saved (16892 records). [2025-10-17T18:47:59.127813] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-17T18:47:59.127904] [INFO ] [MAIN ] Update Progress: 775/2368 symbols completed. ETG took 31.0s. Estimated remaining: 3h 41m 50s. Rate: 7.2 symbols/min [2025-10-17T18:47:59.163133] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-17T18:47:59.297183] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:59.346034] [DEBUG] [LOCAL ] ETR: Loaded 53597 existing records from primary storage. [2025-10-17T18:47:59.346384] [INFO ] [MAIN ] ETR: Loaded 53597 existing records. [2025-10-17T18:47:59.519144] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:59.519351] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-17T18:47:59.519398] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-17T18:47:59.519628] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-17T18:47:59.519744] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-17T18:47:59.862135] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:59.957985] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-17T18:48:00.194788] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T18:48:00.758036] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-17T18:48:01.558046] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-17T18:48:02.170516] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T18:48:02.358025] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-17T18:48:02.688021] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:48:03.091140] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T18:48:03.122812] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T18:48:03.157985] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-17T18:48:03.958030] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-17T18:48:04.758001] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-17T18:48:04.953049] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T18:48:04.982471] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T18:48:05.485333] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T18:48:05.558018] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-17T18:48:06.357998] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-17T18:48:06.580180] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:48:06.583036] [INFO ] [REMOTE ] ETJ: Full fetch complete (25646 records). [2025-10-17T18:48:06.583109] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-17T18:48:06.957372] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-17T18:48:06.957453] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-17T18:48:06.958022] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-17T18:48:06.958085] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-17T18:48:06.958710] [DEBUG] [LOCAL ] ETJ: Trimmed 25646 records to 17031 (keeping 200 days of data) [2025-10-17T18:48:07.059206] [DEBUG] [LOCAL ] ETJ: Primary data saved (17031 records). [2025-10-17T18:48:07.059348] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-17T18:48:07.059426] [INFO ] [MAIN ] Update Progress: 776/2368 symbols completed. ETJ took 30.4s. Estimated remaining: 3h 41m 40s. Rate: 7.2 symbols/min [2025-10-17T18:48:07.158407] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-17T18:48:07.172397] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T18:48:07.244436] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:07.293620] [DEBUG] [LOCAL ] ETSY: Loaded 53966 existing records from primary storage. [2025-10-17T18:48:07.293959] [INFO ] [MAIN ] ETSY: Loaded 53966 existing records. [2025-10-17T18:48:07.467032] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:07.467282] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-17T18:48:07.467339] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-17T18:48:07.467573] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-17T18:48:07.467629] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-17T18:48:07.831219] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:07.958018] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-17T18:48:08.758006] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-17T18:48:08.942348] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:48:09.506345] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:48:09.558040] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-17T18:48:09.775349] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:48:10.171113] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T18:48:10.358032] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-17T18:48:10.968015] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T18:48:11.158077] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-17T18:48:11.958067] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-17T18:48:12.758087] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-17T18:48:12.783293] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T18:48:12.785188] [INFO ] [REMOTE ] ETO: Full fetch complete (9735 records). [2025-10-17T18:48:12.785258] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-17T18:48:13.125016] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T18:48:13.212621] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-17T18:48:13.212738] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-17T18:48:13.212992] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-17T18:48:13.213042] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-17T18:48:13.213478] [DEBUG] [LOCAL ] ETO: Trimmed 9735 records to 7052 (keeping 200 days of data) [2025-10-17T18:48:13.258414] [DEBUG] [LOCAL ] ETO: Primary data saved (7052 records). [2025-10-17T18:48:13.258539] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-17T18:48:13.258624] [INFO ] [MAIN ] Update Progress: 777/2368 symbols completed. ETO took 26.6s. Estimated remaining: 3h 41m 28s. Rate: 7.2 symbols/min [2025-10-17T18:48:13.434100] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:13.456388] [DEBUG] [LOCAL ] ETV: Loaded 22403 existing records from primary storage. [2025-10-17T18:48:13.456634] [INFO ] [MAIN ] ETV: Loaded 22403 existing records. [2025-10-17T18:48:13.563184] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-17T18:48:13.631595] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:13.631806] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-17T18:48:13.631853] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-17T18:48:13.632127] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-17T18:48:13.632184] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-17T18:48:13.985248] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:14.358032] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-17T18:48:14.850037] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T18:48:15.158012] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-17T18:48:15.420158] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T18:48:15.893209] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T18:48:15.958004] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-17T18:48:16.757996] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-17T18:48:17.140960] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T18:48:17.467497] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-17T18:48:17.558025] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-17T18:48:18.271793] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:48:18.358039] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-17T18:48:18.954376] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:48:19.158000] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-17T18:48:19.383255] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T18:48:19.958122] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-17T18:48:20.758013] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-17T18:48:21.029464] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:48:21.082400] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T18:48:21.558030] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-17T18:48:22.358047] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-17T18:48:22.673908] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T18:48:23.158078] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-17T18:48:23.391206] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:48:23.958072] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-17T18:48:24.758024] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-17T18:48:24.824246] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-17T18:48:24.831959] [INFO ] [REMOTE ] ETN: Full fetch complete (76648 records). [2025-10-17T18:48:24.832106] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-17T18:48:25.129033] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:48:25.275736] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-17T18:48:25.275825] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-17T18:48:25.276745] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-17T18:48:25.276815] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-17T18:48:25.278437] [DEBUG] [LOCAL ] ETN: Trimmed 76648 records to 53392 (keeping 200 days of data) [2025-10-17T18:48:25.538250] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T18:48:25.558210] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-17T18:48:25.663392] [DEBUG] [LOCAL ] ETN: Primary data saved (53392 records). [2025-10-17T18:48:25.663590] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-17T18:48:25.664324] [INFO ] [MAIN ] Update Progress: 778/2368 symbols completed. ETN took 46.8s. Estimated remaining: 3h 41m 28s. Rate: 7.2 symbols/min [2025-10-17T18:48:25.838763] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:25.868181] [DEBUG] [LOCAL ] ETW: Loaded 25709 existing records from primary storage. [2025-10-17T18:48:25.868449] [INFO ] [MAIN ] ETW: Loaded 25709 existing records. [2025-10-17T18:48:26.064890] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:26.065190] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-17T18:48:26.065273] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-17T18:48:26.065489] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-17T18:48:26.065529] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-17T18:48:26.361796] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-17T18:48:26.421195] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:26.683191] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:48:27.157999] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-17T18:48:27.381521] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:48:27.518318] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T18:48:27.958012] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-17T18:48:28.717181] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T18:48:28.757983] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-17T18:48:29.558010] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-17T18:48:29.888729] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T18:48:30.358076] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-17T18:48:30.431438] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:48:30.927882] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:48:31.158263] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-17T18:48:31.958060] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-17T18:48:32.171983] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T18:48:32.320086] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:48:32.758057] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-17T18:48:33.287238] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T18:48:33.558007] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-17T18:48:33.899128] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:48:34.358036] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-17T18:48:35.133404] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T18:48:35.157981] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-17T18:48:35.958013] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-17T18:48:36.324637] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:48:36.758003] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-17T18:48:36.977019] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:48:37.074236] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T18:48:37.558022] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-17T18:48:38.358072] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-17T18:48:38.491359] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:48:38.499756] [INFO ] [REMOTE ] ETSY: Full fetch complete (77666 records). [2025-10-17T18:48:38.499937] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-17T18:48:38.899253] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-17T18:48:38.899363] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-17T18:48:38.900377] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-17T18:48:38.900488] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-17T18:48:38.902265] [DEBUG] [LOCAL ] ETSY: Trimmed 77666 records to 54353 (keeping 200 days of data) [2025-10-17T18:48:39.116522] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:48:39.159177] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-17T18:48:39.271793] [DEBUG] [LOCAL ] ETSY: Primary data saved (54353 records). [2025-10-17T18:48:39.271933] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-17T18:48:39.272015] [INFO ] [MAIN ] Update Progress: 779/2368 symbols completed. ETSY took 32.2s. Estimated remaining: 3h 41m 30s. Rate: 7.2 symbols/min [2025-10-17T18:48:39.458065] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:39.466149] [DEBUG] [LOCAL ] ETX: Loaded 5276 existing records from primary storage. [2025-10-17T18:48:39.466362] [INFO ] [MAIN ] ETX: Loaded 5276 existing records. [2025-10-17T18:48:39.647349] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:39.647880] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-17T18:48:39.648022] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-17T18:48:39.653522] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-17T18:48:39.662600] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-17T18:48:39.669448] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:48:39.959850] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-17T18:48:40.026945] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:40.047156] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:48:40.758088] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-17T18:48:41.269783] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:48:41.274385] [INFO ] [REMOTE ] ETV: Full fetch complete (32444 records). [2025-10-17T18:48:41.274540] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-17T18:48:41.470476] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T18:48:41.563195] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-17T18:48:41.660001] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-17T18:48:41.660080] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-17T18:48:41.660761] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-17T18:48:41.660828] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-17T18:48:41.661665] [DEBUG] [LOCAL ] ETV: Trimmed 32444 records to 22515 (keeping 200 days of data) [2025-10-17T18:48:41.810675] [DEBUG] [LOCAL ] ETV: Primary data saved (22515 records). [2025-10-17T18:48:41.810813] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-17T18:48:41.810912] [INFO ] [MAIN ] Update Progress: 780/2368 symbols completed. ETV took 28.6s. Estimated remaining: 3h 41m 10s. Rate: 7.2 symbols/min [2025-10-17T18:48:41.982164] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:42.008215] [DEBUG] [LOCAL ] ETY: Loaded 23111 existing records from primary storage. [2025-10-17T18:48:42.008530] [INFO ] [MAIN ] ETY: Loaded 23111 existing records. [2025-10-17T18:48:42.186106] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:42.186314] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-17T18:48:42.186361] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-17T18:48:42.186600] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-17T18:48:42.186694] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-17T18:48:42.368900] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-17T18:48:42.556402] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:42.761363] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T18:48:43.158017] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-17T18:48:43.778526] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:48:43.958026] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-17T18:48:44.342189] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T18:48:44.349734] [INFO ] [REMOTE ] ETR: Full fetch complete (77284 records). [2025-10-17T18:48:44.349855] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-17T18:48:44.733806] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-17T18:48:44.733900] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-17T18:48:44.734807] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-17T18:48:44.734868] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-17T18:48:44.736313] [DEBUG] [LOCAL ] ETR: Trimmed 77284 records to 53984 (keeping 200 days of data) [2025-10-17T18:48:44.791700] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-17T18:48:45.064982] [DEBUG] [LOCAL ] ETR: Primary data saved (53984 records). [2025-10-17T18:48:45.065108] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-17T18:48:45.065185] [INFO ] [MAIN ] Update Progress: 781/2368 symbols completed. ETR took 45.9s. Estimated remaining: 3h 40m 51s. Rate: 7.2 symbols/min [2025-10-17T18:48:45.247933] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:45.249150] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:48:45.272401] [DEBUG] [LOCAL ] EVC: Loaded 18191 existing records from primary storage. [2025-10-17T18:48:45.272669] [INFO ] [MAIN ] EVC: Loaded 18191 existing records. [2025-10-17T18:48:45.459036] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:45.460933] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T18:48:45.461071] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-17T18:48:45.461326] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-17T18:48:45.464054] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-17T18:48:45.464128] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-17T18:48:45.562549] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-17T18:48:45.815919] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:46.024768] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T18:48:46.358027] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-17T18:48:47.158032] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-17T18:48:47.453936] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:48:47.454116] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-17T18:48:47.958070] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-17T18:48:48.758048] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-17T18:48:49.314053] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T18:48:49.533242] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:48:49.557981] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-17T18:48:50.357997] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-17T18:48:50.692697] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T18:48:50.740971] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-17T18:48:51.158034] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-17T18:48:51.958010] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-17T18:48:52.145871] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T18:48:52.758032] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-17T18:48:53.313753] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T18:48:53.539339] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T18:48:53.557986] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-17T18:48:54.122243] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T18:48:54.358059] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-17T18:48:55.158073] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-17T18:48:55.576581] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T18:48:55.958074] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-17T18:48:56.355544] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:48:56.758042] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-17T18:48:57.079795] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T18:48:57.492984] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T18:48:57.557988] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-17T18:48:58.358027] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-17T18:48:58.898954] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:48:59.158057] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-17T18:48:59.709144] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:48:59.958047] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-17T18:49:00.255731] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T18:49:00.758041] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-17T18:49:01.171036] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T18:49:01.558032] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-17T18:49:02.358032] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-17T18:49:02.432435] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:49:02.508010] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T18:49:03.158033] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-17T18:49:03.411022] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T18:49:03.958041] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-17T18:49:04.368826] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:49:04.756634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T18:49:04.759437] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-17T18:49:05.532730] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:49:05.557988] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-17T18:49:06.358011] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-17T18:49:06.648907] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:49:07.052953] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T18:49:07.054338] [INFO ] [REMOTE ] ETX: Full fetch complete (6874 records). [2025-10-17T18:49:07.054406] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-17T18:49:07.163151] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-17T18:49:07.429885] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-17T18:49:07.429966] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-17T18:49:07.430159] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-17T18:49:07.430220] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-17T18:49:07.430598] [DEBUG] [LOCAL ] ETX: Trimmed 6874 records to 5300 (keeping 200 days of data) [2025-10-17T18:49:07.462478] [DEBUG] [LOCAL ] ETX: Primary data saved (5300 records). [2025-10-17T18:49:07.462567] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-17T18:49:07.462672] [INFO ] [MAIN ] Update Progress: 782/2368 symbols completed. ETX took 28.2s. Estimated remaining: 3h 41m 11s. Rate: 7.2 symbols/min [2025-10-17T18:49:07.634570] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:07.668564] [DEBUG] [LOCAL ] EVEX: Loaded 32729 existing records from primary storage. [2025-10-17T18:49:07.668916] [INFO ] [MAIN ] EVEX: Loaded 32729 existing records. [2025-10-17T18:49:07.846098] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:07.846330] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-17T18:49:07.846381] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-17T18:49:07.846592] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-17T18:49:07.846693] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-17T18:49:07.963195] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-17T18:49:08.206238] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:08.385792] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T18:49:08.758059] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-17T18:49:08.782703] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T18:49:09.558043] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-17T18:49:09.773911] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:49:10.358035] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-17T18:49:10.600851] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T18:49:11.158032] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-17T18:49:11.431011] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:49:11.958056] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-17T18:49:12.372361] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:49:12.758043] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-17T18:49:13.317016] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:49:13.321256] [INFO ] [REMOTE ] ETW: Full fetch complete (36792 records). [2025-10-17T18:49:13.321367] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-17T18:49:13.563193] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-17T18:49:13.712733] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-17T18:49:13.712841] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-17T18:49:13.713676] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-17T18:49:13.713848] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-17T18:49:13.714806] [DEBUG] [LOCAL ] ETW: Trimmed 36792 records to 25887 (keeping 200 days of data) [2025-10-17T18:49:13.845442] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:49:13.896665] [DEBUG] [LOCAL ] ETW: Primary data saved (25887 records). [2025-10-17T18:49:13.896811] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-17T18:49:13.896898] [INFO ] [MAIN ] Update Progress: 783/2368 symbols completed. ETW took 48.2s. Estimated remaining: 3h 40m 59s. Rate: 7.2 symbols/min [2025-10-17T18:49:14.068007] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:14.078615] [DEBUG] [LOCAL ] EVF: Loaded 9864 existing records from primary storage. [2025-10-17T18:49:14.078821] [INFO ] [MAIN ] EVF: Loaded 9864 existing records. [2025-10-17T18:49:14.264083] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:14.264310] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-17T18:49:14.264358] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-17T18:49:14.264504] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-17T18:49:14.264541] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-17T18:49:14.364618] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-17T18:49:14.673619] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:14.786190] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T18:49:14.790348] [INFO ] [REMOTE ] ETY: Full fetch complete (34233 records). [2025-10-17T18:49:14.790469] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-17T18:49:15.168086] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-17T18:49:15.191670] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-17T18:49:15.192804] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-17T18:49:15.193496] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-17T18:49:15.193560] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-17T18:49:15.194479] [DEBUG] [LOCAL ] ETY: Trimmed 34233 records to 23210 (keeping 200 days of data) [2025-10-17T18:49:15.342102] [DEBUG] [LOCAL ] ETY: Primary data saved (23210 records). [2025-10-17T18:49:15.342233] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-17T18:49:15.342312] [INFO ] [MAIN ] Update Progress: 784/2368 symbols completed. ETY took 33.5s. Estimated remaining: 3h 40m 37s. Rate: 7.2 symbols/min [2025-10-17T18:49:15.542950] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T18:49:15.542467] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:15.555095] [DEBUG] [LOCAL ] EVG: Loaded 5979 existing records from primary storage. [2025-10-17T18:49:15.555324] [INFO ] [MAIN ] EVG: Loaded 5979 existing records. [2025-10-17T18:49:15.726098] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:15.726284] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-17T18:49:15.726329] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-17T18:49:15.726521] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-17T18:49:15.726575] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-17T18:49:15.963274] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-17T18:49:16.073007] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:16.437681] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T18:49:16.565926] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:49:16.757998] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-17T18:49:17.557999] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-17T18:49:17.759392] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T18:49:17.761855] [INFO ] [REMOTE ] EVC: Full fetch complete (28841 records). [2025-10-17T18:49:17.761930] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-17T18:49:18.118956] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-17T18:49:18.119040] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-17T18:49:18.119594] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-17T18:49:18.119633] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-17T18:49:18.120400] [DEBUG] [LOCAL ] EVC: Trimmed 28841 records to 18307 (keeping 200 days of data) [2025-10-17T18:49:18.226177] [DEBUG] [LOCAL ] EVC: Primary data saved (18307 records). [2025-10-17T18:49:18.226311] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-17T18:49:18.226393] [INFO ] [MAIN ] Update Progress: 785/2368 symbols completed. EVC took 33.2s. Estimated remaining: 3h 40m 17s. Rate: 7.2 symbols/min [2025-10-17T18:49:18.310924] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T18:49:18.363234] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-17T18:49:18.411097] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:18.454614] [DEBUG] [LOCAL ] EVH: Loaded 49986 existing records from primary storage. [2025-10-17T18:49:18.454986] [INFO ] [MAIN ] EVH: Loaded 49986 existing records. [2025-10-17T18:49:18.630978] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:18.631259] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-17T18:49:18.631317] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-17T18:49:18.631494] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-17T18:49:18.631532] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-17T18:49:18.978490] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:19.158039] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-17T18:49:19.540322] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T18:49:19.760598] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T18:49:19.958019] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-17T18:49:20.758007] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-17T18:49:21.033710] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:49:21.558005] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-17T18:49:21.687429] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T18:49:22.123691] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T18:49:22.358017] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-17T18:49:22.961311] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T18:49:23.158045] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-17T18:49:23.958105] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-17T18:49:23.983672] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T18:49:24.758027] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-17T18:49:25.558038] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-17T18:49:25.637564] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T18:49:25.672297] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T18:49:26.169672] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T18:49:26.358068] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-17T18:49:27.024794] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T18:49:27.158062] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-17T18:49:27.958021] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-17T18:49:28.419755] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:49:28.758064] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-17T18:49:29.558058] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-17T18:49:29.599899] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:49:30.304725] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T18:49:30.340860] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T18:49:30.357977] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-17T18:49:31.158024] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-17T18:49:31.953861] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T18:49:31.961929] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-17T18:49:32.663005] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T18:49:32.689971] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T18:49:32.758081] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-17T18:49:33.558037] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-17T18:49:34.348573] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T18:49:34.358002] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-17T18:49:34.416724] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:49:34.967564] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T18:49:35.158058] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-17T18:49:35.899444] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T18:49:35.958035] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-17T18:49:36.681333] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T18:49:36.757991] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-17T18:49:37.558002] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-17T18:49:38.357999] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-17T18:49:38.424449] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:49:38.792480] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T18:49:39.158015] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-17T18:49:39.402134] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:49:39.408757] [INFO ] [REMOTE ] EVEX: Full fetch complete (43670 records). [2025-10-17T18:49:39.408842] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-17T18:49:39.781930] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-17T18:49:39.782007] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-17T18:49:39.782669] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-17T18:49:39.782731] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-17T18:49:39.783696] [DEBUG] [LOCAL ] EVEX: Trimmed 43670 records to 33091 (keeping 200 days of data) [2025-10-17T18:49:39.963182] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-17T18:49:39.989413] [DEBUG] [LOCAL ] EVEX: Primary data saved (33091 records). [2025-10-17T18:49:39.989575] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-17T18:49:39.990590] [INFO ] [MAIN ] Update Progress: 786/2368 symbols completed. EVEX took 32.5s. Estimated remaining: 3h 40m 36s. Rate: 7.2 symbols/min [2025-10-17T18:49:40.160636] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:40.174613] [DEBUG] [LOCAL ] EVN: Loaded 10839 existing records from primary storage. [2025-10-17T18:49:40.174875] [INFO ] [MAIN ] EVN: Loaded 10839 existing records. [2025-10-17T18:49:40.358057] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:40.358293] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-17T18:49:40.358340] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-17T18:49:40.358496] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-17T18:49:40.358533] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-17T18:49:40.722508] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:40.757990] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-17T18:49:40.997871] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:49:40.999256] [INFO ] [REMOTE ] EVG: Full fetch complete (8176 records). [2025-10-17T18:49:40.999326] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-17T18:49:41.389166] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-17T18:49:41.391237] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T18:49:41.389598] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-17T18:49:41.401514] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-17T18:49:41.401706] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-17T18:49:41.402765] [DEBUG] [LOCAL ] EVG: Trimmed 8176 records to 6021 (keeping 200 days of data) [2025-10-17T18:49:41.437669] [DEBUG] [LOCAL ] EVG: Primary data saved (6021 records). [2025-10-17T18:49:41.437746] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-17T18:49:41.437818] [INFO ] [MAIN ] Update Progress: 787/2368 symbols completed. EVG took 26.1s. Estimated remaining: 3h 40m 14s. Rate: 7.2 symbols/min [2025-10-17T18:49:41.562862] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-17T18:49:41.607425] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:41.617099] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T18:49:41.651366] [DEBUG] [LOCAL ] EVR: Loaded 34630 existing records from primary storage. [2025-10-17T18:49:41.651633] [INFO ] [MAIN ] EVR: Loaded 34630 existing records. [2025-10-17T18:49:41.822303] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:41.822521] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-17T18:49:41.822568] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-17T18:49:41.822751] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-17T18:49:41.822806] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-17T18:49:42.170936] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:42.358026] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-17T18:49:42.383609] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T18:49:43.158074] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-17T18:49:43.775768] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:49:43.958005] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-17T18:49:44.164877] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T18:49:44.758027] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-17T18:49:45.525104] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T18:49:45.557982] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-17T18:49:45.692251] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T18:49:46.358084] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-17T18:49:47.158018] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-17T18:49:47.253632] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T18:49:47.299510] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:49:47.958075] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-17T18:49:48.620440] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T18:49:48.758052] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-17T18:49:49.558049] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-17T18:49:49.652906] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:49:50.302058] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T18:49:50.349749] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T18:49:50.358125] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-17T18:49:51.119213] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T18:49:51.158045] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-17T18:49:51.958079] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-17T18:49:52.742623] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:49:52.757971] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-17T18:49:52.898227] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T18:49:53.558007] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-17T18:49:53.630500] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T18:49:54.358056] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-17T18:49:54.972023] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:49:55.158002] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-17T18:49:55.715387] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:49:55.958008] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-17T18:49:56.508990] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T18:49:56.758053] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-17T18:49:57.550623] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T18:49:57.560778] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-17T18:49:58.223335] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T18:49:58.358013] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-17T18:49:58.579091] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:49:58.581742] [INFO ] [REMOTE ] EVF: Full fetch complete (12855 records). [2025-10-17T18:49:58.581817] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-17T18:49:58.964785] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-17T18:49:58.964993] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-17T18:49:58.965528] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-17T18:49:58.965592] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-17T18:49:58.966271] [DEBUG] [LOCAL ] EVF: Trimmed 12855 records to 9913 (keeping 200 days of data) [2025-10-17T18:49:59.030549] [DEBUG] [LOCAL ] EVF: Primary data saved (9913 records). [2025-10-17T18:49:59.030837] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-17T18:49:59.031012] [INFO ] [MAIN ] Update Progress: 788/2368 symbols completed. EVF took 45.1s. Estimated remaining: 3h 40m 24s. Rate: 7.2 symbols/min [2025-10-17T18:49:59.119424] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T18:49:59.163089] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-17T18:49:59.223815] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:59.241487] [DEBUG] [LOCAL ] EVT: Loaded 16930 existing records from primary storage. [2025-10-17T18:49:59.241757] [INFO ] [MAIN ] EVT: Loaded 16930 existing records. [2025-10-17T18:49:59.413701] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:59.413922] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-17T18:49:59.413970] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-17T18:49:59.414162] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-17T18:49:59.414220] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-17T18:49:59.760565] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:59.958009] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-17T18:50:00.237106] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T18:50:00.758042] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-17T18:50:01.275469] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T18:50:01.558037] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-17T18:50:02.363790] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-17T18:50:02.366137] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:50:03.158012] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-17T18:50:03.318377] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T18:50:03.325391] [INFO ] [REMOTE ] EVH: Full fetch complete (71844 records). [2025-10-17T18:50:03.325503] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-17T18:50:03.541899] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T18:50:03.733604] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-17T18:50:03.733708] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-17T18:50:03.734689] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-17T18:50:03.734752] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-17T18:50:03.736107] [DEBUG] [LOCAL ] EVH: Trimmed 71844 records to 50335 (keeping 200 days of data) [2025-10-17T18:50:03.958055] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-17T18:50:04.018444] [DEBUG] [LOCAL ] EVH: Primary data saved (50335 records). [2025-10-17T18:50:04.018581] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-17T18:50:04.018695] [INFO ] [MAIN ] Update Progress: 789/2368 symbols completed. EVH took 45.8s. Estimated remaining: 3h 40m 9s. Rate: 7.2 symbols/min [2025-10-17T18:50:04.182478] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:04.207763] [DEBUG] [LOCAL ] EVTC: Loaded 27014 existing records from primary storage. [2025-10-17T18:50:04.208013] [INFO ] [MAIN ] EVTC: Loaded 27014 existing records. [2025-10-17T18:50:04.379204] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:04.379391] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-17T18:50:04.379436] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-17T18:50:04.379636] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-17T18:50:04.379722] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-17T18:50:04.738147] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:04.759342] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-17T18:50:04.762570] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T18:50:04.805773] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T18:50:05.558033] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-17T18:50:05.841306] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T18:50:06.358040] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-17T18:50:06.419895] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T18:50:07.158080] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-17T18:50:07.827388] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T18:50:07.832296] [INFO ] [REMOTE ] EVR: Full fetch complete (50847 records). [2025-10-17T18:50:07.832438] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-17T18:50:07.958583] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-17T18:50:08.216909] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-17T18:50:08.217113] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-17T18:50:08.217936] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-17T18:50:08.218043] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-17T18:50:08.230471] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:50:08.234831] [DEBUG] [LOCAL ] EVR: Trimmed 50847 records to 34821 (keeping 200 days of data) [2025-10-17T18:50:08.452300] [DEBUG] [LOCAL ] EVR: Primary data saved (34821 records). [2025-10-17T18:50:08.452443] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-17T18:50:08.452524] [INFO ] [MAIN ] Update Progress: 790/2368 symbols completed. EVR took 27.0s. Estimated remaining: 3h 39m 52s. Rate: 7.2 symbols/min [2025-10-17T18:50:08.629333] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:08.668065] [DEBUG] [LOCAL ] EVTL: Loaded 40675 existing records from primary storage. [2025-10-17T18:50:08.668362] [INFO ] [MAIN ] EVTL: Loaded 40675 existing records. [2025-10-17T18:50:08.764192] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-17T18:50:08.845055] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:08.845260] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-17T18:50:08.845308] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-17T18:50:08.845617] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-17T18:50:08.845721] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-17T18:50:09.136809] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T18:50:09.226763] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:09.558020] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-17T18:50:09.855515] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T18:50:10.358061] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-17T18:50:10.926256] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:50:11.158079] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-17T18:50:11.285215] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T18:50:11.958066] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-17T18:50:12.341490] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:50:12.758069] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-17T18:50:13.130732] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T18:50:13.557986] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-17T18:50:13.728788] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:50:14.098971] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T18:50:14.358065] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-17T18:50:15.158066] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-17T18:50:15.958109] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-17T18:50:16.000680] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:50:16.324229] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T18:50:16.758017] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-17T18:50:16.992287] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T18:50:17.558015] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-17T18:50:18.229207] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:50:18.358012] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-17T18:50:18.505995] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:50:18.508037] [INFO ] [REMOTE ] EVN: Full fetch complete (17213 records). [2025-10-17T18:50:18.508106] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-17T18:50:18.860001] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-17T18:50:18.860074] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-17T18:50:18.860426] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-17T18:50:18.860465] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-17T18:50:18.860981] [DEBUG] [LOCAL ] EVN: Trimmed 17213 records to 10887 (keeping 200 days of data) [2025-10-17T18:50:18.924100] [DEBUG] [LOCAL ] EVN: Primary data saved (10887 records). [2025-10-17T18:50:18.924238] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-17T18:50:18.924314] [INFO ] [MAIN ] Update Progress: 791/2368 symbols completed. EVN took 38.9s. Estimated remaining: 3h 39m 48s. Rate: 7.2 symbols/min [2025-10-17T18:50:19.092066] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:19.116009] [DEBUG] [LOCAL ] EVTR: Loaded 25015 existing records from primary storage. [2025-10-17T18:50:19.116674] [INFO ] [MAIN ] EVTR: Loaded 25015 existing records. [2025-10-17T18:50:19.167901] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-17T18:50:19.319321] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:19.319616] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-17T18:50:19.319712] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-17T18:50:19.319958] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-17T18:50:19.320038] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-17T18:50:19.688540] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:19.690470] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T18:50:19.958011] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-17T18:50:20.557829] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T18:50:20.755778] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T18:50:20.759529] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-17T18:50:21.558046] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-17T18:50:21.956758] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:50:22.358050] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-17T18:50:22.868556] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:50:23.158049] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-17T18:50:23.362980] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T18:50:23.958011] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-17T18:50:24.098958] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:50:24.758031] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-17T18:50:25.175235] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T18:50:25.557999] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-17T18:50:25.800526] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:50:26.358095] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-17T18:50:26.855059] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T18:50:27.158064] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-17T18:50:27.304301] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:50:27.306813] [INFO ] [REMOTE ] EVT: Full fetch complete (25231 records). [2025-10-17T18:50:27.306887] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-17T18:50:27.675041] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-17T18:50:27.675133] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-17T18:50:27.675666] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-17T18:50:27.675796] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-17T18:50:27.676469] [DEBUG] [LOCAL ] EVT: Trimmed 25231 records to 17008 (keeping 200 days of data) [2025-10-17T18:50:27.778439] [DEBUG] [LOCAL ] EVT: Primary data saved (17008 records). [2025-10-17T18:50:27.778575] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-17T18:50:27.778676] [INFO ] [MAIN ] Update Progress: 792/2368 symbols completed. EVT took 28.7s. Estimated remaining: 3h 39m 41s. Rate: 7.2 symbols/min [2025-10-17T18:50:27.946262] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:27.958051] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-17T18:50:27.996822] [DEBUG] [LOCAL ] EW: Loaded 53793 existing records from primary storage. [2025-10-17T18:50:27.997149] [INFO ] [MAIN ] EW: Loaded 53793 existing records. [2025-10-17T18:50:28.178812] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:28.179021] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-17T18:50:28.179069] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-17T18:50:28.179362] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-17T18:50:28.179421] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-17T18:50:28.483890] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:50:28.566421] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:28.758021] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-17T18:50:29.557998] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-17T18:50:29.593043] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:50:29.758355] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T18:50:30.358026] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-17T18:50:30.564085] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T18:50:31.158052] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-17T18:50:31.958044] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-17T18:50:32.188092] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:50:32.609388] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T18:50:32.758036] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-17T18:50:32.979540] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:50:33.558027] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-17T18:50:34.358004] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-17T18:50:34.674501] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T18:50:34.758920] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T18:50:35.021912] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T18:50:35.158030] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-17T18:50:35.958010] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-17T18:50:36.240876] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:50:36.758056] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-17T18:50:37.558005] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-17T18:50:37.679795] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T18:50:38.358057] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-17T18:50:38.447621] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:50:38.720540] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T18:50:38.725092] [INFO ] [REMOTE ] EVTC: Full fetch complete (38413 records). [2025-10-17T18:50:38.725170] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-17T18:50:39.093582] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-17T18:50:39.093681] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-17T18:50:39.094297] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-17T18:50:39.094338] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-17T18:50:39.095150] [DEBUG] [LOCAL ] EVTC: Trimmed 38413 records to 27241 (keeping 200 days of data) [2025-10-17T18:50:39.158059] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-17T18:50:39.261256] [DEBUG] [LOCAL ] EVTC: Primary data saved (27241 records). [2025-10-17T18:50:39.261443] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-17T18:50:39.261548] [INFO ] [MAIN ] Update Progress: 793/2368 symbols completed. EVTC took 35.2s. Estimated remaining: 3h 39m 39s. Rate: 7.2 symbols/min [2025-10-17T18:50:39.428030] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:39.459598] [DEBUG] [LOCAL ] EXG: Loaded 34277 existing records from primary storage. [2025-10-17T18:50:39.459914] [INFO ] [MAIN ] EXG: Loaded 34277 existing records. [2025-10-17T18:50:39.634913] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:39.635122] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-17T18:50:39.635177] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-17T18:50:39.635377] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-17T18:50:39.635415] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-17T18:50:39.986732] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-17T18:50:39.992322] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:40.139621] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T18:50:40.251582] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:50:40.758031] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-17T18:50:41.558001] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-17T18:50:41.791786] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T18:50:42.035109] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T18:50:42.358038] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-17T18:50:42.835189] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T18:50:43.158034] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-17T18:50:43.958001] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-17T18:50:44.386208] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:50:44.394197] [INFO ] [REMOTE ] EVTL: Full fetch complete (54508 records). [2025-10-17T18:50:44.394346] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-17T18:50:44.759720] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-17T18:50:44.783370] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-17T18:50:44.783575] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-17T18:50:44.784529] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-17T18:50:44.784856] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-17T18:50:44.786265] [DEBUG] [LOCAL ] EVTL: Trimmed 54508 records to 41058 (keeping 200 days of data) [2025-10-17T18:50:45.020265] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:50:45.066773] [DEBUG] [LOCAL ] EVTL: Primary data saved (41058 records). [2025-10-17T18:50:45.066905] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-17T18:50:45.067705] [INFO ] [MAIN ] Update Progress: 794/2368 symbols completed. EVTL took 36.6s. Estimated remaining: 3h 39m 25s. Rate: 7.2 symbols/min [2025-10-17T18:50:45.262880] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:45.280569] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:50:45.338849] [DEBUG] [LOCAL ] EXK: Loaded 53561 existing records from primary storage. [2025-10-17T18:50:45.339189] [INFO ] [MAIN ] EXK: Loaded 53561 existing records. [2025-10-17T18:50:45.510273] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:45.510465] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-17T18:50:45.510511] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-17T18:50:45.510768] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-17T18:50:45.510836] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-17T18:50:45.571244] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-17T18:50:45.862006] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:45.881610] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:50:46.358006] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-17T18:50:46.950201] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:50:47.158079] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-17T18:50:47.958005] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-17T18:50:48.215037] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:50:48.454318] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:50:48.459088] [INFO ] [REMOTE ] EVTR: Full fetch complete (33558 records). [2025-10-17T18:50:48.459194] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-17T18:50:48.763211] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-17T18:50:48.833459] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-17T18:50:48.833530] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-17T18:50:48.834174] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-17T18:50:48.834237] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-17T18:50:48.835016] [DEBUG] [LOCAL ] EVTR: Trimmed 33558 records to 25284 (keeping 200 days of data) [2025-10-17T18:50:48.986679] [DEBUG] [LOCAL ] EVTR: Primary data saved (25284 records). [2025-10-17T18:50:49.003301] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-17T18:50:49.003472] [INFO ] [MAIN ] Update Progress: 795/2368 symbols completed. EVTR took 30.1s. Estimated remaining: 3h 39m 8s. Rate: 7.2 symbols/min [2025-10-17T18:50:49.049357] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:50:49.182856] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:49.212958] [DEBUG] [LOCAL ] EXP: Loaded 29802 existing records from primary storage. [2025-10-17T18:50:49.213209] [INFO ] [MAIN ] EXP: Loaded 29802 existing records. [2025-10-17T18:50:49.391703] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:49.391926] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-17T18:50:49.391996] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-17T18:50:49.392209] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-17T18:50:49.392273] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-17T18:50:49.560834] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-17T18:50:49.743027] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:50.358034] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-17T18:50:50.571323] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:50:50.661865] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:50:51.158099] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-17T18:50:51.685783] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T18:50:51.958042] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-17T18:50:52.758005] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-17T18:50:52.911992] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T18:50:53.558027] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-17T18:50:53.653547] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T18:50:53.761192] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T18:50:54.358033] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-17T18:50:55.158050] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-17T18:50:55.454885] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T18:50:55.958017] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-17T18:50:56.088815] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:50:56.665529] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:50:56.758030] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-17T18:50:56.846716] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:50:57.558027] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-17T18:50:58.358018] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-17T18:50:58.399834] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:50:58.896686] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:50:59.158035] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-17T18:50:59.655736] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T18:50:59.958025] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-17T18:51:00.758035] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-17T18:51:01.558097] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-17T18:51:01.837003] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-17T18:51:01.943081] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T18:51:02.358118] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-17T18:51:02.409455] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:51:03.158034] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-17T18:51:03.226924] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:51:03.958003] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-17T18:51:04.413973] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T18:51:04.652634] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:51:04.757988] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-17T18:51:05.558086] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-17T18:51:05.590729] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T18:51:06.358045] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-17T18:51:06.447582] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T18:51:06.459172] [INFO ] [REMOTE ] EW: Full fetch complete (77516 records). [2025-10-17T18:51:06.459368] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-17T18:51:06.891785] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-17T18:51:06.928279] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-17T18:51:06.928726] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-17T18:51:06.929945] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-17T18:51:06.930036] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-17T18:51:06.932000] [DEBUG] [LOCAL ] EW: Trimmed 77516 records to 54179 (keeping 200 days of data) [2025-10-17T18:51:07.158713] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-17T18:51:07.278638] [DEBUG] [LOCAL ] EW: Primary data saved (54179 records). [2025-10-17T18:51:07.278813] [INFO ] [MAIN ] EW: Full history saved. [2025-10-17T18:51:07.279475] [INFO ] [MAIN ] Update Progress: 796/2368 symbols completed. EW took 39.5s. Estimated remaining: 3h 39m 19s. Rate: 7.2 symbols/min [2025-10-17T18:51:07.459923] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:07.507756] [DEBUG] [LOCAL ] EXPD: Loaded 48303 existing records from primary storage. [2025-10-17T18:51:07.508063] [INFO ] [MAIN ] EXPD: Loaded 48303 existing records. [2025-10-17T18:51:07.690031] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:07.690299] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-17T18:51:07.690448] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-17T18:51:07.690756] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-17T18:51:07.690821] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-17T18:51:07.829786] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T18:51:07.963301] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-17T18:51:08.081808] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:08.559329] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:51:08.758114] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-17T18:51:09.558083] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-17T18:51:09.873630] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T18:51:10.358061] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-17T18:51:10.385795] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:51:10.497690] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:51:11.158078] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-17T18:51:11.853501] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T18:51:11.957996] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-17T18:51:12.758015] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-17T18:51:13.258454] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T18:51:13.558017] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-17T18:51:13.656788] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:51:14.358032] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-17T18:51:14.493723] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T18:51:15.158011] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-17T18:51:15.579727] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T18:51:15.720497] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T18:51:15.958044] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-17T18:51:16.549944] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T18:51:16.554727] [INFO ] [REMOTE ] EXG: Full fetch complete (49795 records). [2025-10-17T18:51:16.554867] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-17T18:51:16.763119] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-17T18:51:16.946433] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-17T18:51:16.946509] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-17T18:51:16.947211] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-17T18:51:16.947312] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-17T18:51:16.948468] [DEBUG] [LOCAL ] EXG: Trimmed 49795 records to 34518 (keeping 200 days of data) [2025-10-17T18:51:17.157564] [DEBUG] [LOCAL ] EXG: Primary data saved (34518 records). [2025-10-17T18:51:17.157774] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-17T18:51:17.157891] [INFO ] [MAIN ] Update Progress: 797/2368 symbols completed. EXG took 37.9s. Estimated remaining: 3h 39m 14s. Rate: 7.2 symbols/min [2025-10-17T18:51:17.558032] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-17T18:51:17.676555] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T18:51:18.046013] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T18:51:18.358066] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-17T18:51:19.158056] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-17T18:51:19.495051] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:51:19.832581] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T18:51:19.837219] [INFO ] [REMOTE ] EXP: Full fetch complete (42965 records). [2025-10-17T18:51:19.837365] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-17T18:51:19.963179] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-17T18:51:20.221669] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-17T18:51:20.221759] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-17T18:51:20.222451] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-17T18:51:20.222492] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-17T18:51:20.223420] [DEBUG] [LOCAL ] EXP: Trimmed 42965 records to 29985 (keeping 200 days of data) [2025-10-17T18:51:20.406762] [DEBUG] [LOCAL ] EXP: Primary data saved (29985 records). [2025-10-17T18:51:20.406902] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-17T18:51:20.408416] [INFO ] [MAIN ] Update Progress: 798/2368 symbols completed. EXP took 31.4s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-10-17T18:51:20.895964] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:51:20.906520] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-17T18:51:22.144844] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T18:51:22.152167] [INFO ] [REMOTE ] EXK: Full fetch complete (76799 records). [2025-10-17T18:51:22.152293] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-17T18:51:22.546538] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-17T18:51:22.546725] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-17T18:51:22.547823] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-17T18:51:22.547902] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-17T18:51:22.550272] [DEBUG] [LOCAL ] EXK: Trimmed 76799 records to 53951 (keeping 200 days of data) [2025-10-17T18:51:22.669078] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:51:22.688830] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-17T18:51:22.894098] [DEBUG] [LOCAL ] EXK: Primary data saved (53951 records). [2025-10-17T18:51:22.894238] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-17T18:51:22.895011] [INFO ] [MAIN ] Update Progress: 799/2368 symbols completed. EXK took 37.8s. Estimated remaining: 3h 38m 36s. Rate: 7.2 symbols/min [2025-10-17T18:51:24.505767] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T18:51:24.517620] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-17T18:51:26.078819] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:51:26.088516] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-17T18:51:27.837664] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T18:51:27.848848] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-17T18:51:29.494375] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:51:29.504709] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-17T18:51:31.263323] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:51:31.274204] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-17T18:51:32.115319] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T18:51:32.122053] [INFO ] [REMOTE ] EXPD: Full fetch complete (69482 records). [2025-10-17T18:51:32.122190] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-17T18:51:32.509327] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-17T18:51:32.509460] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-17T18:51:32.510403] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-17T18:51:32.510473] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-17T18:51:32.512021] [DEBUG] [LOCAL ] EXPD: Trimmed 69482 records to 48595 (keeping 200 days of data) [2025-10-17T18:51:32.817725] [DEBUG] [LOCAL ] EXPD: Primary data saved (48595 records). [2025-10-17T18:51:32.817865] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-17T18:51:32.818427] [INFO ] [MAIN ] Update Progress: 800/2368 symbols completed. EXPD took 25.5s. Estimated remaining: 3h 38m 30s. Rate: 7.2 symbols/min [2025-10-17T18:51:33.556615] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.504211] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.553629] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.538477] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.655948] [DEBUG] [LOCAL ] FAF: Loaded 41803 existing records from primary storage. [2025-10-17T18:51:33.670008] [DEBUG] [LOCAL ] EXR: Loaded 45888 existing records from primary storage. [2025-10-17T18:51:33.671987] [INFO ] [MAIN ] EXR: Loaded 45888 existing records. [2025-10-17T18:51:33.671748] [INFO ] [MAIN ] FAF: Loaded 41803 existing records. [2025-10-17T18:51:33.703782] [DEBUG] [LOCAL ] FBIN: Loaded 50718 existing records from primary storage. [2025-10-17T18:51:33.778744] [INFO ] [MAIN ] FBIN: Loaded 50718 existing records. [2025-10-17T18:51:33.839685] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-17T18:51:33.905410] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-10-17T18:51:34.158918] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.206633] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.254508] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-17T18:51:34.344723] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-17T18:51:34.348472] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.348600] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-17T18:51:34.383253] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.489154] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.483322] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.489376] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.500138] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.509535] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-17T18:51:34.523595] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-17T18:51:34.439461] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-17T18:51:34.534313] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-17T18:51:34.534247] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-17T18:51:34.539726] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-17T18:51:34.550117] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-17T18:51:34.593374] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-17T18:51:34.636118] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-17T18:51:35.830721] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.911730] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.925774] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-17T18:51:35.926847] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-17T18:51:35.929888] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.945281] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-17T18:51:35.973877] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.974839] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-17T18:51:37.428282] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T18:51:37.435388] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-17T18:51:37.543229] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:51:37.553039] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-17T18:51:37.578753] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T18:51:37.587868] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-17T18:51:38.507555] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-17T18:51:38.518770] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-17T18:51:38.844633] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T18:51:38.853084] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-17T18:51:38.934471] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:51:38.943979] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-17T18:51:39.327266] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:51:39.337434] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-17T18:51:40.377771] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:51:40.384889] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-17T18:51:40.519216] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:51:40.528884] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-17T18:51:40.936358] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:51:40.946622] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-17T18:51:41.012387] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-17T18:51:41.022916] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-17T18:51:41.806106] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:51:41.815304] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-17T18:51:41.932450] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:51:41.942221] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-17T18:51:42.681220] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:51:42.692016] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-17T18:51:43.411480] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T18:51:43.421170] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-17T18:51:43.496333] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T18:51:43.506886] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-17T18:51:43.613636] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:51:43.623777] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-17T18:51:44.436943] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T18:51:44.448122] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-17T18:51:44.575056] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T18:51:44.584225] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-17T18:51:45.133983] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:51:45.143142] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-17T18:51:46.021063] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-17T18:51:46.032270] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-17T18:51:46.179733] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:51:46.195596] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:51:46.357991] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-17T18:51:46.607484] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:51:47.158070] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-17T18:51:47.924274] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T18:51:47.957991] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-17T18:51:48.144613] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:51:48.758012] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-17T18:51:48.880810] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T18:51:49.558028] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-17T18:51:49.678698] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T18:51:50.357999] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-17T18:51:50.598790] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T18:51:51.157994] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-17T18:51:51.185910] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T18:51:51.948263] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:51:51.957996] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-17T18:51:52.621408] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:51:52.758082] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-17T18:51:53.558017] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-17T18:51:54.149857] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T18:51:54.297615] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T18:51:54.357996] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-17T18:51:55.158005] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-17T18:51:55.258043] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T18:51:55.958068] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-17T18:51:56.742470] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-17T18:51:56.757977] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-17T18:51:56.840176] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:51:57.558043] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-17T18:51:57.636477] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T18:51:57.643106] [INFO ] [REMOTE ] EXR: Full fetch complete (66180 records). [2025-10-17T18:51:57.643245] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-17T18:51:58.020599] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-17T18:51:58.020721] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-17T18:51:58.021594] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-17T18:51:58.021662] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-17T18:51:58.023049] [DEBUG] [LOCAL ] EXR: Trimmed 66180 records to 46249 (keeping 200 days of data) [2025-10-17T18:51:58.308060] [DEBUG] [LOCAL ] EXR: Primary data saved (46249 records). [2025-10-17T18:51:58.308189] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-17T18:51:58.308269] [INFO ] [MAIN ] Update Progress: 801/2368 symbols completed. EXR took 25.5s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-10-17T18:51:58.370388] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-17T18:51:58.479467] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:58.506200] [DEBUG] [LOCAL ] FBK: Loaded 27707 existing records from primary storage. [2025-10-17T18:51:58.506455] [INFO ] [MAIN ] FBK: Loaded 27707 existing records. [2025-10-17T18:51:58.679184] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:58.679389] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-17T18:51:58.679436] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-17T18:51:58.679713] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-17T18:51:58.679772] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-17T18:51:59.028947] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:59.158035] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-17T18:51:59.199110] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:51:59.206019] [INFO ] [REMOTE ] FBIN: Full fetch complete (72955 records). [2025-10-17T18:51:59.206188] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-17T18:51:59.599527] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-17T18:51:59.599856] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-17T18:51:59.601024] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-17T18:51:59.626976] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-17T18:51:59.632562] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-17T18:51:59.662298] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:51:59.669376] [INFO ] [REMOTE ] FAF: Full fetch complete (58147 records). [2025-10-17T18:51:59.669775] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-17T18:51:59.669638] [DEBUG] [LOCAL ] FBIN: Trimmed 72955 records to 51068 (keeping 200 days of data) [2025-10-17T18:51:59.963139] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-17T18:52:00.135377] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:52:00.377145] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-17T18:52:00.377417] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-17T18:52:00.392383] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-17T18:52:00.392776] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-17T18:52:00.396627] [DEBUG] [LOCAL ] FAF: Trimmed 58147 records to 42095 (keeping 200 days of data) [2025-10-17T18:52:00.502393] [DEBUG] [LOCAL ] FBIN: Primary data saved (51068 records). [2025-10-17T18:52:00.502970] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-17T18:52:00.503335] [INFO ] [MAIN ] Update Progress: 802/2368 symbols completed. FBIN took 27.7s. Estimated remaining: 3h 38m 35s. Rate: 7.2 symbols/min [2025-10-17T18:52:00.683034] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:00.772134] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-17T18:52:00.824028] [DEBUG] [LOCAL ] FBP: Loaded 46111 existing records from primary storage. [2025-10-17T18:52:00.827541] [INFO ] [MAIN ] FBP: Loaded 46111 existing records. [2025-10-17T18:52:01.027472] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:01.028744] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-17T18:52:01.029709] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-17T18:52:01.031798] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-17T18:52:01.032227] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-17T18:52:01.442168] [DEBUG] [LOCAL ] FAF: Primary data saved (42095 records). [2025-10-17T18:52:01.444194] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-17T18:52:01.448208] [INFO ] [MAIN ] Update Progress: 803/2368 symbols completed. FAF took 28.6s. Estimated remaining: 3h 38m 12s. Rate: 7.2 symbols/min [2025-10-17T18:52:01.448048] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:01.563103] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-17T18:52:01.630156] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:01.678004] [DEBUG] [LOCAL ] FBRT: Loaded 35695 existing records from primary storage. [2025-10-17T18:52:01.678399] [INFO ] [MAIN ] FBRT: Loaded 35695 existing records. [2025-10-17T18:52:01.879448] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:01.879778] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-17T18:52:01.879837] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-17T18:52:01.880305] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-17T18:52:01.880365] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-17T18:52:02.254088] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:02.358121] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-17T18:52:02.786312] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:52:03.083605] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-10-17T18:52:03.158019] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-17T18:52:03.234775] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:52:03.518415] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T18:52:03.958512] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-17T18:52:03.959083] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:52:04.758085] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-17T18:52:05.264903] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T18:52:05.558045] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-17T18:52:06.357996] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-17T18:52:06.581023] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:52:07.123587] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-17T18:52:07.158006] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-17T18:52:07.234417] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:52:07.958088] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-17T18:52:08.455277] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:52:08.758033] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-17T18:52:08.882834] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T18:52:09.558011] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-17T18:52:10.286905] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T18:52:10.358027] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-17T18:52:11.062161] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:52:11.157991] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-17T18:52:11.843602] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:52:11.958093] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-17T18:52:12.458771] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T18:52:12.758040] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-17T18:52:13.558007] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-17T18:52:13.785360] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:52:14.358040] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-17T18:52:14.554613] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-17T18:52:14.562158] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-17T18:52:14.562295] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-17T18:52:14.950271] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-17T18:52:14.950380] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-17T18:52:14.951336] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-17T18:52:14.951399] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-17T18:52:14.952868] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-17T18:52:15.163803] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-17T18:52:15.294415] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-17T18:52:15.294575] [INFO ] [MAIN ] F: Full history saved. [2025-10-17T18:52:15.295610] [INFO ] [MAIN ] Update Progress: 804/2368 symbols completed. F took 42.5s. Estimated remaining: 3h 38m 14s. Rate: 7.2 symbols/min [2025-10-17T18:52:15.467343] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:15.500304] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T18:52:15.544266] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:52:15.542719] [DEBUG] [LOCAL ] FC: Loaded 14966 existing records from primary storage. [2025-10-17T18:52:15.551455] [INFO ] [MAIN ] FC: Loaded 14966 existing records. [2025-10-17T18:52:15.728100] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:15.728356] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-17T18:52:15.728404] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-17T18:52:15.728699] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-17T18:52:15.728756] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-17T18:52:15.963152] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-17T18:52:16.094948] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:16.271637] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T18:52:16.758178] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-17T18:52:17.460621] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T18:52:17.558073] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-17T18:52:18.149151] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T18:52:18.166126] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T18:52:18.358051] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-17T18:52:19.158034] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-17T18:52:19.663716] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T18:52:19.958023] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-17T18:52:20.460943] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T18:52:20.758076] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-17T18:52:21.558012] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-17T18:52:21.659380] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:52:21.721284] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T18:52:22.358007] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-17T18:52:22.488482] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T18:52:23.158016] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-17T18:52:23.814869] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:52:23.820046] [INFO ] [REMOTE ] FBK: Full fetch complete (35294 records). [2025-10-17T18:52:23.820130] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-17T18:52:23.964781] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-17T18:52:24.217182] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-17T18:52:24.217318] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-17T18:52:24.218258] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-17T18:52:24.218321] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-17T18:52:24.219327] [DEBUG] [LOCAL ] FBK: Trimmed 35294 records to 27962 (keeping 200 days of data) [2025-10-17T18:52:24.388256] [DEBUG] [LOCAL ] FBK: Primary data saved (27962 records). [2025-10-17T18:52:24.388403] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-17T18:52:24.388497] [INFO ] [MAIN ] Update Progress: 805/2368 symbols completed. FBK took 26.1s. Estimated remaining: 3h 38m 7s. Rate: 7.2 symbols/min [2025-10-17T18:52:24.573015] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:52:24.597161] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:24.637350] [DEBUG] [LOCAL ] FCF: Loaded 39657 existing records from primary storage. [2025-10-17T18:52:24.637716] [INFO ] [MAIN ] FCF: Loaded 39657 existing records. [2025-10-17T18:52:24.760033] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-17T18:52:24.801150] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T18:52:24.827601] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:24.830950] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-17T18:52:24.831719] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-17T18:52:24.832081] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-17T18:52:24.832140] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-17T18:52:25.185408] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:25.558033] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-17T18:52:26.268602] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T18:52:26.274303] [INFO ] [REMOTE ] FBRT: Full fetch complete (49564 records). [2025-10-17T18:52:26.274405] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-17T18:52:26.363677] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-17T18:52:26.630635] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:52:26.693681] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-17T18:52:26.693834] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-17T18:52:26.695115] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-17T18:52:26.695215] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-17T18:52:26.697073] [DEBUG] [LOCAL ] FBRT: Trimmed 49564 records to 35936 (keeping 200 days of data) [2025-10-17T18:52:26.912002] [DEBUG] [LOCAL ] FBRT: Primary data saved (35936 records). [2025-10-17T18:52:26.912143] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-17T18:52:26.912226] [INFO ] [MAIN ] Update Progress: 806/2368 symbols completed. FBRT took 25.5s. Estimated remaining: 3h 37m 48s. Rate: 7.2 symbols/min [2025-10-17T18:52:27.077565] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:27.103564] [DEBUG] [LOCAL ] FCN: Loaded 26219 existing records from primary storage. [2025-10-17T18:52:27.103844] [INFO ] [MAIN ] FCN: Loaded 26219 existing records. [2025-10-17T18:52:27.164695] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-17T18:52:27.279619] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:27.279868] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-17T18:52:27.279914] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-17T18:52:27.280251] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-17T18:52:27.280308] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-17T18:52:27.662391] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:27.963123] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-17T18:52:27.976144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T18:52:28.242307] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T18:52:28.758005] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-17T18:52:29.130769] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:52:29.532963] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T18:52:29.557991] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-17T18:52:30.358017] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-17T18:52:30.421042] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T18:52:31.158037] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-17T18:52:31.918144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:52:31.957994] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-17T18:52:32.345019] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T18:52:32.758009] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-17T18:52:33.558013] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-17T18:52:33.700753] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:52:34.138002] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T18:52:34.357439] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T18:52:34.361746] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-17T18:52:35.158038] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-17T18:52:35.800303] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:52:35.958029] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-17T18:52:36.588305] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T18:52:36.758055] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-17T18:52:37.058138] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T18:52:37.558017] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-17T18:52:37.665698] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:52:38.358033] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-17T18:52:39.090854] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T18:52:39.157993] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-17T18:52:39.344330] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T18:52:39.958020] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-17T18:52:40.646718] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T18:52:40.653442] [INFO ] [REMOTE ] FBP: Full fetch complete (66765 records). [2025-10-17T18:52:40.653544] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-17T18:52:40.763255] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-17T18:52:41.042273] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-17T18:52:41.042433] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-17T18:52:41.043354] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-17T18:52:41.043505] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-17T18:52:41.044838] [DEBUG] [LOCAL ] FBP: Trimmed 66765 records to 46466 (keeping 200 days of data) [2025-10-17T18:52:41.324274] [DEBUG] [LOCAL ] FBP: Primary data saved (46466 records). [2025-10-17T18:52:41.324398] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-17T18:52:41.325052] [INFO ] [MAIN ] Update Progress: 807/2368 symbols completed. FBP took 40.8s. Estimated remaining: 3h 37m 51s. Rate: 7.2 symbols/min [2025-10-17T18:52:41.496906] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:52:41.515958] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:41.563092] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-17T18:52:41.565178] [DEBUG] [LOCAL ] FCPT: Loaded 37627 existing records from primary storage. [2025-10-17T18:52:41.565504] [INFO ] [MAIN ] FCPT: Loaded 37627 existing records. [2025-10-17T18:52:41.741490] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:41.741699] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-17T18:52:41.741755] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-17T18:52:41.742024] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-17T18:52:41.742088] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-17T18:52:42.094103] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:42.162400] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:52:42.358004] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-17T18:52:43.117079] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T18:52:43.157989] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-17T18:52:43.721617] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T18:52:43.958010] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-17T18:52:44.757998] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-17T18:52:44.944169] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T18:52:45.322428] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T18:52:45.558010] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-17T18:52:45.760665] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T18:52:45.763891] [INFO ] [REMOTE ] FC: Full fetch complete (21862 records). [2025-10-17T18:52:45.763974] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-17T18:52:46.115834] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-17T18:52:46.115906] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-17T18:52:46.116280] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-17T18:52:46.116319] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-17T18:52:46.117049] [DEBUG] [LOCAL ] FC: Trimmed 21862 records to 15052 (keeping 200 days of data) [2025-10-17T18:52:46.209291] [DEBUG] [LOCAL ] FC: Primary data saved (15052 records). [2025-10-17T18:52:46.209512] [INFO ] [MAIN ] FC: Full history saved. [2025-10-17T18:52:46.209718] [INFO ] [MAIN ] Update Progress: 808/2368 symbols completed. FC took 30.9s. Estimated remaining: 3h 37m 36s. Rate: 7.2 symbols/min [2025-10-17T18:52:46.359490] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-17T18:52:46.380191] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:46.380481] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-17T18:52:46.380602] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-17T18:52:46.380740] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-17T18:52:46.380784] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-17T18:52:46.380826] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-17T18:52:46.380858] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-17T18:52:46.735549] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:46.753114] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T18:52:47.158038] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-17T18:52:47.510409] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T18:52:47.727516] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:52:47.958028] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-17T18:52:48.303222] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-17T18:52:48.758027] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-17T18:52:49.558037] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-17T18:52:50.128995] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T18:52:50.358035] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-17T18:52:50.919112] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T18:52:51.157998] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-17T18:52:51.474347] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T18:52:51.958050] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-17T18:52:52.514721] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T18:52:52.758036] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-17T18:52:53.558008] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-17T18:52:53.638907] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T18:52:54.281143] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T18:52:54.348337] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:52:54.357983] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-17T18:52:55.158073] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-17T18:52:55.726454] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:52:55.958020] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-17T18:52:56.389476] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T18:52:56.429099] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T18:52:56.758012] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-17T18:52:57.558004] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-17T18:52:57.898089] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T18:52:58.358021] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-17T18:52:58.995489] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:52:59.158022] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-17T18:52:59.583138] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T18:52:59.958004] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-17T18:53:00.490336] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T18:53:00.757994] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-17T18:53:00.816746] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T18:53:00.822479] [INFO ] [REMOTE ] FCF: Full fetch complete (58260 records). [2025-10-17T18:53:00.822577] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-17T18:53:01.201446] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-17T18:53:01.201537] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-17T18:53:01.202386] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-17T18:53:01.202456] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-17T18:53:01.203748] [DEBUG] [LOCAL ] FCF: Trimmed 58260 records to 39969 (keeping 200 days of data) [2025-10-17T18:53:01.446421] [DEBUG] [LOCAL ] FCF: Primary data saved (39969 records). [2025-10-17T18:53:01.446625] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-17T18:53:01.446799] [INFO ] [MAIN ] Update Progress: 809/2368 symbols completed. FCF took 37.1s. Estimated remaining: 3h 37m 41s. Rate: 7.2 symbols/min [2025-10-17T18:53:01.563191] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-17T18:53:01.622691] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:01.639172] [DEBUG] [LOCAL ] FCT: Loaded 14752 existing records from primary storage. [2025-10-17T18:53:01.639473] [INFO ] [MAIN ] FCT: Loaded 14752 existing records. [2025-10-17T18:53:01.817221] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T18:53:01.823274] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:01.826354] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-17T18:53:01.826432] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-17T18:53:01.826667] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-17T18:53:01.826742] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-17T18:53:02.188089] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:02.358059] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-17T18:53:03.052638] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T18:53:03.158043] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-17T18:53:03.410024] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T18:53:03.958028] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-17T18:53:04.151868] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T18:53:04.156020] [INFO ] [REMOTE ] FCN: Full fetch complete (36013 records). [2025-10-17T18:53:04.156115] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-17T18:53:04.327590] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-17T18:53:04.564724] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-17T18:53:04.564808] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-17T18:53:04.565397] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-17T18:53:04.565444] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-17T18:53:04.566407] [DEBUG] [LOCAL ] FCN: Trimmed 36013 records to 26402 (keeping 200 days of data) [2025-10-17T18:53:04.719851] [DEBUG] [LOCAL ] FCN: Primary data saved (26402 records). [2025-10-17T18:53:04.719985] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-17T18:53:04.720077] [INFO ] [MAIN ] Update Progress: 810/2368 symbols completed. FCN took 37.8s. Estimated remaining: 3h 37m 23s. Rate: 7.2 symbols/min [2025-10-17T18:53:04.763212] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-17T18:53:04.892264] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:04.949394] [DEBUG] [LOCAL ] FCX: Loaded 54091 existing records from primary storage. [2025-10-17T18:53:04.949736] [INFO ] [MAIN ] FCX: Loaded 54091 existing records. [2025-10-17T18:53:05.120786] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:05.121018] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-17T18:53:05.121066] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-17T18:53:05.121462] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-17T18:53:05.121548] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-17T18:53:05.462511] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:05.557990] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-17T18:53:05.897751] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T18:53:06.358028] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-17T18:53:06.965951] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:53:07.158024] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-17T18:53:07.166841] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T18:53:07.958047] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-17T18:53:08.758040] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-17T18:53:08.895583] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T18:53:09.165002] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:53:09.558029] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-17T18:53:10.097485] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:53:10.358055] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-17T18:53:10.516230] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T18:53:10.781393] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:53:11.158032] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-17T18:53:11.958043] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-17T18:53:11.966801] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:53:12.758038] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-17T18:53:13.374134] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T18:53:13.391154] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T18:53:13.558030] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-17T18:53:14.358031] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-17T18:53:15.040298] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T18:53:15.157997] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-17T18:53:15.958059] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-17T18:53:16.289259] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T18:53:16.400515] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T18:53:16.763141] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-17T18:53:16.773781] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T18:53:16.780532] [INFO ] [REMOTE ] FCPT: Full fetch complete (53920 records). [2025-10-17T18:53:16.780737] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-17T18:53:17.170909] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-17T18:53:17.170989] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-17T18:53:17.171765] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-17T18:53:17.171828] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-17T18:53:17.172946] [DEBUG] [LOCAL ] FCPT: Trimmed 53920 records to 37885 (keeping 200 days of data) [2025-10-17T18:53:17.404979] [DEBUG] [LOCAL ] FCPT: Primary data saved (37885 records). [2025-10-17T18:53:17.405117] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-17T18:53:17.405610] [INFO ] [MAIN ] Update Progress: 811/2368 symbols completed. FCPT took 36.1s. Estimated remaining: 3h 37m 22s. Rate: 7.2 symbols/min [2025-10-17T18:53:17.566242] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-17T18:53:17.585897] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:17.625363] [DEBUG] [LOCAL ] FDP: Loaded 29961 existing records from primary storage. [2025-10-17T18:53:17.625723] [INFO ] [MAIN ] FDP: Loaded 29961 existing records. [2025-10-17T18:53:17.813989] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:17.814265] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-17T18:53:17.814334] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-17T18:53:17.814778] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-17T18:53:17.814855] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-17T18:53:18.196613] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:18.358036] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-17T18:53:18.616815] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T18:53:18.685953] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T18:53:19.158037] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-17T18:53:19.267995] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:53:19.500421] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T18:53:19.958049] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-17T18:53:20.758082] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-17T18:53:21.192638] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T18:53:21.558039] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-17T18:53:21.581619] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T18:53:22.358069] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-17T18:53:22.789343] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T18:53:23.158051] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-17T18:53:23.278721] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T18:53:23.958028] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-17T18:53:24.566077] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T18:53:24.758042] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-17T18:53:24.886986] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:53:24.889596] [INFO ] [REMOTE ] FCT: Full fetch complete (21126 records). [2025-10-17T18:53:24.889705] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-17T18:53:25.211844] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:53:25.255797] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-17T18:53:25.255871] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-17T18:53:25.256364] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-17T18:53:25.256412] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-17T18:53:25.257077] [DEBUG] [LOCAL ] FCT: Trimmed 21126 records to 14906 (keeping 200 days of data) [2025-10-17T18:53:25.345501] [DEBUG] [LOCAL ] FCT: Primary data saved (14906 records). [2025-10-17T18:53:25.345670] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-17T18:53:25.345772] [INFO ] [MAIN ] Update Progress: 812/2368 symbols completed. FCT took 23.9s. Estimated remaining: 3h 37m 13s. Rate: 7.2 symbols/min [2025-10-17T18:53:25.513381] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:25.541607] [DEBUG] [LOCAL ] FDS: Loaded 27887 existing records from primary storage. [2025-10-17T18:53:25.541892] [INFO ] [MAIN ] FDS: Loaded 27887 existing records. [2025-10-17T18:53:25.563261] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-17T18:53:25.716864] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:25.717099] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-17T18:53:25.717147] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-17T18:53:25.717343] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-17T18:53:25.717402] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-17T18:53:26.062741] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:26.358047] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-17T18:53:26.742329] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-17T18:53:26.743144] [INFO ] [REMOTE ] FCRX: Full fetch complete (1656 records). [2025-10-17T18:53:26.743218] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-17T18:53:26.946661] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-17T18:53:26.946898] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:53:26.946955] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:53:26.947043] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-17T18:53:26.947108] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-17T18:53:26.947144] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-17T18:53:26.947196] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-17T18:53:26.947315] [INFO ] [MAIN ] Update Progress: 813/2368 symbols completed. FCRX took 40.7s. Estimated remaining: 3h 36m 52s. Rate: 7.2 symbols/min [2025-10-17T18:53:27.172387] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-17T18:53:27.175392] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:27.234871] [DEBUG] [LOCAL ] FDX: Loaded 51742 existing records from primary storage. [2025-10-17T18:53:27.235257] [INFO ] [MAIN ] FDX: Loaded 51742 existing records. [2025-10-17T18:53:27.410378] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:27.411338] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-17T18:53:27.411401] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-17T18:53:27.411619] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-17T18:53:27.411698] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-17T18:53:27.770239] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:27.848450] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T18:53:27.958059] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-17T18:53:28.352952] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:53:28.758147] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-17T18:53:29.558025] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-17T18:53:29.901575] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:53:30.003123] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T18:53:30.358045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-17T18:53:31.158082] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-17T18:53:31.601907] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T18:53:31.828687] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T18:53:31.958045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-17T18:53:32.278296] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T18:53:32.758077] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-17T18:53:33.387544] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:53:33.558013] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-17T18:53:34.358015] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-17T18:53:34.870893] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T18:53:34.883195] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:53:35.157994] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-17T18:53:35.580284] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T18:53:35.958014] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-17T18:53:36.758054] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-17T18:53:37.190439] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T18:53:37.300468] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:53:37.558053] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-17T18:53:38.358000] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-17T18:53:38.642296] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T18:53:38.697184] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:53:39.158016] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-17T18:53:39.853021] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:53:39.957995] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-17T18:53:40.445242] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T18:53:40.758020] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-17T18:53:41.558000] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-17T18:53:42.004076] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T18:53:42.344248] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-17T18:53:42.357989] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-17T18:53:43.106367] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:53:43.158026] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-17T18:53:43.958007] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-17T18:53:44.373590] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T18:53:44.491111] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T18:53:44.495081] [INFO ] [REMOTE ] FDP: Full fetch complete (42720 records). [2025-10-17T18:53:44.495162] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-17T18:53:44.764075] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-17T18:53:44.863301] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-17T18:53:44.863371] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-17T18:53:44.864032] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-17T18:53:44.864093] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-17T18:53:44.865020] [DEBUG] [LOCAL ] FDP: Trimmed 42720 records to 30199 (keeping 200 days of data) [2025-10-17T18:53:45.047395] [DEBUG] [LOCAL ] FDP: Primary data saved (30199 records). [2025-10-17T18:53:45.047527] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-17T18:53:45.048071] [INFO ] [MAIN ] Update Progress: 814/2368 symbols completed. FDP took 27.6s. Estimated remaining: 3h 37m 2s. Rate: 7.2 symbols/min [2025-10-17T18:53:45.212046] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:45.261364] [DEBUG] [LOCAL ] FE: Loaded 53822 existing records from primary storage. [2025-10-17T18:53:45.261684] [INFO ] [MAIN ] FE: Loaded 53822 existing records. [2025-10-17T18:53:45.437800] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:45.438034] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-17T18:53:45.438099] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-17T18:53:45.438462] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-17T18:53:45.438522] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-17T18:53:45.563100] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-17T18:53:45.811215] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:45.854487] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:53:46.022234] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:53:46.358027] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-17T18:53:47.158029] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-17T18:53:47.656769] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T18:53:47.731634] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:53:47.958028] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-17T18:53:48.758012] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-17T18:53:49.041278] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T18:53:49.104032] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T18:53:49.563129] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-17T18:53:49.573761] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T18:53:49.582585] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-17T18:53:49.582740] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-17T18:53:49.964972] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-17T18:53:49.965056] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-17T18:53:49.966023] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-17T18:53:49.966087] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-17T18:53:49.967557] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54481 (keeping 200 days of data) [2025-10-17T18:53:50.316297] [DEBUG] [LOCAL ] FCX: Primary data saved (54481 records). [2025-10-17T18:53:50.316442] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-17T18:53:50.317336] [INFO ] [MAIN ] Update Progress: 815/2368 symbols completed. FCX took 45.6s. Estimated remaining: 3h 36m 48s. Rate: 7.2 symbols/min [2025-10-17T18:53:50.363135] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-17T18:53:50.489552] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:50.489738] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-17T18:53:50.489785] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-17T18:53:50.489895] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-17T18:53:50.489935] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-17T18:53:50.489976] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-17T18:53:50.490008] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-17T18:53:50.841118] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:51.158004] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-17T18:53:51.392055] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:53:51.466452] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:53:51.508241] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T18:53:51.958024] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-17T18:53:52.758076] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-17T18:53:53.316754] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T18:53:53.558028] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-17T18:53:54.358080] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-17T18:53:54.434323] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:53:54.782349] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-17T18:53:55.158030] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-17T18:53:55.197734] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:53:55.203380] [INFO ] [REMOTE ] FDS: Full fetch complete (38873 records). [2025-10-17T18:53:55.203472] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-17T18:53:55.565710] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-17T18:53:55.565798] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-17T18:53:55.566498] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-17T18:53:55.566540] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-17T18:53:55.567578] [DEBUG] [LOCAL ] FDS: Trimmed 38873 records to 28183 (keeping 200 days of data) [2025-10-17T18:53:55.751965] [DEBUG] [LOCAL ] FDS: Primary data saved (28183 records). [2025-10-17T18:53:55.752118] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-17T18:53:55.752204] [INFO ] [MAIN ] Update Progress: 816/2368 symbols completed. FDS took 30.4s. Estimated remaining: 3h 36m 34s. Rate: 7.2 symbols/min [2025-10-17T18:53:55.922155] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:55.958038] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-17T18:53:55.975384] [DEBUG] [LOCAL ] FERG: Loaded 49121 existing records from primary storage. [2025-10-17T18:53:55.975808] [INFO ] [MAIN ] FERG: Loaded 49121 existing records. [2025-10-17T18:53:56.154872] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:56.155121] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-17T18:53:56.155179] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-17T18:53:56.155539] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-17T18:53:56.155579] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-17T18:53:56.511988] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:56.731663] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T18:53:56.757986] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-17T18:53:57.558037] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-17T18:53:57.991607] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T18:53:58.022753] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T18:53:58.358004] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-17T18:53:58.615564] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:53:59.158041] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-17T18:53:59.958008] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-17T18:54:00.090732] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:54:00.483535] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T18:54:00.758033] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-17T18:54:01.395028] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-17T18:54:01.558035] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-17T18:54:01.585439] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T18:54:02.358079] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-17T18:54:03.158101] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-17T18:54:03.426121] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T18:54:03.451696] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-17T18:54:03.958043] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-17T18:54:04.382389] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:54:04.758101] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-17T18:54:05.115564] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-17T18:54:05.563185] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-17T18:54:05.581378] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T18:54:06.358048] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-17T18:54:07.158042] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-17T18:54:07.324685] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T18:54:07.485263] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T18:54:07.958013] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-17T18:54:08.102033] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:54:08.758069] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-17T18:54:09.558112] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-17T18:54:09.915719] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:54:10.082150] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T18:54:10.354359] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:54:10.362986] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-17T18:54:11.158036] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-17T18:54:11.958031] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-17T18:54:12.146320] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:54:12.758002] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-17T18:54:12.918263] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:54:13.235165] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T18:54:13.558003] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-17T18:54:13.950570] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:54:14.358035] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-17T18:54:14.841005] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T18:54:14.841823] [INFO ] [REMOTE ] FENG: Full fetch complete (2278 records). [2025-10-17T18:54:14.841890] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-17T18:54:15.022553] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:54:15.022756] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:54:15.022907] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:54:15.022982] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-17T18:54:15.023145] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-17T18:54:15.023213] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-17T18:54:15.023280] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-17T18:54:15.023469] [INFO ] [MAIN ] Update Progress: 817/2368 symbols completed. FENG took 24.7s. Estimated remaining: 3h 36m 46s. Rate: 7.2 symbols/min [2025-10-17T18:54:15.162058] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-17T18:54:15.195677] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:15.226480] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:54:15.246099] [DEBUG] [LOCAL ] FET: Loaded 12940 existing records from primary storage. [2025-10-17T18:54:15.246307] [INFO ] [MAIN ] FET: Loaded 12940 existing records. [2025-10-17T18:54:15.418235] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:15.418450] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-17T18:54:15.418504] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-17T18:54:15.418690] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-17T18:54:15.418746] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-17T18:54:15.764666] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:15.958004] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-17T18:54:16.758007] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-17T18:54:16.865254] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:54:17.256584] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T18:54:17.263760] [INFO ] [REMOTE ] FDX: Full fetch complete (74381 records). [2025-10-17T18:54:17.263909] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-17T18:54:17.559949] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-17T18:54:17.654067] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-17T18:54:17.654160] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-17T18:54:17.655091] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-17T18:54:17.655163] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-17T18:54:17.656708] [DEBUG] [LOCAL ] FDX: Trimmed 74381 records to 52099 (keeping 200 days of data) [2025-10-17T18:54:17.981741] [DEBUG] [LOCAL ] FDX: Primary data saved (52099 records). [2025-10-17T18:54:17.981930] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-17T18:54:17.982959] [INFO ] [MAIN ] Update Progress: 818/2368 symbols completed. FDX took 51.0s. Estimated remaining: 3h 36m 28s. Rate: 7.2 symbols/min [2025-10-17T18:54:18.150345] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:18.173696] [DEBUG] [LOCAL ] FF: Loaded 24506 existing records from primary storage. [2025-10-17T18:54:18.173949] [INFO ] [MAIN ] FF: Loaded 24506 existing records. [2025-10-17T18:54:18.304502] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:54:18.363530] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-17T18:54:18.395631] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:18.403130] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-17T18:54:18.404628] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:54:18.406661] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-17T18:54:18.408733] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-17T18:54:18.408793] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-17T18:54:18.760833] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:19.158017] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-17T18:54:19.958006] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-17T18:54:20.216682] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T18:54:20.511635] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T18:54:20.758009] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-17T18:54:21.049747] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:54:21.526316] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T18:54:21.557982] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-17T18:54:22.151387] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T18:54:22.358064] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-17T18:54:23.158027] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-17T18:54:23.499463] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:54:23.958007] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-17T18:54:24.188625] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:54:24.196959] [INFO ] [REMOTE ] FE: Full fetch complete (77470 records). [2025-10-17T18:54:24.197110] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-17T18:54:24.595112] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-17T18:54:24.595190] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-17T18:54:24.596191] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-17T18:54:24.596259] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-17T18:54:24.597792] [DEBUG] [LOCAL ] FE: Trimmed 77470 records to 54212 (keeping 200 days of data) [2025-10-17T18:54:24.775244] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-17T18:54:24.832547] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T18:54:24.939790] [DEBUG] [LOCAL ] FE: Primary data saved (54212 records). [2025-10-17T18:54:24.939931] [INFO ] [MAIN ] FE: Full history saved. [2025-10-17T18:54:24.940485] [INFO ] [MAIN ] Update Progress: 819/2368 symbols completed. FE took 39.9s. Estimated remaining: 3h 36m 16s. Rate: 7.2 symbols/min [2025-10-17T18:54:25.110301] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:25.119716] [DEBUG] [LOCAL ] FFA: Loaded 5963 existing records from primary storage. [2025-10-17T18:54:25.119944] [INFO ] [MAIN ] FFA: Loaded 5963 existing records. [2025-10-17T18:54:25.297361] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:25.297555] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-17T18:54:25.297603] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-17T18:54:25.297787] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-17T18:54:25.297844] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-17T18:54:25.563158] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-17T18:54:25.658136] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:25.952095] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:54:26.358074] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-17T18:54:26.488605] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T18:54:27.158028] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-17T18:54:27.958003] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-17T18:54:28.068229] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T18:54:28.136253] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:54:28.758083] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-17T18:54:29.300920] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:54:29.313624] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T18:54:29.558021] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-17T18:54:30.135610] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T18:54:30.358029] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-17T18:54:31.062607] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T18:54:31.158028] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-17T18:54:31.958020] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-17T18:54:32.175940] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T18:54:32.758045] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-17T18:54:32.796183] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T18:54:33.174419] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T18:54:33.558044] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-17T18:54:34.358009] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-17T18:54:35.148553] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:54:35.158007] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-17T18:54:35.742626] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T18:54:35.908782] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T18:54:35.958011] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-17T18:54:36.758031] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-17T18:54:37.558070] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-17T18:54:37.704235] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T18:54:37.914497] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T18:54:38.169316] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T18:54:38.358070] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-17T18:54:39.133420] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T18:54:39.158023] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-17T18:54:39.958013] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-17T18:54:40.099828] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T18:54:40.603374] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-17T18:54:40.758057] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-17T18:54:41.558072] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-17T18:54:42.020691] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:54:42.323106] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:54:42.358065] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-17T18:54:43.109626] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T18:54:43.111527] [INFO ] [REMOTE ] FFA: Full fetch complete (8739 records). [2025-10-17T18:54:43.111614] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-17T18:54:43.167833] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-17T18:54:43.489337] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-17T18:54:43.489467] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-17T18:54:43.489884] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-17T18:54:43.489961] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-17T18:54:43.490978] [DEBUG] [LOCAL ] FFA: Trimmed 8739 records to 5984 (keeping 200 days of data) [2025-10-17T18:54:43.533340] [DEBUG] [LOCAL ] FFA: Primary data saved (5984 records). [2025-10-17T18:54:43.533531] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-17T18:54:43.533677] [INFO ] [MAIN ] Update Progress: 820/2368 symbols completed. FFA took 18.6s. Estimated remaining: 3h 36m 27s. Rate: 7.2 symbols/min [2025-10-17T18:54:43.708964] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:43.729237] [DEBUG] [LOCAL ] FFC: Loaded 16818 existing records from primary storage. [2025-10-17T18:54:43.729579] [INFO ] [MAIN ] FFC: Loaded 16818 existing records. [2025-10-17T18:54:43.917341] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:43.917753] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-17T18:54:43.917829] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-17T18:54:43.918165] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-17T18:54:43.918242] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-17T18:54:43.963306] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-17T18:54:44.289484] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:44.301712] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T18:54:44.758096] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-17T18:54:45.558043] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-17T18:54:45.830685] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T18:54:46.165201] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T18:54:46.172164] [INFO ] [REMOTE ] FERG: Full fetch complete (71149 records). [2025-10-17T18:54:46.172309] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-17T18:54:46.365414] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-17T18:54:46.483708] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T18:54:46.579538] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-17T18:54:46.579617] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-17T18:54:46.580536] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-17T18:54:46.580596] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-17T18:54:46.581972] [DEBUG] [LOCAL ] FERG: Trimmed 71149 records to 49492 (keeping 200 days of data) [2025-10-17T18:54:46.885932] [DEBUG] [LOCAL ] FERG: Primary data saved (49492 records). [2025-10-17T18:54:46.886066] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-17T18:54:46.886161] [INFO ] [MAIN ] Update Progress: 821/2368 symbols completed. FERG took 51.1s. Estimated remaining: 3h 36m 9s. Rate: 7.2 symbols/min [2025-10-17T18:54:47.051494] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:47.084318] [DEBUG] [LOCAL ] FFWM: Loaded 36234 existing records from primary storage. [2025-10-17T18:54:47.084588] [INFO ] [MAIN ] FFWM: Loaded 36234 existing records. [2025-10-17T18:54:47.160168] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-17T18:54:47.260137] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:47.260372] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-17T18:54:47.260424] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-17T18:54:47.260605] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-17T18:54:47.260685] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-17T18:54:47.513693] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T18:54:47.628282] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:47.957993] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-17T18:54:48.285261] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:54:48.758030] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-17T18:54:48.915913] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T18:54:49.558049] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-17T18:54:50.160678] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T18:54:50.358020] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-17T18:54:50.621711] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T18:54:51.158063] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-17T18:54:51.445717] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:54:51.958000] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-17T18:54:52.106376] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T18:54:52.758052] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-17T18:54:53.290335] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:54:53.558004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-17T18:54:53.725305] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T18:54:53.727760] [INFO ] [REMOTE ] FET: Full fetch complete (18415 records). [2025-10-17T18:54:53.727833] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-17T18:54:54.120574] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-17T18:54:54.120673] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-17T18:54:54.121093] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-17T18:54:54.121152] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-17T18:54:54.121692] [DEBUG] [LOCAL ] FET: Trimmed 18415 records to 13043 (keeping 200 days of data) [2025-10-17T18:54:54.195582] [DEBUG] [LOCAL ] FET: Primary data saved (13043 records). [2025-10-17T18:54:54.195749] [INFO ] [MAIN ] FET: Full history saved. [2025-10-17T18:54:54.195838] [INFO ] [MAIN ] Update Progress: 822/2368 symbols completed. FET took 39.2s. Estimated remaining: 3h 35m 59s. Rate: 7.2 symbols/min [2025-10-17T18:54:54.361879] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-17T18:54:54.361781] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:54.387714] [DEBUG] [LOCAL ] FG: Loaded 22335 existing records from primary storage. [2025-10-17T18:54:54.387997] [INFO ] [MAIN ] FG: Loaded 22335 existing records. [2025-10-17T18:54:54.562287] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:54.562564] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-17T18:54:54.562615] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-17T18:54:54.562974] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-17T18:54:54.563029] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-17T18:54:54.922606] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:54.962108] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:54:55.127872] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T18:54:55.158074] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-17T18:54:55.926773] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T18:54:55.958073] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-17T18:54:56.758038] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-17T18:54:56.794681] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:54:57.558020] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-17T18:54:57.716608] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T18:54:58.358038] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-17T18:54:58.370514] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T18:54:59.000160] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T18:54:59.158030] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-17T18:54:59.958047] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-17T18:55:00.149426] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T18:55:00.758027] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-17T18:55:01.312734] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T18:55:01.316401] [INFO ] [REMOTE ] FF: Full fetch complete (36590 records). [2025-10-17T18:55:01.316505] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-17T18:55:01.563259] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-17T18:55:01.719918] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-17T18:55:01.720018] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-17T18:55:01.720971] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-17T18:55:01.721048] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-17T18:55:01.722195] [DEBUG] [LOCAL ] FF: Trimmed 36590 records to 24686 (keeping 200 days of data) [2025-10-17T18:55:01.882227] [DEBUG] [LOCAL ] FF: Primary data saved (24686 records). [2025-10-17T18:55:01.882385] [INFO ] [MAIN ] FF: Full history saved. [2025-10-17T18:55:01.882475] [INFO ] [MAIN ] Update Progress: 823/2368 symbols completed. FF took 43.9s. Estimated remaining: 3h 35m 49s. Rate: 7.2 symbols/min [2025-10-17T18:55:02.070311] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:02.078451] [DEBUG] [LOCAL ] FGN: Loaded 3741 existing records from primary storage. [2025-10-17T18:55:02.078727] [INFO ] [MAIN ] FGN: Loaded 3741 existing records. [2025-10-17T18:55:02.275869] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:02.276127] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-17T18:55:02.276203] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-17T18:55:02.276377] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-17T18:55:02.276444] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-17T18:55:02.368226] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-17T18:55:02.667699] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:03.110549] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:55:03.158024] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-17T18:55:03.267122] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T18:55:03.450858] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-17T18:55:03.783040] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T18:55:03.958014] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-17T18:55:04.532812] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T18:55:04.758152] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-17T18:55:05.558042] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-17T18:55:05.845795] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:55:06.358028] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-17T18:55:07.073194] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T18:55:07.158027] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-17T18:55:07.739438] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T18:55:07.957991] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-17T18:55:08.270143] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:55:08.758024] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-17T18:55:09.211048] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T18:55:09.343119] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T18:55:09.558032] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-17T18:55:10.358007] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-17T18:55:10.633014] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:55:10.635665] [INFO ] [REMOTE ] FFC: Full fetch complete (24497 records). [2025-10-17T18:55:10.635767] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-17T18:55:11.036317] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-17T18:55:11.036407] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-17T18:55:11.037012] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-17T18:55:11.037077] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-17T18:55:11.037794] [DEBUG] [LOCAL ] FFC: Trimmed 24497 records to 16896 (keeping 200 days of data) [2025-10-17T18:55:11.146755] [DEBUG] [LOCAL ] FFC: Primary data saved (16896 records). [2025-10-17T18:55:11.146910] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-17T18:55:11.147001] [INFO ] [MAIN ] Update Progress: 824/2368 symbols completed. FFC took 27.6s. Estimated remaining: 3h 35m 43s. Rate: 7.2 symbols/min [2025-10-17T18:55:11.163114] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-17T18:55:11.337793] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:11.337981] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-17T18:55:11.338020] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-17T18:55:11.338130] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-17T18:55:11.338191] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-17T18:55:11.338245] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-17T18:55:11.338282] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-17T18:55:11.738984] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:11.920738] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T18:55:11.957981] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-17T18:55:12.192287] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:55:12.192633] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-17T18:55:12.192787] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:55:12.192859] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-17T18:55:12.192931] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:55:12.193006] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-17T18:55:12.193073] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-17T18:55:12.193113] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-17T18:55:12.193153] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-17T18:55:12.193200] [INFO ] [MAIN ] Update Progress: 825/2368 symbols completed. FGSN took 1.0s. Estimated remaining: 3h 35m 21s. Rate: 7.2 symbols/min [2025-10-17T18:55:12.335638] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T18:55:12.396197] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:12.438567] [DEBUG] [LOCAL ] FHI: Loaded 40215 existing records from primary storage. [2025-10-17T18:55:12.438918] [INFO ] [MAIN ] FHI: Loaded 40215 existing records. [2025-10-17T18:55:12.639270] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:12.639520] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-17T18:55:12.639577] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-17T18:55:12.639865] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-17T18:55:12.639935] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-17T18:55:12.763133] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-17T18:55:13.018520] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:13.433446] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T18:55:13.558023] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-17T18:55:14.358026] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-17T18:55:14.879177] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:55:14.952998] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T18:55:15.158038] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-17T18:55:15.958101] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-17T18:55:16.480194] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T18:55:16.623901] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T18:55:16.758011] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-17T18:55:17.558039] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-17T18:55:18.157930] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T18:55:18.358007] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-17T18:55:18.562715] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T18:55:19.158018] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-17T18:55:19.509447] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:55:19.764599] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T18:55:19.958051] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-17T18:55:20.494486] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-17T18:55:20.758059] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-17T18:55:21.558041] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-17T18:55:22.272146] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:55:22.358013] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-17T18:55:22.559891] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T18:55:22.949513] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:55:23.158057] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-17T18:55:23.654101] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-17T18:55:23.958028] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-17T18:55:24.758072] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-17T18:55:25.045611] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:55:25.558045] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-17T18:55:26.130765] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:55:26.358013] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-17T18:55:26.505964] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:55:26.506900] [INFO ] [REMOTE ] FGN: Full fetch complete (5586 records). [2025-10-17T18:55:26.506970] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-17T18:55:26.864620] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-17T18:55:26.864734] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-17T18:55:26.864917] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-17T18:55:26.864977] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-17T18:55:26.865388] [DEBUG] [LOCAL ] FGN: Trimmed 5586 records to 3750 (keeping 200 days of data) [2025-10-17T18:55:26.887997] [DEBUG] [LOCAL ] FGN: Primary data saved (3750 records). [2025-10-17T18:55:26.888071] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-17T18:55:26.888169] [INFO ] [MAIN ] Update Progress: 826/2368 symbols completed. FGN took 25.0s. Estimated remaining: 3h 35m 24s. Rate: 7.2 symbols/min [2025-10-17T18:55:27.053896] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:27.054031] [DEBUG] [LOCAL ] FHN: No existing data file found in primary storage. [2025-10-17T18:55:27.054069] [WARN ] [MAIN ] FHN: No existing data found, performing full refresh instead. [2025-10-17T18:55:27.054195] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-17T18:55:27.054241] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-17T18:55:27.054283] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-17T18:55:27.054317] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-17T18:55:27.163085] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-17T18:55:27.405142] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:27.429590] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:55:27.432989] [INFO ] [REMOTE ] FG: Full fetch complete (28779 records). [2025-10-17T18:55:27.433066] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-17T18:55:27.790767] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-17T18:55:27.790844] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-17T18:55:27.791384] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-17T18:55:27.791424] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-17T18:55:27.792126] [DEBUG] [LOCAL ] FG: Trimmed 28779 records to 22484 (keeping 200 days of data) [2025-10-17T18:55:27.929861] [DEBUG] [LOCAL ] FG: Primary data saved (22484 records). [2025-10-17T18:55:27.929987] [INFO ] [MAIN ] FG: Full history saved. [2025-10-17T18:55:27.930063] [INFO ] [MAIN ] Update Progress: 827/2368 symbols completed. FG took 33.7s. Estimated remaining: 3h 35m 2s. Rate: 7.2 symbols/min [2025-10-17T18:55:27.961233] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-17T18:55:28.097355] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:28.159339] [DEBUG] [LOCAL ] FI: Loaded 53970 existing records from primary storage. [2025-10-17T18:55:28.159716] [INFO ] [MAIN ] FI: Loaded 53970 existing records. [2025-10-17T18:55:28.334261] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:28.334463] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-17T18:55:28.334510] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-17T18:55:28.334819] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-17T18:55:28.334875] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-17T18:55:28.682395] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:28.762983] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-17T18:55:28.764868] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T18:55:28.770299] [INFO ] [REMOTE ] FFWM: Full fetch complete (51931 records). [2025-10-17T18:55:28.770397] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-17T18:55:29.136903] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-17T18:55:29.136980] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-17T18:55:29.137783] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-17T18:55:29.137846] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-17T18:55:29.138943] [DEBUG] [LOCAL ] FFWM: Trimmed 51931 records to 36515 (keeping 200 days of data) [2025-10-17T18:55:29.336536] [DEBUG] [LOCAL ] FFWM: Primary data saved (36515 records). [2025-10-17T18:55:29.336697] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-17T18:55:29.336803] [INFO ] [MAIN ] Update Progress: 828/2368 symbols completed. FFWM took 42.5s. Estimated remaining: 3h 34m 41s. Rate: 7.2 symbols/min [2025-10-17T18:55:29.505979] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:29.528877] [DEBUG] [LOCAL ] FICO: Loaded 21912 existing records from primary storage. [2025-10-17T18:55:29.529140] [INFO ] [MAIN ] FICO: Loaded 21912 existing records. [2025-10-17T18:55:29.570707] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-17T18:55:29.706865] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:29.707108] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-17T18:55:29.707298] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-17T18:55:29.707537] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-17T18:55:29.707593] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-17T18:55:29.910127] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T18:55:30.099993] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:30.357996] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-17T18:55:30.422226] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:55:31.165353] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-17T18:55:31.182504] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:55:31.251558] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:55:31.958067] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-17T18:55:32.758008] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-17T18:55:33.019746] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T18:55:33.557999] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-17T18:55:33.630276] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:55:34.260072] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:55:34.358018] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-17T18:55:34.966369] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T18:55:35.158018] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-17T18:55:35.958021] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-17T18:55:36.251357] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T18:55:36.758040] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-17T18:55:36.903628] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:55:37.551178] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:55:37.559418] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-17T18:55:37.885119] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T18:55:38.358039] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-17T18:55:39.158022] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-17T18:55:39.402491] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:55:39.888223] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T18:55:39.958952] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T18:55:39.959029] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-17T18:55:40.758097] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-17T18:55:41.558015] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-17T18:55:41.785205] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:55:42.273206] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T18:55:42.358039] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-17T18:55:43.158055] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-17T18:55:43.766740] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-17T18:55:43.918110] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:55:43.957989] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-17T18:55:44.202975] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T18:55:44.758083] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-17T18:55:45.457590] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:55:45.463023] [INFO ] [REMOTE ] FHI: Full fetch complete (57712 records). [2025-10-17T18:55:45.463191] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-17T18:55:45.563232] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-17T18:55:45.842293] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-17T18:55:45.842368] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-17T18:55:45.843141] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-17T18:55:45.843202] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-17T18:55:45.844303] [DEBUG] [LOCAL ] FHI: Trimmed 57712 records to 40432 (keeping 200 days of data) [2025-10-17T18:55:46.084251] [DEBUG] [LOCAL ] FHI: Primary data saved (40432 records). [2025-10-17T18:55:46.084415] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-17T18:55:46.084508] [INFO ] [MAIN ] Update Progress: 829/2368 symbols completed. FHI took 33.9s. Estimated remaining: 3h 34m 48s. Rate: 7.2 symbols/min [2025-10-17T18:55:46.259391] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:46.259563] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-17T18:55:46.259601] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-17T18:55:46.259737] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-17T18:55:46.259780] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-17T18:55:46.259819] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-17T18:55:46.259851] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-17T18:55:46.363251] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-17T18:55:46.614596] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:46.716686] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:55:46.784525] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T18:55:47.158026] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-17T18:55:47.958019] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-17T18:55:48.132170] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T18:55:48.757999] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-17T18:55:49.121241] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T18:55:49.355435] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:55:49.558013] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-17T18:55:50.256700] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T18:55:50.357994] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-17T18:55:50.626276] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T18:55:50.677776] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-17T18:55:51.158037] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-17T18:55:51.384527] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-17T18:55:51.958025] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-17T18:55:52.758031] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-17T18:55:53.330470] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T18:55:53.558032] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-17T18:55:54.357997] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-17T18:55:54.921665] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T18:55:55.157998] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-17T18:55:55.411766] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:55:55.617933] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T18:55:55.958006] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-17T18:55:56.758026] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-17T18:55:57.066007] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-17T18:55:57.127594] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T18:55:57.178898] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T18:55:57.558021] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-17T18:55:57.851048] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-17T18:55:58.358024] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-17T18:55:59.158035] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-17T18:55:59.958009] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-17T18:56:00.309462] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:56:00.360046] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-17T18:56:00.758009] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-17T18:56:00.772494] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T18:56:00.776737] [INFO ] [REMOTE ] FICO: Full fetch complete (29941 records). [2025-10-17T18:56:00.776827] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-17T18:56:01.195930] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-17T18:56:01.196233] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-17T18:56:01.196983] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-17T18:56:01.197067] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-17T18:56:01.197912] [DEBUG] [LOCAL ] FICO: Trimmed 29941 records to 22042 (keeping 200 days of data) [2025-10-17T18:56:01.310068] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T18:56:01.344423] [DEBUG] [LOCAL ] FICO: Primary data saved (22042 records). [2025-10-17T18:56:01.344545] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-17T18:56:01.344627] [INFO ] [MAIN ] Update Progress: 830/2368 symbols completed. FICO took 32.0s. Estimated remaining: 3h 34m 52s. Rate: 7.2 symbols/min [2025-10-17T18:56:01.518983] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:01.560582] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-17T18:56:01.562421] [DEBUG] [LOCAL ] FIGS: Loaded 48947 existing records from primary storage. [2025-10-17T18:56:01.562859] [INFO ] [MAIN ] FIGS: Loaded 48947 existing records. [2025-10-17T18:56:01.742433] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:01.742700] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-17T18:56:01.742758] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-17T18:56:01.743019] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-17T18:56:01.743059] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-17T18:56:02.131857] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:02.163096] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:56:02.163610] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-17T18:56:02.163741] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:56:02.163878] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-17T18:56:02.163951] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:56:02.164029] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-17T18:56:02.164107] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-17T18:56:02.164148] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-17T18:56:02.164188] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-17T18:56:02.164242] [INFO ] [MAIN ] Update Progress: 831/2368 symbols completed. FIG took 16.1s. Estimated remaining: 3h 34m 30s. Rate: 7.2 symbols/min [2025-10-17T18:56:02.336659] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:02.358040] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-17T18:56:02.375738] [DEBUG] [LOCAL ] FIHL: Loaded 39714 existing records from primary storage. [2025-10-17T18:56:02.376026] [INFO ] [MAIN ] FIHL: Loaded 39714 existing records. [2025-10-17T18:56:02.547249] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:02.547460] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-17T18:56:02.547508] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-17T18:56:02.547708] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-17T18:56:02.547765] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-17T18:56:02.892090] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:03.158034] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-17T18:56:03.958115] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-17T18:56:04.081870] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:56:04.758133] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-17T18:56:04.978518] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:56:05.257600] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T18:56:05.558026] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-17T18:56:06.358001] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-17T18:56:06.602759] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:56:06.610236] [INFO ] [REMOTE ] FI: Full fetch complete (77457 records). [2025-10-17T18:56:06.610407] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-17T18:56:06.994602] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-17T18:56:06.994758] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-17T18:56:06.995700] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-17T18:56:06.995764] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-17T18:56:06.997194] [DEBUG] [LOCAL ] FI: Trimmed 77457 records to 54357 (keeping 200 days of data) [2025-10-17T18:56:07.168228] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-17T18:56:07.333961] [DEBUG] [LOCAL ] FI: Primary data saved (54357 records). [2025-10-17T18:56:07.334261] [INFO ] [MAIN ] FI: Full history saved. [2025-10-17T18:56:07.334987] [INFO ] [MAIN ] Update Progress: 832/2368 symbols completed. FI took 39.4s. Estimated remaining: 3h 34m 16s. Rate: 7.2 symbols/min [2025-10-17T18:56:07.561094] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:07.563789] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T18:56:07.598877] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T18:56:07.610165] [DEBUG] [LOCAL ] FINS: Loaded 8363 existing records from primary storage. [2025-10-17T18:56:07.610417] [INFO ] [MAIN ] FINS: Loaded 8363 existing records. [2025-10-17T18:56:07.803232] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:07.803739] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-17T18:56:07.803801] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-17T18:56:07.803991] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-17T18:56:07.804049] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-17T18:56:07.963205] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-17T18:56:08.197091] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:08.517049] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:56:08.758027] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-17T18:56:09.558059] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-17T18:56:09.930976] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T18:56:09.938497] [INFO ] [REMOTE ] FHN: Full fetch complete (77472 records). [2025-10-17T18:56:09.938637] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-17T18:56:10.365338] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-17T18:56:10.370788] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-17T18:56:10.373405] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:56:10.373691] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-17T18:56:10.382281] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-17T18:56:10.382771] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-17T18:56:10.385323] [DEBUG] [LOCAL ] FHN: Trimmed 77472 records to 54172 (keeping 200 days of data) [2025-10-17T18:56:10.516820] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T18:56:10.737289] [DEBUG] [LOCAL ] FHN: Primary data saved (54172 records). [2025-10-17T18:56:10.737443] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-17T18:56:10.737518] [INFO ] [MAIN ] Update Progress: 833/2368 symbols completed. FHN took 43.8s. Estimated remaining: 3h 33m 58s. Rate: 7.2 symbols/min [2025-10-17T18:56:10.901600] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:10.941740] [DEBUG] [LOCAL ] FINV: Loaded 45609 existing records from primary storage. [2025-10-17T18:56:10.942061] [INFO ] [MAIN ] FINV: Loaded 45609 existing records. [2025-10-17T18:56:11.112543] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:11.112785] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-17T18:56:11.112832] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-17T18:56:11.113063] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-17T18:56:11.113119] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-17T18:56:11.165789] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-17T18:56:11.462395] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:11.958021] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-17T18:56:12.003447] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:56:12.036305] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T18:56:12.758043] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-17T18:56:13.306890] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T18:56:13.558008] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-17T18:56:14.218887] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T18:56:14.241022] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T18:56:14.358042] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-17T18:56:15.158040] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-17T18:56:15.896684] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:56:15.957991] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-17T18:56:16.757997] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-17T18:56:16.844382] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T18:56:17.320293] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T18:56:17.429832] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T18:56:17.558054] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-17T18:56:18.358083] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-17T18:56:19.002810] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:56:19.158072] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-17T18:56:19.781748] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:56:19.958039] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-17T18:56:20.758024] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-17T18:56:20.857807] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:56:21.384160] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T18:56:21.558013] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-17T18:56:21.946985] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:56:22.358030] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-17T18:56:23.091536] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T18:56:23.160170] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-17T18:56:23.162925] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T18:56:23.963685] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-17T18:56:23.965997] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:56:24.758048] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-17T18:56:25.469212] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:56:25.558016] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-17T18:56:26.340038] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T18:56:26.357980] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-17T18:56:27.060122] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T18:56:27.158030] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-17T18:56:27.958011] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-17T18:56:28.174427] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:56:28.616118] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:56:28.621613] [INFO ] [REMOTE ] FIHL: Full fetch complete (56385 records). [2025-10-17T18:56:28.621763] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-17T18:56:28.763344] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-17T18:56:29.007076] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-17T18:56:29.007159] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-17T18:56:29.007968] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-17T18:56:29.008034] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-17T18:56:29.009223] [DEBUG] [LOCAL ] FIHL: Trimmed 56385 records to 39982 (keeping 200 days of data) [2025-10-17T18:56:29.251384] [DEBUG] [LOCAL ] FIHL: Primary data saved (39982 records). [2025-10-17T18:56:29.251518] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-17T18:56:29.252021] [INFO ] [MAIN ] Update Progress: 834/2368 symbols completed. FIHL took 27.1s. Estimated remaining: 3h 34m 8s. Rate: 7.2 symbols/min [2025-10-17T18:56:29.417461] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:29.468959] [DEBUG] [LOCAL ] FIS: Loaded 53727 existing records from primary storage. [2025-10-17T18:56:29.469273] [INFO ] [MAIN ] FIS: Loaded 53727 existing records. [2025-10-17T18:56:29.562993] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-17T18:56:29.654411] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:29.654955] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-17T18:56:29.655168] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-17T18:56:29.655614] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-17T18:56:29.655748] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-17T18:56:29.778589] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:56:30.046959] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:30.339608] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T18:56:30.357993] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-17T18:56:30.413446] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:56:31.091569] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T18:56:31.158022] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-17T18:56:31.855674] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T18:56:31.957999] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-17T18:56:32.746625] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T18:56:32.758013] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-17T18:56:33.554530] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T18:56:33.555981] [INFO ] [REMOTE ] FINS: Full fetch complete (11621 records). [2025-10-17T18:56:33.556051] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-17T18:56:33.567245] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-17T18:56:33.923826] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-17T18:56:33.923918] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-17T18:56:33.924216] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-17T18:56:33.924260] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-17T18:56:33.924756] [DEBUG] [LOCAL ] FINS: Trimmed 11621 records to 8404 (keeping 200 days of data) [2025-10-17T18:56:33.977098] [DEBUG] [LOCAL ] FINS: Primary data saved (8404 records). [2025-10-17T18:56:33.977258] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-17T18:56:33.977365] [INFO ] [MAIN ] Update Progress: 835/2368 symbols completed. FINS took 26.6s. Estimated remaining: 3h 33m 53s. Rate: 7.2 symbols/min [2025-10-17T18:56:34.148325] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:34.179049] [DEBUG] [LOCAL ] FIX: Loaded 29033 existing records from primary storage. [2025-10-17T18:56:34.179311] [INFO ] [MAIN ] FIX: Loaded 29033 existing records. [2025-10-17T18:56:34.354842] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:34.355087] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-17T18:56:34.355137] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-17T18:56:34.355355] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-17T18:56:34.355413] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-17T18:56:34.366696] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-17T18:56:34.717809] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:35.158035] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-17T18:56:35.396173] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:56:35.958042] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-17T18:56:36.444131] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T18:56:36.471409] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:56:36.758023] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-17T18:56:37.558099] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-17T18:56:37.593816] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:56:38.205065] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T18:56:38.358040] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-17T18:56:39.158053] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-17T18:56:39.725713] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T18:56:39.865861] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:56:39.958040] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-17T18:56:40.590496] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:56:40.758015] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-17T18:56:41.558024] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-17T18:56:41.732490] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T18:56:41.742739] [INFO ] [REMOTE ] FIGS: Full fetch complete (70879 records). [2025-10-17T18:56:41.742881] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-17T18:56:42.125860] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-17T18:56:42.126043] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-17T18:56:42.126949] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-17T18:56:42.127023] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-17T18:56:42.128442] [DEBUG] [LOCAL ] FIGS: Trimmed 70879 records to 49320 (keeping 200 days of data) [2025-10-17T18:56:42.230829] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T18:56:42.358678] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-17T18:56:42.426532] [DEBUG] [LOCAL ] FIGS: Primary data saved (49320 records). [2025-10-17T18:56:42.426684] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-17T18:56:42.426777] [INFO ] [MAIN ] Update Progress: 836/2368 symbols completed. FIGS took 41.1s. Estimated remaining: 3h 33m 45s. Rate: 7.2 symbols/min [2025-10-17T18:56:42.596287] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:42.596452] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-17T18:56:42.596494] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-17T18:56:42.596603] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-17T18:56:42.596694] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-17T18:56:42.596778] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-17T18:56:42.596831] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-17T18:56:42.952734] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:42.983919] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T18:56:43.158022] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-17T18:56:43.958049] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-17T18:56:44.036271] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T18:56:44.159530] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:56:44.159953] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-17T18:56:44.160073] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:56:44.160168] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-17T18:56:44.160253] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:56:44.160344] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-17T18:56:44.160438] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-17T18:56:44.160498] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-17T18:56:44.160561] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-17T18:56:44.160629] [INFO ] [MAIN ] Update Progress: 837/2368 symbols completed. FIXT took 1.7s. Estimated remaining: 3h 33m 25s. Rate: 7.2 symbols/min [2025-10-17T18:56:44.629849] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:56:44.758021] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-17T18:56:45.558035] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-17T18:56:46.358023] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-17T18:56:46.461036] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:56:47.158007] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-17T18:56:47.402181] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T18:56:47.958043] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-17T18:56:47.994515] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:56:48.758040] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-17T18:56:48.825959] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:56:49.558003] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-17T18:56:49.897207] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T18:56:50.358032] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-17T18:56:50.388097] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:56:51.158001] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-17T18:56:51.251765] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:56:51.258593] [INFO ] [REMOTE ] FINV: Full fetch complete (64712 records). [2025-10-17T18:56:51.258733] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-17T18:56:51.687825] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-17T18:56:51.687905] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-17T18:56:51.688893] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-17T18:56:51.688959] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-17T18:56:51.690477] [DEBUG] [LOCAL ] FINV: Trimmed 64712 records to 45943 (keeping 200 days of data) [2025-10-17T18:56:51.964269] [DEBUG] [LOCAL ] FINV: Primary data saved (45943 records). [2025-10-17T18:56:51.964449] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-17T18:56:51.964687] [INFO ] [MAIN ] Update Progress: 838/2368 symbols completed. FINV took 41.2s. Estimated remaining: 3h 33m 15s. Rate: 7.2 symbols/min [2025-10-17T18:56:52.060970] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T18:56:52.072768] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-17T18:56:52.559587] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:56:52.758105] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-17T18:56:53.978920] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T18:56:53.994672] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-17T18:56:54.046113] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T18:56:54.358055] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-17T18:56:55.745075] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T18:56:55.751816] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-17T18:56:55.787335] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:56:55.958013] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-17T18:56:57.138541] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:56:57.145299] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-17T18:56:57.840735] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T18:56:57.852268] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-17T18:56:58.431855] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:56:58.438457] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-17T18:56:58.717962] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T18:56:58.726159] [INFO ] [REMOTE ] FIS: Full fetch complete (77393 records). [2025-10-17T18:56:58.726387] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-17T18:56:59.127336] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-17T18:56:59.127458] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-17T18:56:59.128479] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-17T18:56:59.128551] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-17T18:56:59.130700] [DEBUG] [LOCAL ] FIS: Trimmed 77393 records to 54114 (keeping 200 days of data) [2025-10-17T18:56:59.478934] [DEBUG] [LOCAL ] FIS: Primary data saved (54114 records). [2025-10-17T18:56:59.479162] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-17T18:56:59.479991] [INFO ] [MAIN ] Update Progress: 839/2368 symbols completed. FIS took 30.2s. Estimated remaining: 3h 33m 5s. Rate: 7.2 symbols/min [2025-10-17T18:56:59.586069] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T18:56:59.590315] [INFO ] [REMOTE ] FIX: Full fetch complete (45584 records). [2025-10-17T18:56:59.590399] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-17T18:56:59.955344] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-17T18:56:59.955418] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-17T18:56:59.956020] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-17T18:56:59.956081] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-17T18:56:59.956979] [DEBUG] [LOCAL ] FIX: Trimmed 45584 records to 29256 (keeping 200 days of data) [2025-10-17T18:57:00.141003] [DEBUG] [LOCAL ] FIX: Primary data saved (29256 records). [2025-10-17T18:57:00.141178] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-17T18:57:00.141314] [INFO ] [MAIN ] Update Progress: 840/2368 symbols completed. FIX took 26.2s. Estimated remaining: 3h 32m 43s. Rate: 7.2 symbols/min [2025-10-17T18:57:00.828359] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.826806] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.914730] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.952870] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.963430] [DEBUG] [LOCAL ] FLC: Loaded 5440 existing records from primary storage. [2025-10-17T18:57:00.963865] [INFO ] [MAIN ] FLC: Loaded 5440 existing records. [2025-10-17T18:57:01.105403] [DEBUG] [LOCAL ] FLNG: Loaded 33918 existing records from primary storage. [2025-10-17T18:57:01.145005] [INFO ] [MAIN ] FLNG: Loaded 33918 existing records. [2025-10-17T18:57:01.245105] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:01.259355] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-17T18:57:01.299092] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-17T18:57:01.324899] [DEBUG] [LOCAL ] FLG: Loaded 53717 existing records from primary storage. [2025-10-17T18:57:01.332072] [DEBUG] [LOCAL ] FLO: Loaded 52459 existing records from primary storage. [2025-10-17T18:57:01.348568] [INFO ] [MAIN ] FLG: Loaded 53717 existing records. [2025-10-17T18:57:01.362570] [INFO ] [MAIN ] FLO: Loaded 52459 existing records. [2025-10-17T18:57:01.354426] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-17T18:57:01.363180] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-17T18:57:01.748998] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:01.836879] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-17T18:57:01.842431] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-17T18:57:01.847947] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-17T18:57:01.849078] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-17T18:57:02.142458] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:02.186127] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-17T18:57:02.199708] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-17T18:57:02.281438] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:02.305966] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-17T18:57:02.328233] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-17T18:57:02.352190] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-17T18:57:02.366881] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-17T18:57:02.411594] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-17T18:57:02.496378] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-17T18:57:02.825799] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:02.874096] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-17T18:57:03.237594] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:03.264447] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-17T18:57:03.483089] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:03.494279] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-17T18:57:03.555723] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:03.556096] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-17T18:57:03.647425] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T18:57:03.649663] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-17T18:57:04.303671] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T18:57:04.305802] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-17T18:57:04.780925] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:57:04.789253] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-17T18:57:04.891283] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T18:57:04.894405] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T18:57:04.907915] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-17T18:57:05.373573] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:57:05.558064] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-17T18:57:05.905972] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:57:06.358080] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-17T18:57:06.633304] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:57:07.158049] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-17T18:57:07.306308] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T18:57:07.771875] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T18:57:07.958002] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-17T18:57:08.584138] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T18:57:08.758020] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-17T18:57:09.454297] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T18:57:09.557990] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-17T18:57:09.890911] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T18:57:10.253719] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T18:57:10.358014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-17T18:57:11.158025] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-17T18:57:11.958069] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-17T18:57:12.182295] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:57:12.540952] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:57:12.552946] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T18:57:12.757998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-17T18:57:13.558071] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-17T18:57:14.213098] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:57:14.358045] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-17T18:57:14.396764] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:57:15.007247] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T18:57:15.158019] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-17T18:57:15.864741] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:57:15.957984] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-17T18:57:16.549838] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T18:57:16.758024] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-17T18:57:17.311623] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T18:57:17.312770] [INFO ] [REMOTE ] FLC: Full fetch complete (7776 records). [2025-10-17T18:57:17.312865] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-17T18:57:17.563193] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-17T18:57:17.673938] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-17T18:57:17.674015] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-17T18:57:17.674223] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-17T18:57:17.674282] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-17T18:57:17.674716] [DEBUG] [LOCAL ] FLC: Trimmed 7776 records to 5454 (keeping 200 days of data) [2025-10-17T18:57:17.707697] [DEBUG] [LOCAL ] FLC: Primary data saved (5454 records). [2025-10-17T18:57:17.707792] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-17T18:57:17.707883] [INFO ] [MAIN ] Update Progress: 841/2368 symbols completed. FLC took 17.6s. Estimated remaining: 3h 32m 51s. Rate: 7.2 symbols/min [2025-10-17T18:57:17.872372] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:17.872539] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-17T18:57:17.872575] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-17T18:57:17.872710] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-17T18:57:17.872766] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-17T18:57:17.872808] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-17T18:57:17.872839] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-17T18:57:18.218301] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:18.358025] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-17T18:57:18.579299] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:57:18.579627] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-17T18:57:18.579737] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:57:18.579786] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-17T18:57:18.579819] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:57:18.579858] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-17T18:57:18.579919] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-17T18:57:18.579953] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-17T18:57:18.579993] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-17T18:57:18.580037] [INFO ] [MAIN ] Update Progress: 842/2368 symbols completed. FLOC took 0.9s. Estimated remaining: 3h 32m 29s. Rate: 7.2 symbols/min [2025-10-17T18:57:18.749952] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:18.801775] [DEBUG] [LOCAL ] FLR: Loaded 53630 existing records from primary storage. [2025-10-17T18:57:18.802092] [INFO ] [MAIN ] FLR: Loaded 53630 existing records. [2025-10-17T18:57:18.980278] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:18.980543] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-17T18:57:18.980596] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-17T18:57:18.981068] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-17T18:57:18.981128] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-17T18:57:19.169380] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-17T18:57:19.338361] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:19.446673] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T18:57:19.958033] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-17T18:57:20.757996] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-17T18:57:21.020817] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T18:57:21.558020] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-17T18:57:21.718184] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T18:57:21.792846] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T18:57:22.358066] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-17T18:57:23.158006] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-17T18:57:23.271597] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T18:57:23.706093] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:57:23.958032] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-17T18:57:24.758031] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-17T18:57:24.987737] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T18:57:25.159590] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:57:25.558033] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-17T18:57:26.363243] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-17T18:57:26.382250] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:57:26.896758] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T18:57:27.158044] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-17T18:57:27.958043] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-17T18:57:28.187374] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:57:28.409446] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T18:57:28.758040] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-17T18:57:29.292704] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T18:57:29.558018] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-17T18:57:30.357996] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-17T18:57:30.462761] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:57:31.158026] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-17T18:57:31.357223] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:57:31.817489] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:57:31.958011] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-17T18:57:32.620448] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:57:32.758019] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-17T18:57:33.464160] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T18:57:33.557990] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-17T18:57:34.358055] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-17T18:57:34.513268] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:57:35.046959] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T18:57:35.158002] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-17T18:57:35.958004] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-17T18:57:36.129936] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T18:57:36.591357] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:57:36.758002] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-17T18:57:37.557990] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-17T18:57:37.775825] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T18:57:38.088035] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T18:57:38.092429] [INFO ] [REMOTE ] FLNG: Full fetch complete (50117 records). [2025-10-17T18:57:38.092509] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-17T18:57:38.363183] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-17T18:57:38.475269] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-17T18:57:38.475341] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-17T18:57:38.476069] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-17T18:57:38.476131] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-17T18:57:38.477110] [DEBUG] [LOCAL ] FLNG: Trimmed 50117 records to 34189 (keeping 200 days of data) [2025-10-17T18:57:38.679130] [DEBUG] [LOCAL ] FLNG: Primary data saved (34189 records). [2025-10-17T18:57:38.679243] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-17T18:57:38.679801] [INFO ] [MAIN ] Update Progress: 843/2368 symbols completed. FLNG took 38.5s. Estimated remaining: 3h 32m 42s. Rate: 7.2 symbols/min [2025-10-17T18:57:38.845302] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:38.892739] [DEBUG] [LOCAL ] FLS: Loaded 50762 existing records from primary storage. [2025-10-17T18:57:38.893246] [INFO ] [MAIN ] FLS: Loaded 50762 existing records. [2025-10-17T18:57:39.074681] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:39.075061] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-17T18:57:39.075153] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-17T18:57:39.075602] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-17T18:57:39.075694] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-17T18:57:39.163947] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-17T18:57:39.278766] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:57:39.468585] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:39.958043] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-17T18:57:40.126160] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:57:40.758038] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-17T18:57:41.234831] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-17T18:57:41.242522] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-17T18:57:41.242687] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-17T18:57:41.559911] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-17T18:57:41.662082] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-17T18:57:41.662308] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-17T18:57:41.663548] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-17T18:57:41.663686] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-17T18:57:41.697836] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:57:41.697984] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 54107 (keeping 200 days of data) [2025-10-17T18:57:42.047034] [DEBUG] [LOCAL ] FLG: Primary data saved (54107 records). [2025-10-17T18:57:42.047180] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-17T18:57:42.047285] [INFO ] [MAIN ] Update Progress: 844/2368 symbols completed. FLG took 41.9s. Estimated remaining: 3h 32m 25s. Rate: 7.2 symbols/min [2025-10-17T18:57:42.222724] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:42.272277] [DEBUG] [LOCAL ] FLUT: Loaded 51111 existing records from primary storage. [2025-10-17T18:57:42.272732] [INFO ] [MAIN ] FLUT: Loaded 51111 existing records. [2025-10-17T18:57:42.361984] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-17T18:57:42.453333] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:42.462597] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-17T18:57:42.476963] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-17T18:57:42.477390] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-17T18:57:42.477475] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-17T18:57:42.484184] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T18:57:42.839802] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:43.013630] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:57:43.022060] [INFO ] [REMOTE ] FLO: Full fetch complete (75278 records). [2025-10-17T18:57:43.022311] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-17T18:57:43.166952] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-17T18:57:43.432583] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-17T18:57:43.432741] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-17T18:57:43.433978] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-17T18:57:43.434044] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-17T18:57:43.435978] [DEBUG] [LOCAL ] FLO: Trimmed 75278 records to 52831 (keeping 200 days of data) [2025-10-17T18:57:43.768972] [DEBUG] [LOCAL ] FLO: Primary data saved (52831 records). [2025-10-17T18:57:43.769178] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-17T18:57:43.769285] [INFO ] [MAIN ] Update Progress: 845/2368 symbols completed. FLO took 43.6s. Estimated remaining: 3h 32m 4s. Rate: 7.2 symbols/min [2025-10-17T18:57:43.945684] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:43.960121] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-17T18:57:43.971863] [DEBUG] [LOCAL ] FLXR: Loaded 21214 existing records from primary storage. [2025-10-17T18:57:43.972219] [INFO ] [MAIN ] FLXR: Loaded 21214 existing records. [2025-10-17T18:57:44.154264] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:44.154857] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-17T18:57:44.155005] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-17T18:57:44.155361] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-17T18:57:44.155423] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-17T18:57:44.474422] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T18:57:44.585074] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:44.758053] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-17T18:57:44.893401] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:57:45.440878] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T18:57:45.474619] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T18:57:45.558040] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-17T18:57:46.358043] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-17T18:57:47.157997] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-17T18:57:47.329174] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:57:47.968529] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-17T18:57:47.975331] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:57:48.763286] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-17T18:57:48.767094] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T18:57:49.099013] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:57:49.558113] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-17T18:57:50.358218] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-17T18:57:50.479496] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:57:51.158006] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-17T18:57:51.263498] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T18:57:51.305424] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:57:51.958023] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-17T18:57:52.758008] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-17T18:57:53.136539] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T18:57:53.144461] [INFO ] [REMOTE ] FLR: Full fetch complete (76814 records). [2025-10-17T18:57:53.144585] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-17T18:57:53.551986] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-17T18:57:53.552139] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-17T18:57:53.553276] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-17T18:57:53.553378] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-17T18:57:53.555183] [DEBUG] [LOCAL ] FLR: Trimmed 76814 records to 54019 (keeping 200 days of data) [2025-10-17T18:57:53.602678] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-17T18:57:53.824875] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:57:53.836100] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T18:57:53.931949] [DEBUG] [LOCAL ] FLR: Primary data saved (54019 records). [2025-10-17T18:57:53.932090] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-17T18:57:53.932168] [INFO ] [MAIN ] Update Progress: 846/2368 symbols completed. FLR took 35.4s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-17T18:57:54.097247] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:54.145241] [DEBUG] [LOCAL ] FMC: Loaded 52236 existing records from primary storage. [2025-10-17T18:57:54.145563] [INFO ] [MAIN ] FMC: Loaded 52236 existing records. [2025-10-17T18:57:54.316883] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:54.317156] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-17T18:57:54.317211] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-17T18:57:54.317577] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-17T18:57:54.317634] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-17T18:57:54.369937] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-17T18:57:54.664379] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:55.158012] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-17T18:57:55.440741] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:57:55.958001] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-17T18:57:56.081325] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T18:57:56.113330] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T18:57:56.758007] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-17T18:57:57.558012] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-17T18:57:57.779404] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:57:58.365172] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-17T18:57:58.370439] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:57:58.555950] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T18:57:59.158022] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-17T18:57:59.958012] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-17T18:58:00.235356] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:58:00.758043] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-17T18:58:01.350088] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T18:58:01.558035] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-17T18:58:01.589440] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-17T18:58:02.358046] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-17T18:58:03.157990] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-17T18:58:03.188140] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-17T18:58:03.289407] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:58:03.957984] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-17T18:58:04.183954] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T18:58:04.285211] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T18:58:04.758066] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-17T18:58:05.558005] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-17T18:58:05.654936] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:58:06.358017] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-17T18:58:06.582896] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:58:07.158021] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-17T18:58:07.291970] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:58:07.958007] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-17T18:58:08.115577] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:58:08.291138] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:58:08.758023] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-17T18:58:09.558001] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-17T18:58:09.782526] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:58:10.358003] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-17T18:58:10.491318] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:58:10.498505] [INFO ] [REMOTE ] FLS: Full fetch complete (72471 records). [2025-10-17T18:58:10.498635] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-17T18:58:10.877458] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T18:58:10.904801] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-17T18:58:10.905196] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-17T18:58:10.906406] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-17T18:58:10.906473] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-17T18:58:10.907794] [DEBUG] [LOCAL ] FLS: Trimmed 72471 records to 51134 (keeping 200 days of data) [2025-10-17T18:58:11.170257] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-17T18:58:11.213529] [DEBUG] [LOCAL ] FLS: Primary data saved (51134 records). [2025-10-17T18:58:11.213666] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-17T18:58:11.214159] [INFO ] [MAIN ] Update Progress: 847/2368 symbols completed. FLS took 32.5s. Estimated remaining: 3h 32m 7s. Rate: 7.2 symbols/min [2025-10-17T18:58:11.378763] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:11.387599] [DEBUG] [LOCAL ] FMN: Loaded 5497 existing records from primary storage. [2025-10-17T18:58:11.387849] [INFO ] [MAIN ] FMN: Loaded 5497 existing records. [2025-10-17T18:58:11.557183] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:11.557429] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-17T18:58:11.557484] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-17T18:58:11.557670] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-17T18:58:11.557740] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-17T18:58:11.906045] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:11.935532] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T18:58:11.957989] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-17T18:58:12.511540] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T18:58:12.515530] [INFO ] [REMOTE ] FLXR: Full fetch complete (27089 records). [2025-10-17T18:58:12.515676] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-17T18:58:12.737080] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T18:58:12.765665] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-17T18:58:12.893284] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-17T18:58:12.893356] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-17T18:58:12.893934] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-17T18:58:12.893996] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-17T18:58:12.894698] [DEBUG] [LOCAL ] FLXR: Trimmed 27089 records to 21398 (keeping 200 days of data) [2025-10-17T18:58:13.020028] [DEBUG] [LOCAL ] FLXR: Primary data saved (21398 records). [2025-10-17T18:58:13.020159] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-17T18:58:13.020236] [INFO ] [MAIN ] Update Progress: 848/2368 symbols completed. FLXR took 29.3s. Estimated remaining: 3h 31m 47s. Rate: 7.2 symbols/min [2025-10-17T18:58:13.189698] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:13.220843] [DEBUG] [LOCAL ] FMS: Loaded 30464 existing records from primary storage. [2025-10-17T18:58:13.221108] [INFO ] [MAIN ] FMS: Loaded 30464 existing records. [2025-10-17T18:58:13.395818] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:13.396020] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-17T18:58:13.396067] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-17T18:58:13.396302] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-17T18:58:13.396360] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-17T18:58:13.568536] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-17T18:58:13.691554] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T18:58:13.769095] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:14.358005] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-17T18:58:15.158055] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-17T18:58:15.366673] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:58:15.418881] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T18:58:15.958027] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-17T18:58:16.725444] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T18:58:16.767175] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-17T18:58:16.788427] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:58:17.558017] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-17T18:58:17.581542] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T18:58:18.358032] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-17T18:58:19.158059] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-17T18:58:19.417489] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:58:19.882268] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:58:19.958038] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-17T18:58:20.071423] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T18:58:20.079485] [INFO ] [REMOTE ] FLUT: Full fetch complete (73308 records). [2025-10-17T18:58:20.079761] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-17T18:58:20.484551] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-17T18:58:20.484634] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-17T18:58:20.485593] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-17T18:58:20.485663] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-17T18:58:20.487183] [DEBUG] [LOCAL ] FLUT: Trimmed 73308 records to 51478 (keeping 200 days of data) [2025-10-17T18:58:20.771614] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-17T18:58:20.796662] [DEBUG] [LOCAL ] FLUT: Primary data saved (51478 records). [2025-10-17T18:58:20.796874] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-17T18:58:20.796986] [INFO ] [MAIN ] Update Progress: 849/2368 symbols completed. FLUT took 38.7s. Estimated remaining: 3h 31m 37s. Rate: 7.2 symbols/min [2025-10-17T18:58:20.965978] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:21.003628] [DEBUG] [LOCAL ] FMX: Loaded 40866 existing records from primary storage. [2025-10-17T18:58:21.003973] [INFO ] [MAIN ] FMX: Loaded 40866 existing records. [2025-10-17T18:58:21.179044] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:21.179375] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-17T18:58:21.179561] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-17T18:58:21.184914] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-17T18:58:21.193271] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-17T18:58:21.261616] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T18:58:21.549413] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:21.557989] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-17T18:58:22.358075] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-17T18:58:22.502555] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:58:22.929883] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T18:58:23.025355] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T18:58:23.158026] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-17T18:58:23.958014] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-17T18:58:24.758005] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-17T18:58:25.044634] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:58:25.201892] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:58:25.558047] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-17T18:58:25.705144] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T18:58:26.141750] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:58:26.358035] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-17T18:58:27.158146] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-17T18:58:27.920714] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T18:58:27.951702] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T18:58:27.958669] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-17T18:58:28.758027] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-17T18:58:29.352238] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:58:29.558006] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-17T18:58:29.678960] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:58:30.196296] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T18:58:30.358061] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-17T18:58:31.158088] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-17T18:58:31.958040] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-17T18:58:32.236029] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T18:58:32.641927] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T18:58:32.643682] [INFO ] [REMOTE ] FMN: Full fetch complete (10158 records). [2025-10-17T18:58:32.643771] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-17T18:58:32.760711] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-17T18:58:33.027089] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-17T18:58:33.027222] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-17T18:58:33.027519] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-17T18:58:33.027591] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-17T18:58:33.028210] [DEBUG] [LOCAL ] FMN: Trimmed 10158 records to 5571 (keeping 200 days of data) [2025-10-17T18:58:33.088783] [DEBUG] [LOCAL ] FMN: Primary data saved (5571 records). [2025-10-17T18:58:33.088935] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-17T18:58:33.089031] [INFO ] [MAIN ] Update Progress: 850/2368 symbols completed. FMN took 21.9s. Estimated remaining: 3h 31m 36s. Rate: 7.2 symbols/min [2025-10-17T18:58:33.091040] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T18:58:33.266746] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:33.270521] [DEBUG] [LOCAL ] FMY: Loaded 1390 existing records from primary storage. [2025-10-17T18:58:33.270690] [INFO ] [MAIN ] FMY: Loaded 1390 existing records. [2025-10-17T18:58:33.441881] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:33.442110] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-17T18:58:33.442158] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-17T18:58:33.442348] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-17T18:58:33.442406] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-17T18:58:33.563207] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-17T18:58:33.793240] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:34.338434] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:58:34.357996] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-17T18:58:35.158116] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-17T18:58:35.938600] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T18:58:35.957987] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-17T18:58:36.004417] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-17T18:58:36.012796] [INFO ] [REMOTE ] FMC: Full fetch complete (75367 records). [2025-10-17T18:58:36.012939] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-17T18:58:36.398449] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-17T18:58:36.398534] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-17T18:58:36.399462] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-17T18:58:36.399526] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-17T18:58:36.400943] [DEBUG] [LOCAL ] FMC: Trimmed 75367 records to 52624 (keeping 200 days of data) [2025-10-17T18:58:36.661992] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:58:36.746604] [DEBUG] [LOCAL ] FMC: Primary data saved (52624 records). [2025-10-17T18:58:36.746767] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-17T18:58:36.746866] [INFO ] [MAIN ] Update Progress: 851/2368 symbols completed. FMC took 42.8s. Estimated remaining: 3h 31m 19s. Rate: 7.2 symbols/min [2025-10-17T18:58:36.767295] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-17T18:58:36.922517] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:36.958717] [DEBUG] [LOCAL ] FN: Loaded 38016 existing records from primary storage. [2025-10-17T18:58:36.959040] [INFO ] [MAIN ] FN: Loaded 38016 existing records. [2025-10-17T18:58:37.157615] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:37.158056] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-17T18:58:37.158127] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-17T18:58:37.158339] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-17T18:58:37.158402] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-17T18:58:37.251135] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T18:58:37.512195] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:58:37.562002] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-17T18:58:37.605622] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:37.933495] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T18:58:38.358077] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-17T18:58:39.158013] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-17T18:58:39.871561] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:58:39.957989] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-17T18:58:40.536219] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T18:58:40.758090] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-17T18:58:41.532226] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T18:58:41.556218] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:58:41.558926] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-17T18:58:41.987065] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T18:58:42.358112] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-17T18:58:43.158124] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-17T18:58:43.958045] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-17T18:58:44.006219] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:58:44.290796] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T18:58:44.462772] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:58:44.758029] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-17T18:58:45.558046] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-17T18:58:46.358034] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-17T18:58:46.498736] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:58:46.710424] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:58:47.102949] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T18:58:47.158044] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-17T18:58:47.958051] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-17T18:58:48.729563] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T18:58:48.757994] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-17T18:58:49.161087] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T18:58:49.558039] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-17T18:58:50.358057] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-17T18:58:50.404919] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:58:50.719761] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-17T18:58:51.025841] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T18:58:51.158010] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-17T18:58:51.958041] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-17T18:58:52.758042] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-17T18:58:52.861034] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:58:53.384549] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:58:53.558003] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-17T18:58:54.021813] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T18:58:54.358039] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-17T18:58:55.016720] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T18:58:55.158033] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-17T18:58:55.808520] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:58:55.813037] [INFO ] [REMOTE ] FMS: Full fetch complete (42794 records). [2025-10-17T18:58:55.813139] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-17T18:58:55.959614] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-17T18:58:56.260321] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-17T18:58:56.260400] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-17T18:58:56.261187] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-17T18:58:56.261251] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-17T18:58:56.262340] [DEBUG] [LOCAL ] FMS: Trimmed 42794 records to 30733 (keeping 200 days of data) [2025-10-17T18:58:56.446819] [DEBUG] [LOCAL ] FMS: Primary data saved (30733 records). [2025-10-17T18:58:56.446976] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-17T18:58:56.447064] [INFO ] [MAIN ] Update Progress: 852/2368 symbols completed. FMS took 43.4s. Estimated remaining: 3h 31m 31s. Rate: 7.2 symbols/min [2025-10-17T18:58:56.531636] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T18:58:56.628322] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:56.680113] [DEBUG] [LOCAL ] FNB: Loaded 52986 existing records from primary storage. [2025-10-17T18:58:56.680448] [INFO ] [MAIN ] FNB: Loaded 52986 existing records. [2025-10-17T18:58:56.764692] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-17T18:58:56.867173] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T18:58:56.887408] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:56.896282] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-17T18:58:56.896452] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-17T18:58:56.896925] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-17T18:58:56.896984] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-17T18:58:57.250795] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:57.336221] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T18:58:57.558025] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-17T18:58:58.358028] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-17T18:58:59.080380] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:58:59.158020] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-17T18:58:59.882150] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T18:58:59.958005] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-17T18:59:00.662696] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:59:00.667182] [INFO ] [REMOTE ] FN: Full fetch complete (56338 records). [2025-10-17T18:59:00.667325] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-17T18:59:00.767887] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-17T18:59:01.052905] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-17T18:59:01.052986] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-17T18:59:01.053787] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-17T18:59:01.053860] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-17T18:59:01.055045] [DEBUG] [LOCAL ] FN: Trimmed 56338 records to 38299 (keeping 200 days of data) [2025-10-17T18:59:01.288890] [DEBUG] [LOCAL ] FN: Primary data saved (38299 records). [2025-10-17T18:59:01.289019] [INFO ] [MAIN ] FN: Full history saved. [2025-10-17T18:59:01.289098] [INFO ] [MAIN ] Update Progress: 853/2368 symbols completed. FN took 24.5s. Estimated remaining: 3h 31m 17s. Rate: 7.2 symbols/min [2025-10-17T18:59:01.455489] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:01.507929] [DEBUG] [LOCAL ] FND: Loaded 52517 existing records from primary storage. [2025-10-17T18:59:01.508351] [INFO ] [MAIN ] FND: Loaded 52517 existing records. [2025-10-17T18:59:01.570793] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-17T18:59:01.691120] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:01.691346] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-17T18:59:01.691428] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-17T18:59:01.691783] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-17T18:59:01.691851] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-17T18:59:01.775960] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T18:59:02.056902] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:02.084357] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:59:02.358074] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-17T18:59:02.794209] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T18:59:02.795539] [INFO ] [REMOTE ] FMY: Full fetch complete (1953 records). [2025-10-17T18:59:02.795614] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-17T18:59:03.163484] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-17T18:59:03.170327] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-17T18:59:03.171231] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-17T18:59:03.171379] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-17T18:59:03.171427] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-17T18:59:03.171856] [DEBUG] [LOCAL ] FMY: Trimmed 1953 records to 1397 (keeping 200 days of data) [2025-10-17T18:59:03.181874] [DEBUG] [LOCAL ] FMY: Primary data saved (1397 records). [2025-10-17T18:59:03.181989] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-17T18:59:03.182091] [INFO ] [MAIN ] Update Progress: 854/2368 symbols completed. FMY took 30.1s. Estimated remaining: 3h 30m 57s. Rate: 7.2 symbols/min [2025-10-17T18:59:03.358690] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:03.413956] [DEBUG] [LOCAL ] FNF: Loaded 49296 existing records from primary storage. [2025-10-17T18:59:03.414271] [INFO ] [MAIN ] FNF: Loaded 49296 existing records. [2025-10-17T18:59:03.596002] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:03.596293] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-17T18:59:03.596367] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-17T18:59:03.596755] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-17T18:59:03.596814] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-17T18:59:03.952135] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:03.957986] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-17T18:59:04.154812] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-17T18:59:04.758098] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-17T18:59:05.014672] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T18:59:05.530194] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T18:59:05.557997] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-17T18:59:06.358047] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-17T18:59:06.508965] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T18:59:07.039290] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T18:59:07.044686] [INFO ] [REMOTE ] FMX: Full fetch complete (57971 records). [2025-10-17T18:59:07.044795] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-17T18:59:07.163228] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-17T18:59:07.440172] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-17T18:59:07.440272] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-17T18:59:07.441162] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-17T18:59:07.441227] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-17T18:59:07.442409] [DEBUG] [LOCAL ] FMX: Trimmed 57971 records to 41172 (keeping 200 days of data) [2025-10-17T18:59:07.699314] [DEBUG] [LOCAL ] FMX: Primary data saved (41172 records). [2025-10-17T18:59:07.699446] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-17T18:59:07.699524] [INFO ] [MAIN ] Update Progress: 855/2368 symbols completed. FMX took 46.9s. Estimated remaining: 3h 30m 42s. Rate: 7.2 symbols/min [2025-10-17T18:59:07.875751] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:07.923418] [DEBUG] [LOCAL ] FNV: Loaded 46507 existing records from primary storage. [2025-10-17T18:59:07.923798] [INFO ] [MAIN ] FNV: Loaded 46507 existing records. [2025-10-17T18:59:07.967289] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-17T18:59:08.116673] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:08.116995] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-17T18:59:08.117114] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-17T18:59:08.117531] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-17T18:59:08.117665] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-17T18:59:08.419832] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T18:59:08.516042] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:08.763096] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-17T18:59:08.776507] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:59:09.276240] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T18:59:09.558078] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-17T18:59:10.342059] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T18:59:10.358003] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-17T18:59:11.165515] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-17T18:59:11.181431] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:59:11.869615] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T18:59:11.957995] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-17T18:59:12.746336] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:59:12.757973] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-17T18:59:13.558038] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-17T18:59:13.737595] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T18:59:14.358077] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-17T18:59:14.497104] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:59:15.123266] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:59:15.158039] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-17T18:59:15.680955] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T18:59:15.958048] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-17T18:59:16.758013] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-17T18:59:16.937810] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:59:17.558038] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-17T18:59:17.685721] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:59:18.178828] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:59:18.358044] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-17T18:59:18.835408] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T18:59:19.158080] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-17T18:59:19.958010] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-17T18:59:20.142380] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:59:20.763212] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-17T18:59:20.776060] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:59:21.558022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-17T18:59:21.631247] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:59:22.358011] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-17T18:59:22.463365] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:59:23.163786] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-17T18:59:23.176538] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T18:59:23.660206] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:59:23.958038] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-17T18:59:24.758116] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-17T18:59:24.960588] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T18:59:25.558011] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-17T18:59:25.684871] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:59:26.348779] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:59:26.358387] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-17T18:59:27.166253] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-17T18:59:27.183195] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:59:27.958020] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-17T18:59:28.033698] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T18:59:28.758001] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-17T18:59:29.215053] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T18:59:29.473788] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T18:59:29.557986] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-17T18:59:30.316570] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:59:30.357987] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-17T18:59:31.158050] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-17T18:59:31.255246] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:59:31.958032] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-17T18:59:32.364525] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T18:59:32.758056] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-17T18:59:33.017489] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:59:33.026729] [INFO ] [REMOTE ] FNF: Full fetch complete (70008 records). [2025-10-17T18:59:33.026971] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-17T18:59:33.446606] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-17T18:59:33.446953] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-17T18:59:33.448586] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-17T18:59:33.448729] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-17T18:59:33.479050] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:59:33.489131] [DEBUG] [LOCAL ] FNF: Trimmed 70008 records to 49639 (keeping 200 days of data) [2025-10-17T18:59:33.585023] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-17T18:59:33.823540] [DEBUG] [LOCAL ] FNF: Primary data saved (49639 records). [2025-10-17T18:59:33.823797] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-17T18:59:33.824539] [INFO ] [MAIN ] Update Progress: 856/2368 symbols completed. FNF took 30.6s. Estimated remaining: 3h 31m 5s. Rate: 7.2 symbols/min [2025-10-17T18:59:34.005883] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:34.025191] [DEBUG] [LOCAL ] FOA: Loaded 13156 existing records from primary storage. [2025-10-17T18:59:34.025592] [INFO ] [MAIN ] FOA: Loaded 13156 existing records. [2025-10-17T18:59:34.225563] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:34.226036] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-17T18:59:34.226101] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-17T18:59:34.226372] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-17T18:59:34.226431] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-17T18:59:34.369808] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-17T18:59:34.613880] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:34.637858] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T18:59:35.158051] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-17T18:59:35.313058] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:59:35.319692] [INFO ] [REMOTE ] FNV: Full fetch complete (66807 records). [2025-10-17T18:59:35.319797] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-17T18:59:35.696765] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-17T18:59:35.696865] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-17T18:59:35.697823] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-17T18:59:35.697889] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-17T18:59:35.699305] [DEBUG] [LOCAL ] FNV: Trimmed 66807 records to 46890 (keeping 200 days of data) [2025-10-17T18:59:35.968929] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-17T18:59:35.995078] [DEBUG] [LOCAL ] FNV: Primary data saved (46890 records). [2025-10-17T18:59:35.995246] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-17T18:59:35.996227] [INFO ] [MAIN ] Update Progress: 857/2368 symbols completed. FNV took 28.3s. Estimated remaining: 3h 30m 45s. Rate: 7.2 symbols/min [2025-10-17T18:59:36.176927] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:36.192117] [DEBUG] [LOCAL ] FOF: Loaded 8657 existing records from primary storage. [2025-10-17T18:59:36.192357] [INFO ] [MAIN ] FOF: Loaded 8657 existing records. [2025-10-17T18:59:36.412093] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:36.406556] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:59:36.422818] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-17T18:59:36.422908] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-17T18:59:36.423321] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-17T18:59:36.423385] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-17T18:59:36.776701] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-17T18:59:36.781713] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:36.915367] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T18:59:36.923613] [INFO ] [REMOTE ] FNB: Full fetch complete (76183 records). [2025-10-17T18:59:36.923861] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-17T18:59:37.268949] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T18:59:37.364477] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-17T18:59:37.364610] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-17T18:59:37.366026] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-17T18:59:37.366131] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-17T18:59:37.368457] [DEBUG] [LOCAL ] FNB: Trimmed 76183 records to 53376 (keeping 200 days of data) [2025-10-17T18:59:37.562115] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-17T18:59:37.729976] [DEBUG] [LOCAL ] FNB: Primary data saved (53376 records). [2025-10-17T18:59:37.730208] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-17T18:59:37.730999] [INFO ] [MAIN ] Update Progress: 858/2368 symbols completed. FNB took 41.3s. Estimated remaining: 3h 30m 25s. Rate: 7.2 symbols/min [2025-10-17T18:59:37.911437] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:37.945084] [DEBUG] [LOCAL ] FOR: Loaded 19877 existing records from primary storage. [2025-10-17T18:59:37.945438] [INFO ] [MAIN ] FOR: Loaded 19877 existing records. [2025-10-17T18:59:38.138128] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:38.138560] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-17T18:59:38.138700] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-17T18:59:38.139106] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-17T18:59:38.139229] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-17T18:59:38.365385] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-17T18:59:38.414511] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T18:59:38.581188] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:38.698200] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:59:39.158078] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-17T18:59:39.442551] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T18:59:39.958074] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-17T18:59:40.137067] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:59:40.758061] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-17T18:59:41.558012] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-17T18:59:41.567500] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:59:41.665684] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T18:59:42.358050] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-17T18:59:42.525462] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:59:43.018840] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T18:59:43.158028] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-17T18:59:43.932287] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:59:43.958023] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-17T18:59:44.757997] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-17T18:59:44.767286] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T18:59:45.558016] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-17T18:59:45.846884] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:59:46.358070] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-17T18:59:47.152791] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T18:59:47.157997] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-17T18:59:47.456874] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T18:59:47.464245] [INFO ] [REMOTE ] FND: Full fetch complete (75015 records). [2025-10-17T18:59:47.464370] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-17T18:59:47.852744] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-17T18:59:47.852841] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-17T18:59:47.853852] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-17T18:59:47.853920] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-17T18:59:47.855427] [DEBUG] [LOCAL ] FND: Trimmed 75015 records to 52865 (keeping 200 days of data) [2025-10-17T18:59:47.958175] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-17T18:59:48.180233] [DEBUG] [LOCAL ] FND: Primary data saved (52865 records). [2025-10-17T18:59:48.180380] [INFO ] [MAIN ] FND: Full history saved. [2025-10-17T18:59:48.180460] [INFO ] [MAIN ] Update Progress: 859/2368 symbols completed. FND took 46.9s. Estimated remaining: 3h 30m 21s. Rate: 7.2 symbols/min [2025-10-17T18:59:48.340943] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:59:48.365427] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:48.420457] [DEBUG] [LOCAL ] FOUR: Loaded 50101 existing records from primary storage. [2025-10-17T18:59:48.420925] [INFO ] [MAIN ] FOUR: Loaded 50101 existing records. [2025-10-17T18:59:48.610876] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:48.611171] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-17T18:59:48.611225] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-17T18:59:48.611463] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-17T18:59:48.611505] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-17T18:59:48.764136] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-17T18:59:49.004149] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:49.004615] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:59:49.558073] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-17T18:59:50.057833] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T18:59:50.358063] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-17T18:59:50.529507] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:59:51.158053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-17T18:59:51.635058] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T18:59:51.958069] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-17T18:59:52.763165] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-17T18:59:52.786899] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:59:52.991890] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:59:53.558058] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-17T18:59:53.874631] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:59:54.358066] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-17T18:59:54.566795] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T18:59:55.139075] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T18:59:55.157990] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-17T18:59:55.957425] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T18:59:55.960329] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-17T18:59:56.758004] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-17T18:59:56.811865] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T18:59:57.558040] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-17T18:59:57.833832] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T18:59:58.285294] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T18:59:58.357979] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-17T18:59:59.107021] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T18:59:59.158042] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-17T18:59:59.918539] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T18:59:59.958025] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-17T19:00:00.758003] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-17T19:00:00.979595] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:00:00.981280] [INFO ] [REMOTE ] FOF: Full fetch complete (11887 records). [2025-10-17T19:00:00.981354] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-17T19:00:01.345272] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-17T19:00:01.345358] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-17T19:00:01.345755] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-17T19:00:01.345818] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-17T19:00:01.346358] [DEBUG] [LOCAL ] FOF: Trimmed 11887 records to 8707 (keeping 200 days of data) [2025-10-17T19:00:01.402312] [DEBUG] [LOCAL ] FOF: Primary data saved (8707 records). [2025-10-17T19:00:01.402465] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-17T19:00:01.402551] [INFO ] [MAIN ] Update Progress: 860/2368 symbols completed. FOF took 25.4s. Estimated remaining: 3h 30m 21s. Rate: 7.2 symbols/min [2025-10-17T19:00:01.563255] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-17T19:00:01.591223] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:01.615736] [DEBUG] [LOCAL ] FPF: Loaded 19054 existing records from primary storage. [2025-10-17T19:00:01.616045] [INFO ] [MAIN ] FPF: Loaded 19054 existing records. [2025-10-17T19:00:01.809585] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:01.809858] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-17T19:00:01.809910] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-17T19:00:01.810151] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-17T19:00:01.810211] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-17T19:00:02.276685] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:02.286859] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:00:02.358053] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-17T19:00:03.158053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-17T19:00:03.278221] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:00:03.368472] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T19:00:03.958066] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-17T19:00:04.758006] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-17T19:00:05.163260] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T19:00:05.188154] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T19:00:05.558053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-17T19:00:05.909065] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T19:00:06.358053] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-17T19:00:07.158034] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-17T19:00:07.604804] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T19:00:07.607514] [INFO ] [REMOTE ] FOA: Full fetch complete (21588 records). [2025-10-17T19:00:07.607621] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-17T19:00:07.958755] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-17T19:00:07.992095] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-17T19:00:07.992202] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-17T19:00:07.992980] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-17T19:00:07.993207] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-17T19:00:08.023761] [DEBUG] [LOCAL ] FOA: Trimmed 21588 records to 13224 (keeping 200 days of data) [2025-10-17T19:00:08.025465] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T19:00:08.114931] [DEBUG] [LOCAL ] FOA: Primary data saved (13224 records). [2025-10-17T19:00:08.115089] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-17T19:00:08.115177] [INFO ] [MAIN ] Update Progress: 861/2368 symbols completed. FOA took 34.3s. Estimated remaining: 3h 30m 9s. Rate: 7.2 symbols/min [2025-10-17T19:00:08.292787] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:08.313013] [DEBUG] [LOCAL ] FPH: Loaded 19484 existing records from primary storage. [2025-10-17T19:00:08.313282] [INFO ] [MAIN ] FPH: Loaded 19484 existing records. [2025-10-17T19:00:08.465952] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T19:00:08.557775] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:08.558024] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-17T19:00:08.558079] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-17T19:00:08.558285] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-17T19:00:08.558327] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-17T19:00:08.767775] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-17T19:00:08.942493] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:09.212317] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T19:00:09.215150] [INFO ] [REMOTE ] FOR: Full fetch complete (29834 records). [2025-10-17T19:00:09.215237] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-17T19:00:09.563499] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-17T19:00:09.575775] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-17T19:00:09.575834] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-17T19:00:09.576445] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-17T19:00:09.576599] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-17T19:00:09.577543] [DEBUG] [LOCAL ] FOR: Trimmed 29834 records to 20025 (keeping 200 days of data) [2025-10-17T19:00:09.712526] [DEBUG] [LOCAL ] FOR: Primary data saved (20025 records). [2025-10-17T19:00:09.712703] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-17T19:00:09.712825] [INFO ] [MAIN ] Update Progress: 862/2368 symbols completed. FOR took 32.0s. Estimated remaining: 3h 29m 49s. Rate: 7.2 symbols/min [2025-10-17T19:00:09.881986] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:09.915491] [DEBUG] [LOCAL ] FPI: Loaded 31623 existing records from primary storage. [2025-10-17T19:00:09.915778] [INFO ] [MAIN ] FPI: Loaded 31623 existing records. [2025-10-17T19:00:10.087251] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:10.087438] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-17T19:00:10.087484] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-17T19:00:10.087717] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-17T19:00:10.087775] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-17T19:00:10.360687] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-17T19:00:10.443609] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:10.590292] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T19:00:10.643362] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T19:00:11.158048] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-17T19:00:11.538024] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T19:00:11.958084] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-17T19:00:12.758039] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-17T19:00:13.250976] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T19:00:13.337503] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:00:13.557983] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-17T19:00:13.792050] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T19:00:14.358014] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-17T19:00:14.533689] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T19:00:15.158004] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-17T19:00:15.970132] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-17T19:00:15.973512] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T19:00:16.426606] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T19:00:16.758049] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-17T19:00:17.208986] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T19:00:17.558047] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-17T19:00:18.025287] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T19:00:18.358066] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-17T19:00:19.109844] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:00:19.158033] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-17T19:00:19.230318] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T19:00:19.958031] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-17T19:00:20.573185] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:00:20.758004] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-17T19:00:21.116357] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T19:00:21.558026] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-17T19:00:22.357995] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-17T19:00:22.614003] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:00:22.674964] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T19:00:23.158111] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-17T19:00:23.438094] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:00:23.958097] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-17T19:00:24.407405] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T19:00:24.595684] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:00:24.758062] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-17T19:00:25.558057] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-17T19:00:25.817280] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:00:26.358063] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-17T19:00:26.507515] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T19:00:27.158065] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-17T19:00:27.482190] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T19:00:27.958058] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-17T19:00:28.758004] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-17T19:00:29.078096] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:00:29.377627] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:00:29.557984] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-17T19:00:29.878083] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:00:30.357999] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-17T19:00:30.511124] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T19:00:31.157989] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-17T19:00:31.241850] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T19:00:31.957999] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-17T19:00:32.232744] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T19:00:32.758022] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-17T19:00:33.558095] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-17T19:00:33.893904] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:00:33.967464] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T19:00:33.975579] [INFO ] [REMOTE ] FOUR: Full fetch complete (72284 records). [2025-10-17T19:00:33.975901] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-17T19:00:34.363247] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-17T19:00:34.423087] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-17T19:00:34.423181] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-17T19:00:34.424145] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-17T19:00:34.424212] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-17T19:00:34.425711] [DEBUG] [LOCAL ] FOUR: Trimmed 72284 records to 50475 (keeping 200 days of data) [2025-10-17T19:00:34.647140] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T19:00:34.744345] [DEBUG] [LOCAL ] FOUR: Primary data saved (50475 records). [2025-10-17T19:00:34.744487] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-17T19:00:34.744569] [INFO ] [MAIN ] Update Progress: 863/2368 symbols completed. FOUR took 46.6s. Estimated remaining: 3h 30m 10s. Rate: 7.2 symbols/min [2025-10-17T19:00:34.907044] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:34.947689] [DEBUG] [LOCAL ] FR: Loaded 46923 existing records from primary storage. [2025-10-17T19:00:34.947989] [INFO ] [MAIN ] FR: Loaded 46923 existing records. [2025-10-17T19:00:35.118121] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:35.118289] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-17T19:00:35.118333] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-17T19:00:35.118604] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-17T19:00:35.118688] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-17T19:00:35.163178] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-17T19:00:35.466326] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:35.902806] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:00:35.958025] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-17T19:00:36.447695] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:00:36.451397] [INFO ] [REMOTE ] FPF: Full fetch complete (26710 records). [2025-10-17T19:00:36.451503] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-17T19:00:36.770567] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-17T19:00:36.817679] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-17T19:00:36.817769] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-17T19:00:36.818453] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-17T19:00:36.818492] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-17T19:00:36.819276] [DEBUG] [LOCAL ] FPF: Trimmed 26710 records to 19175 (keeping 200 days of data) [2025-10-17T19:00:36.935619] [DEBUG] [LOCAL ] FPF: Primary data saved (19175 records). [2025-10-17T19:00:36.935784] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-17T19:00:36.935869] [INFO ] [MAIN ] Update Progress: 864/2368 symbols completed. FPF took 35.5s. Estimated remaining: 3h 29m 51s. Rate: 7.2 symbols/min [2025-10-17T19:00:37.094774] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T19:00:37.119921] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:37.142374] [DEBUG] [LOCAL ] FRA: Loaded 14371 existing records from primary storage. [2025-10-17T19:00:37.142675] [INFO ] [MAIN ] FRA: Loaded 14371 existing records. [2025-10-17T19:00:37.315454] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:37.315720] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-17T19:00:37.315777] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-17T19:00:37.316139] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-17T19:00:37.316197] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-17T19:00:37.563175] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-17T19:00:37.659676] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:38.358045] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-17T19:00:38.515737] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T19:00:39.151320] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T19:00:39.157976] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-17T19:00:39.276889] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:00:39.280811] [INFO ] [REMOTE ] FPH: Full fetch complete (31094 records). [2025-10-17T19:00:39.280910] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-17T19:00:39.661239] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-17T19:00:39.661323] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-17T19:00:39.661978] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-17T19:00:39.662047] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-17T19:00:39.662939] [DEBUG] [LOCAL ] FPH: Trimmed 31094 records to 19603 (keeping 200 days of data) [2025-10-17T19:00:39.772421] [DEBUG] [LOCAL ] FPH: Primary data saved (19603 records). [2025-10-17T19:00:39.772579] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-17T19:00:39.772687] [INFO ] [MAIN ] Update Progress: 865/2368 symbols completed. FPH took 31.7s. Estimated remaining: 3h 29m 33s. Rate: 7.2 symbols/min [2025-10-17T19:00:39.938983] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:39.955679] [DEBUG] [LOCAL ] FRGE: Loaded 16223 existing records from primary storage. [2025-10-17T19:00:39.955928] [INFO ] [MAIN ] FRGE: Loaded 16223 existing records. [2025-10-17T19:00:39.967021] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-17T19:00:40.134199] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:40.134410] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-17T19:00:40.134478] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-17T19:00:40.134686] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-17T19:00:40.134760] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-17T19:00:40.501870] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:40.517872] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:00:40.758065] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-17T19:00:41.558005] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-17T19:00:41.659092] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T19:00:41.772015] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T19:00:42.358034] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-17T19:00:42.465870] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T19:00:43.158097] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-17T19:00:43.366428] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:00:43.958172] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-17T19:00:44.700066] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:00:44.758002] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-17T19:00:44.955247] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:00:45.558058] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-17T19:00:46.358006] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-17T19:00:46.423690] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:00:46.977579] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:00:47.162106] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-17T19:00:47.166986] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T19:00:47.958068] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-17T19:00:48.758093] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-17T19:00:48.810710] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T19:00:49.452187] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T19:00:49.470856] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T19:00:49.558004] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-17T19:00:50.358006] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-17T19:00:50.568932] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T19:00:51.158027] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-17T19:00:51.728855] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T19:00:51.953222] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:00:51.957971] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-17T19:00:52.758008] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-17T19:00:52.776437] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:00:53.558021] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-17T19:00:54.027791] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T19:00:54.032549] [INFO ] [REMOTE ] FPI: Full fetch complete (43900 records). [2025-10-17T19:00:54.032721] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-17T19:00:54.363131] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-17T19:00:54.438628] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-17T19:00:54.438762] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-17T19:00:54.439479] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-17T19:00:54.439529] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-17T19:00:54.440724] [DEBUG] [LOCAL ] FPI: Trimmed 43900 records to 31833 (keeping 200 days of data) [2025-10-17T19:00:54.643779] [DEBUG] [LOCAL ] FPI: Primary data saved (31833 records). [2025-10-17T19:00:54.643946] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-17T19:00:54.644150] [INFO ] [MAIN ] Update Progress: 866/2368 symbols completed. FPI took 44.9s. Estimated remaining: 3h 29m 36s. Rate: 7.2 symbols/min [2025-10-17T19:00:54.817759] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:54.835737] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:00:54.890398] [DEBUG] [LOCAL ] FRO: Loaded 52078 existing records from primary storage. [2025-10-17T19:00:54.890725] [INFO ] [MAIN ] FRO: Loaded 52078 existing records. [2025-10-17T19:00:55.069584] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:55.069868] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-17T19:00:55.069934] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-17T19:00:55.070328] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-17T19:00:55.070390] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-17T19:00:55.165217] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-17T19:00:55.431315] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:55.474355] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:00:55.476788] [INFO ] [REMOTE ] FRA: Full fetch complete (23600 records). [2025-10-17T19:00:55.476868] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-17T19:00:55.831442] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-17T19:00:55.831519] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-17T19:00:55.832018] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-17T19:00:55.832099] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-17T19:00:55.832765] [DEBUG] [LOCAL ] FRA: Trimmed 23600 records to 14476 (keeping 200 days of data) [2025-10-17T19:00:55.921827] [DEBUG] [LOCAL ] FRA: Primary data saved (14476 records). [2025-10-17T19:00:55.921959] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-17T19:00:55.922051] [INFO ] [MAIN ] Update Progress: 867/2368 symbols completed. FRA took 19.0s. Estimated remaining: 3h 29m 15s. Rate: 7.2 symbols/min [2025-10-17T19:00:55.964368] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-17T19:00:56.090576] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:56.133763] [DEBUG] [LOCAL ] FRT: Loaded 42000 existing records from primary storage. [2025-10-17T19:00:56.134076] [INFO ] [MAIN ] FRT: Loaded 42000 existing records. [2025-10-17T19:00:56.308794] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:56.309042] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-17T19:00:56.309091] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-17T19:00:56.309347] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-17T19:00:56.309386] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-17T19:00:56.668635] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:56.752163] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:00:56.761492] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-17T19:00:57.393775] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T19:00:57.558026] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-17T19:00:58.263033] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:00:58.358016] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-17T19:00:58.839025] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T19:00:59.158062] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-17T19:00:59.896679] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T19:00:59.958014] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-17T19:01:00.670745] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:01:00.757988] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-17T19:01:01.141405] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T19:01:01.558059] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-17T19:01:02.364758] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-17T19:01:02.393677] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T19:01:02.418333] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T19:01:03.158061] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-17T19:01:03.958022] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-17T19:01:04.049837] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T19:01:04.093489] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T19:01:04.758030] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-17T19:01:05.557997] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-17T19:01:05.688532] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:01:06.234103] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:01:06.358002] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-17T19:01:06.664335] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T19:01:07.158057] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-17T19:01:07.958042] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-17T19:01:08.338604] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-17T19:01:08.758085] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-17T19:01:08.891557] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:01:08.927797] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T19:01:09.558027] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-17T19:01:10.292744] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:01:10.358036] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-17T19:01:11.136898] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:01:11.157995] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-17T19:01:11.744992] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:01:11.751933] [INFO ] [REMOTE ] FR: Full fetch complete (67049 records). [2025-10-17T19:01:11.752086] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-17T19:01:11.963259] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-17T19:01:12.161557] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-17T19:01:12.161684] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-17T19:01:12.162609] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-17T19:01:12.162698] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-17T19:01:12.164176] [DEBUG] [LOCAL ] FR: Trimmed 67049 records to 47301 (keeping 200 days of data) [2025-10-17T19:01:12.455166] [DEBUG] [LOCAL ] FR: Primary data saved (47301 records). [2025-10-17T19:01:12.455308] [INFO ] [MAIN ] FR: Full history saved. [2025-10-17T19:01:12.455391] [INFO ] [MAIN ] Update Progress: 868/2368 symbols completed. FR took 37.7s. Estimated remaining: 3h 29m 21s. Rate: 7.2 symbols/min [2025-10-17T19:01:12.632429] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:12.657193] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:01:12.698334] [DEBUG] [LOCAL ] FSCO: Loaded 38807 existing records from primary storage. [2025-10-17T19:01:12.698711] [INFO ] [MAIN ] FSCO: Loaded 38807 existing records. [2025-10-17T19:01:12.762788] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-17T19:01:12.878817] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:12.879038] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-17T19:01:12.879102] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-17T19:01:12.879332] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-17T19:01:12.879400] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-17T19:01:13.104803] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:01:13.144475] [INFO ] [REMOTE ] FRGE: Full fetch complete (30671 records). [2025-10-17T19:01:13.166100] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-17T19:01:13.359824] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:13.563187] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-17T19:01:13.627140] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-17T19:01:13.627402] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-17T19:01:13.628144] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-17T19:01:13.628210] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-17T19:01:13.629144] [DEBUG] [LOCAL ] FRGE: Trimmed 30671 records to 16315 (keeping 200 days of data) [2025-10-17T19:01:13.725871] [DEBUG] [LOCAL ] FRGE: Primary data saved (16315 records). [2025-10-17T19:01:13.726010] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-17T19:01:13.726099] [INFO ] [MAIN ] Update Progress: 869/2368 symbols completed. FRGE took 34.0s. Estimated remaining: 3h 29m 0s. Rate: 7.2 symbols/min [2025-10-17T19:01:13.901801] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:13.952012] [DEBUG] [LOCAL ] FSK: Loaded 49891 existing records from primary storage. [2025-10-17T19:01:13.952333] [INFO ] [MAIN ] FSK: Loaded 49891 existing records. [2025-10-17T19:01:14.162753] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:14.162998] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-17T19:01:14.163047] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-17T19:01:14.163318] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-17T19:01:14.163377] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-17T19:01:14.379802] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-17T19:01:14.525392] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:14.879055] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T19:01:15.140397] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:01:15.157988] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-17T19:01:15.929372] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:01:15.957987] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-17T19:01:16.706822] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:01:16.757990] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-17T19:01:17.476781] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:01:17.558044] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-17T19:01:18.240874] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T19:01:18.358007] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-17T19:01:18.903300] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T19:01:19.158039] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-17T19:01:19.883063] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:01:19.888772] [INFO ] [REMOTE ] FRT: Full fetch complete (60545 records). [2025-10-17T19:01:19.888919] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-17T19:01:19.964381] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-17T19:01:20.275442] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-17T19:01:20.275529] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-17T19:01:20.276372] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-17T19:01:20.276435] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-17T19:01:20.277723] [DEBUG] [LOCAL ] FRT: Trimmed 60545 records to 42290 (keeping 200 days of data) [2025-10-17T19:01:20.539569] [DEBUG] [LOCAL ] FRT: Primary data saved (42290 records). [2025-10-17T19:01:20.539720] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-17T19:01:20.539834] [INFO ] [MAIN ] Update Progress: 870/2368 symbols completed. FRT took 24.6s. Estimated remaining: 3h 28m 49s. Rate: 7.2 symbols/min [2025-10-17T19:01:20.712923] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:20.748603] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:01:20.759000] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-17T19:01:20.794935] [DEBUG] [LOCAL ] FSLY: Loaded 51707 existing records from primary storage. [2025-10-17T19:01:20.795234] [INFO ] [MAIN ] FSLY: Loaded 51707 existing records. [2025-10-17T19:01:20.981431] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:20.981680] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-17T19:01:20.981740] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-17T19:01:20.982033] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-17T19:01:20.982073] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-17T19:01:21.346759] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:21.435765] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T19:01:21.557992] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-17T19:01:22.358012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-17T19:01:22.485970] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T19:01:22.973908] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T19:01:23.158063] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-17T19:01:23.958053] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-17T19:01:24.055927] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:01:24.674063] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:01:24.758007] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-17T19:01:25.558039] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-17T19:01:25.850068] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T19:01:26.358077] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-17T19:01:26.702133] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T19:01:27.112303] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T19:01:27.158002] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-17T19:01:27.958059] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-17T19:01:28.212578] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T19:01:28.758009] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-17T19:01:29.000505] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T19:01:29.376141] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:01:29.558040] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-17T19:01:30.358023] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-17T19:01:30.568950] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T19:01:30.957786] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:01:31.158039] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-17T19:01:31.958082] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-17T19:01:32.512107] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T19:01:32.758003] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-17T19:01:33.122784] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T19:01:33.558040] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-17T19:01:34.358012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-17T19:01:34.392864] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:01:34.504619] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-17T19:01:35.096860] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:01:35.158034] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-17T19:01:35.958107] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-17T19:01:36.210495] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T19:01:36.758045] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-17T19:01:36.854928] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:01:37.558050] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-17T19:01:37.741169] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T19:01:38.216918] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:01:38.358124] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-17T19:01:39.158050] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-17T19:01:39.590082] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T19:01:39.958032] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-17T19:01:40.395595] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:01:40.758034] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-17T19:01:40.978678] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:01:41.504840] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:01:41.557987] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-17T19:01:42.358004] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-17T19:01:42.439558] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:01:43.158052] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-17T19:01:43.246063] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:01:43.252396] [INFO ] [REMOTE ] FSCO: Full fetch complete (55364 records). [2025-10-17T19:01:43.252496] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-17T19:01:43.630851] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-17T19:01:43.630957] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-17T19:01:43.631870] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-17T19:01:43.631954] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-17T19:01:43.633401] [DEBUG] [LOCAL ] FSCO: Trimmed 55364 records to 39152 (keeping 200 days of data) [2025-10-17T19:01:43.865099] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:01:43.913419] [DEBUG] [LOCAL ] FSCO: Primary data saved (39152 records). [2025-10-17T19:01:43.913578] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-17T19:01:43.913692] [INFO ] [MAIN ] Update Progress: 871/2368 symbols completed. FSCO took 31.5s. Estimated remaining: 3h 29m 7s. Rate: 7.2 symbols/min [2025-10-17T19:01:43.963227] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-17T19:01:44.117178] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:44.173517] [DEBUG] [LOCAL ] FSM: Loaded 53691 existing records from primary storage. [2025-10-17T19:01:44.173942] [INFO ] [MAIN ] FSM: Loaded 53691 existing records. [2025-10-17T19:01:44.364213] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:44.364452] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-17T19:01:44.364502] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-17T19:01:44.364758] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-17T19:01:44.364816] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-17T19:01:44.723870] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:44.757992] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-17T19:01:44.947357] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T19:01:45.558045] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-17T19:01:45.886245] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T19:01:46.358076] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-17T19:01:46.446813] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T19:01:47.071047] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T19:01:47.158035] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-17T19:01:47.958043] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-17T19:01:48.264081] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:01:48.758013] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-17T19:01:49.074941] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T19:01:49.082331] [INFO ] [REMOTE ] FSK: Full fetch complete (72095 records). [2025-10-17T19:01:49.082471] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-17T19:01:49.479900] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-17T19:01:49.480079] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-17T19:01:49.481157] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-17T19:01:49.490983] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-17T19:01:49.510040] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:01:49.521257] [DEBUG] [LOCAL ] FSK: Trimmed 72095 records to 50273 (keeping 200 days of data) [2025-10-17T19:01:49.576046] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-17T19:01:49.833491] [DEBUG] [LOCAL ] FSK: Primary data saved (50273 records). [2025-10-17T19:01:49.833683] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-17T19:01:49.834306] [INFO ] [MAIN ] Update Progress: 872/2368 symbols completed. FSK took 36.1s. Estimated remaining: 3h 28m 54s. Rate: 7.2 symbols/min [2025-10-17T19:01:50.002787] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:50.038842] [DEBUG] [LOCAL ] FSS: Loaded 33877 existing records from primary storage. [2025-10-17T19:01:50.039140] [INFO ] [MAIN ] FSS: Loaded 33877 existing records. [2025-10-17T19:01:50.214219] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:50.214437] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-17T19:01:50.214485] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-17T19:01:50.214720] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-17T19:01:50.214794] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-17T19:01:50.362742] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-17T19:01:50.572788] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:50.751672] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T19:01:50.759204] [INFO ] [REMOTE ] FRO: Full fetch complete (75377 records). [2025-10-17T19:01:50.759343] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-17T19:01:51.154747] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-17T19:01:51.154861] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-17T19:01:51.155850] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-17T19:01:51.155999] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-17T19:01:51.157713] [DEBUG] [LOCAL ] FRO: Trimmed 75377 records to 52460 (keeping 200 days of data) [2025-10-17T19:01:51.158183] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-17T19:01:51.404865] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:01:51.522270] [DEBUG] [LOCAL ] FRO: Primary data saved (52460 records). [2025-10-17T19:01:51.522407] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-17T19:01:51.523015] [INFO ] [MAIN ] Update Progress: 873/2368 symbols completed. FRO took 56.9s. Estimated remaining: 3h 28m 34s. Rate: 7.2 symbols/min [2025-10-17T19:01:51.686910] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:51.696732] [DEBUG] [LOCAL ] FT: Loaded 6851 existing records from primary storage. [2025-10-17T19:01:51.696952] [INFO ] [MAIN ] FT: Loaded 6851 existing records. [2025-10-17T19:01:51.878044] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:51.878262] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-17T19:01:51.878310] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-17T19:01:51.878470] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-17T19:01:51.878525] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-17T19:01:51.958438] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-17T19:01:52.282718] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:52.312847] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T19:01:52.411414] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:01:52.758073] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-17T19:01:53.393766] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T19:01:53.558079] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-17T19:01:53.736618] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:01:54.263016] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T19:01:54.358033] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-17T19:01:55.158036] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-17T19:01:55.958072] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-17T19:01:56.189813] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:01:56.758063] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-17T19:01:56.999210] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T19:01:57.246771] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T19:01:57.359238] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:01:57.558042] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-17T19:01:58.358033] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-17T19:01:58.928747] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T19:01:58.950882] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:01:59.158024] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-17T19:01:59.958058] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-17T19:02:00.758052] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-17T19:02:01.558124] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-17T19:02:01.854481] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-17T19:02:01.862589] [INFO ] [REMOTE ] FSLY: Full fetch complete (74986 records). [2025-10-17T19:02:01.862907] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-17T19:02:02.269579] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-17T19:02:02.317491] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:02:02.333048] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-17T19:02:02.333365] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-17T19:02:02.334575] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-17T19:02:02.334703] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-17T19:02:02.336849] [DEBUG] [LOCAL ] FSLY: Trimmed 74986 records to 52088 (keeping 200 days of data) [2025-10-17T19:02:02.381828] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-17T19:02:02.631010] [DEBUG] [LOCAL ] FSLY: Primary data saved (52088 records). [2025-10-17T19:02:02.631152] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-17T19:02:02.631231] [INFO ] [MAIN ] Update Progress: 874/2368 symbols completed. FSLY took 42.1s. Estimated remaining: 3h 28m 30s. Rate: 7.2 symbols/min [2025-10-17T19:02:02.799303] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:02.812999] [DEBUG] [LOCAL ] FTHY: Loaded 12446 existing records from primary storage. [2025-10-17T19:02:02.813203] [INFO ] [MAIN ] FTHY: Loaded 12446 existing records. [2025-10-17T19:02:02.993364] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:02.993614] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-17T19:02:02.993694] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-17T19:02:02.993887] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-17T19:02:02.993945] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-17T19:02:03.166908] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-17T19:02:03.353147] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:03.892717] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T19:02:03.918874] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-17T19:02:03.957981] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-17T19:02:04.178223] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:02:04.758069] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-17T19:02:05.450857] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T19:02:05.480968] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:02:05.557991] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-17T19:02:06.247559] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T19:02:06.358024] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-17T19:02:07.158081] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-17T19:02:07.866550] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:02:07.958055] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-17T19:02:08.758126] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-17T19:02:08.978095] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T19:02:09.355169] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T19:02:09.558002] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-17T19:02:09.881074] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:02:10.358040] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-17T19:02:11.158012] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-17T19:02:11.369946] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:02:11.369691] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T19:02:11.958164] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-17T19:02:12.673288] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T19:02:12.758162] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-17T19:02:13.493809] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T19:02:13.558039] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-17T19:02:13.864600] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:02:14.358064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-17T19:02:14.778705] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T19:02:15.158274] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-17T19:02:15.187064] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:02:15.958049] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-17T19:02:16.532491] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T19:02:16.639322] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T19:02:16.758239] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-17T19:02:17.501225] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T19:02:17.558041] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-17T19:02:18.358028] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-17T19:02:19.158086] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-17T19:02:19.185464] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T19:02:19.187869] [INFO ] [REMOTE ] FT: Full fetch complete (9305 records). [2025-10-17T19:02:19.187990] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-17T19:02:19.553981] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-17T19:02:19.554164] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-17T19:02:19.554597] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-17T19:02:19.554793] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-17T19:02:19.555614] [DEBUG] [LOCAL ] FT: Trimmed 9305 records to 6884 (keeping 200 days of data) [2025-10-17T19:02:19.609850] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T19:02:19.625045] [INFO ] [REMOTE ] FSM: Full fetch complete (77091 records). [2025-10-17T19:02:19.626427] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-17T19:02:19.734107] [DEBUG] [LOCAL ] FT: Primary data saved (6884 records). [2025-10-17T19:02:19.736499] [INFO ] [MAIN ] FT: Full history saved. [2025-10-17T19:02:19.736594] [INFO ] [MAIN ] Update Progress: 875/2368 symbols completed. FT took 28.2s. Estimated remaining: 3h 28m 37s. Rate: 7.2 symbols/min [2025-10-17T19:02:19.958735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-17T19:02:20.068676] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:20.212524] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-17T19:02:20.213110] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-17T19:02:20.214082] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-17T19:02:20.214183] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-17T19:02:20.215835] [DEBUG] [LOCAL ] FSM: Trimmed 77091 records to 54081 (keeping 200 days of data) [2025-10-17T19:02:20.337119] [DEBUG] [LOCAL ] FTI: Loaded 53685 existing records from primary storage. [2025-10-17T19:02:20.338279] [INFO ] [MAIN ] FTI: Loaded 53685 existing records. [2025-10-17T19:02:20.546080] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:20.546374] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-17T19:02:20.546481] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-17T19:02:20.546893] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-17T19:02:20.546954] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-17T19:02:20.846764] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:02:20.903036] [INFO ] [REMOTE ] FSS: Full fetch complete (48628 records). [2025-10-17T19:02:20.923780] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-17T19:02:21.223985] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:21.286279] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-17T19:02:21.445003] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T19:02:21.558909] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-17T19:02:21.559481] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-17T19:02:21.559420] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-17T19:02:21.565017] [DEBUG] [LOCAL ] FSM: Primary data saved (54081 records). [2025-10-17T19:02:21.565334] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-17T19:02:21.565477] [INFO ] [MAIN ] Update Progress: 876/2368 symbols completed. FSM took 37.7s. Estimated remaining: 3h 28m 17s. Rate: 7.2 symbols/min [2025-10-17T19:02:21.566466] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-17T19:02:21.566568] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-17T19:02:21.660408] [DEBUG] [LOCAL ] FSS: Trimmed 48628 records to 34103 (keeping 200 days of data) [2025-10-17T19:02:21.846953] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:21.965535] [DEBUG] [LOCAL ] FSS: Primary data saved (34103 records). [2025-10-17T19:02:21.965972] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-17T19:02:21.966555] [INFO ] [MAIN ] Update Progress: 877/2368 symbols completed. FSS took 32.1s. Estimated remaining: 3h 27m 56s. Rate: 7.2 symbols/min [2025-10-17T19:02:21.997379] [DEBUG] [LOCAL ] FTK: Loaded 33095 existing records from primary storage. [2025-10-17T19:02:21.997807] [INFO ] [MAIN ] FTK: Loaded 33095 existing records. [2025-10-17T19:02:22.191369] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:22.191833] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-17T19:02:22.191908] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-17T19:02:22.192147] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-17T19:02:22.192207] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-17T19:02:22.418478] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:02:22.483921] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-17T19:02:22.565966] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:23.108977] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T19:02:23.158073] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-17T19:02:23.279309] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T19:02:23.958090] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-17T19:02:24.290095] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T19:02:24.748382] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T19:02:24.758014] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-17T19:02:25.558006] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-17T19:02:25.847207] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:02:26.358001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-17T19:02:26.435277] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T19:02:27.158080] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-17T19:02:27.377101] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:02:27.958070] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-17T19:02:28.758124] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-17T19:02:28.817718] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T19:02:29.128258] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T19:02:29.548009] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T19:02:29.557999] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-17T19:02:30.358056] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-17T19:02:30.769619] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T19:02:31.158109] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-17T19:02:31.372693] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T19:02:31.376194] [INFO ] [REMOTE ] FTHY: Full fetch complete (17252 records). [2025-10-17T19:02:31.376303] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-17T19:02:31.730982] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-17T19:02:31.731061] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-17T19:02:31.731438] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-17T19:02:31.731477] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-17T19:02:31.732050] [DEBUG] [LOCAL ] FTHY: Trimmed 17252 records to 12522 (keeping 200 days of data) [2025-10-17T19:02:31.807347] [DEBUG] [LOCAL ] FTHY: Primary data saved (12522 records). [2025-10-17T19:02:31.807503] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-17T19:02:31.807596] [INFO ] [MAIN ] Update Progress: 878/2368 symbols completed. FTHY took 29.2s. Estimated remaining: 3h 27m 50s. Rate: 7.2 symbols/min [2025-10-17T19:02:31.958024] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-17T19:02:32.579406] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:02:32.758025] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-17T19:02:33.620117] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:02:33.630492] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-17T19:02:34.226132] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:02:34.357999] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-17T19:02:35.548238] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T19:02:35.559735] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-17T19:02:35.780394] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:02:35.958038] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-17T19:02:37.348804] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T19:02:37.360834] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-17T19:02:37.436214] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:02:37.558063] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-17T19:02:39.229067] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:02:39.236703] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-17T19:02:39.908076] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-17T19:02:39.920795] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-17T19:02:40.666295] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:02:40.671071] [INFO ] [REMOTE ] FTK: Full fetch complete (43984 records). [2025-10-17T19:02:40.671159] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-17T19:02:41.037869] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-17T19:02:41.037946] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-17T19:02:41.038633] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-17T19:02:41.038712] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-17T19:02:41.039670] [DEBUG] [LOCAL ] FTK: Trimmed 43984 records to 33277 (keeping 200 days of data) [2025-10-17T19:02:41.228381] [DEBUG] [LOCAL ] FTK: Primary data saved (33277 records). [2025-10-17T19:02:41.228529] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-17T19:02:41.228609] [INFO ] [MAIN ] Update Progress: 879/2368 symbols completed. FTK took 19.7s. Estimated remaining: 3h 27m 43s. Rate: 7.2 symbols/min [2025-10-17T19:02:41.581229] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T19:02:41.592358] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-17T19:02:43.464200] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T19:02:43.481305] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-17T19:02:45.167128] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:02:45.178439] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-17T19:02:47.127807] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T19:02:47.139180] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-17T19:02:49.063823] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T19:02:49.071343] [INFO ] [REMOTE ] FTI: Full fetch complete (77330 records). [2025-10-17T19:02:49.071482] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-17T19:02:49.479722] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-17T19:02:49.479803] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-17T19:02:49.481014] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-17T19:02:49.481084] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-17T19:02:49.482602] [DEBUG] [LOCAL ] FTI: Trimmed 77330 records to 54070 (keeping 200 days of data) [2025-10-17T19:02:49.811832] [DEBUG] [LOCAL ] FTI: Primary data saved (54070 records). [2025-10-17T19:02:49.811984] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-17T19:02:49.812067] [INFO ] [MAIN ] Update Progress: 880/2368 symbols completed. FTI took 30.1s. Estimated remaining: 3h 27m 35s. Rate: 7.2 symbols/min [2025-10-17T19:02:50.395994] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.514390] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.496713] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.553897] [DEBUG] [LOCAL ] FTWO: Loaded 1940 existing records from primary storage. [2025-10-17T19:02:50.585620] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.586173] [INFO ] [MAIN ] FTWO: Loaded 1940 existing records. [2025-10-17T19:02:50.829231] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:50.829821] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-17T19:02:50.829894] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-17T19:02:50.830616] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-17T19:02:50.830838] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-17T19:02:50.991114] [DEBUG] [LOCAL ] FTV: Loaded 53454 existing records from primary storage. [2025-10-17T19:02:50.989693] [DEBUG] [LOCAL ] FUBO: Loaded 54108 existing records from primary storage. [2025-10-17T19:02:50.991692] [INFO ] [MAIN ] FTV: Loaded 53454 existing records. [2025-10-17T19:02:50.992559] [DEBUG] [LOCAL ] FTS: Loaded 42838 existing records from primary storage. [2025-10-17T19:02:51.004366] [INFO ] [MAIN ] FTS: Loaded 42838 existing records. [2025-10-17T19:02:50.998216] [INFO ] [MAIN ] FUBO: Loaded 54108 existing records. [2025-10-17T19:02:51.631629] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:51.755961] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-17T19:02:51.743964] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:51.756180] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-17T19:02:51.789490] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-17T19:02:51.836669] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:51.836837] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-17T19:02:51.833124] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-17T19:02:51.837099] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-17T19:02:51.849101] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-17T19:02:51.842288] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-17T19:02:51.881240] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-17T19:02:51.881143] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-17T19:02:51.902017] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-17T19:02:51.907387] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-17T19:02:52.133909] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:52.199580] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-17T19:02:52.912938] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:52.943939] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T19:02:52.970341] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-17T19:02:52.991714] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-17T19:02:53.091493] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:53.092868] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-17T19:02:53.113716] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:53.114202] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-17T19:02:53.626587] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T19:02:53.628346] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-17T19:02:54.108929] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:02:54.110395] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-17T19:02:54.447366] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T19:02:54.455854] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-17T19:02:54.484113] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T19:02:54.485445] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-17T19:02:54.551008] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:02:54.561687] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-17T19:02:55.077323] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T19:02:55.078417] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-17T19:02:55.122938] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T19:02:55.133904] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-17T19:02:55.419323] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-17T19:02:55.420455] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-17T19:02:55.613020] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:02:55.622408] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-17T19:02:55.881206] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-17T19:02:55.882452] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-17T19:02:56.334723] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T19:02:56.336204] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-17T19:02:56.368870] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T19:02:56.379471] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-17T19:02:56.787432] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T19:02:56.788615] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-17T19:02:57.033573] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:02:57.146921] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T19:02:57.190427] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T19:02:57.557988] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-17T19:02:57.974416] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:02:58.358000] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-17T19:02:58.791981] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T19:02:58.793205] [INFO ] [REMOTE ] FTWO: Full fetch complete (3332 records). [2025-10-17T19:02:58.793302] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-17T19:02:59.146262] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-17T19:02:59.146347] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-17T19:02:59.146461] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-17T19:02:59.146500] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-17T19:02:59.146859] [DEBUG] [LOCAL ] FTWO: Trimmed 3332 records to 1965 (keeping 200 days of data) [2025-10-17T19:02:59.159289] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-17T19:02:59.159247] [DEBUG] [LOCAL ] FTWO: Primary data saved (1965 records). [2025-10-17T19:02:59.159443] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-17T19:02:59.160372] [INFO ] [MAIN ] Update Progress: 881/2368 symbols completed. FTWO took 9.3s. Estimated remaining: 3h 27m 28s. Rate: 7.2 symbols/min [2025-10-17T19:02:59.334284] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:59.366678] [DEBUG] [LOCAL ] FUL: Loaded 32565 existing records from primary storage. [2025-10-17T19:02:59.366963] [INFO ] [MAIN ] FUL: Loaded 32565 existing records. [2025-10-17T19:02:59.543784] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:59.543995] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-17T19:02:59.544052] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-17T19:02:59.544235] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-17T19:02:59.544285] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-17T19:02:59.904564] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:59.935127] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-17T19:02:59.957991] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-17T19:03:00.568606] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T19:03:00.758034] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-17T19:03:01.561707] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-17T19:03:02.366228] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-17T19:03:02.369917] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-17T19:03:03.158041] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-17T19:03:03.241570] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-17T19:03:03.335546] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T19:03:03.958136] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-17T19:03:04.098070] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:03:04.758043] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-17T19:03:04.963776] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:03:05.509957] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-17T19:03:05.558048] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-17T19:03:06.358019] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-17T19:03:06.598089] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T19:03:07.087051] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T19:03:07.157989] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-17T19:03:07.958068] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-17T19:03:08.619033] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:03:08.672170] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-17T19:03:08.758001] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-17T19:03:08.914279] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T19:03:09.558045] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-17T19:03:10.358032] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-17T19:03:10.925718] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-17T19:03:11.158047] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-17T19:03:11.305882] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:03:11.958047] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-17T19:03:12.035000] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:03:12.758037] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-17T19:03:13.528766] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T19:03:13.557990] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-17T19:03:13.605408] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T19:03:13.906461] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T19:03:14.358089] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-17T19:03:15.158042] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-17T19:03:15.939125] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T19:03:15.957988] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-17T19:03:16.016795] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:03:16.758014] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-17T19:03:16.999318] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T19:03:17.558036] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-17T19:03:18.234120] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:03:18.240101] [INFO ] [REMOTE ] FTS: Full fetch complete (60653 records). [2025-10-17T19:03:18.240229] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-17T19:03:18.363712] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-17T19:03:18.452697] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-17T19:03:18.676138] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-17T19:03:18.676224] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-17T19:03:18.677230] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-17T19:03:18.677317] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-17T19:03:18.678754] [DEBUG] [LOCAL ] FTS: Trimmed 60653 records to 43161 (keeping 200 days of data) [2025-10-17T19:03:18.940719] [DEBUG] [LOCAL ] FTS: Primary data saved (43161 records). [2025-10-17T19:03:18.940925] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-17T19:03:18.941119] [INFO ] [MAIN ] Update Progress: 882/2368 symbols completed. FTS took 29.1s. Estimated remaining: 3h 27m 39s. Rate: 7.2 symbols/min [2025-10-17T19:03:19.144551] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:19.166399] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-17T19:03:19.169027] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:03:19.221668] [DEBUG] [LOCAL ] FUN: Loaded 52299 existing records from primary storage. [2025-10-17T19:03:19.221983] [INFO ] [MAIN ] FUN: Loaded 52299 existing records. [2025-10-17T19:03:19.402004] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:19.402200] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-17T19:03:19.402254] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-17T19:03:19.402443] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-17T19:03:19.402481] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-17T19:03:19.764593] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:19.958042] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-17T19:03:20.225052] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:03:20.758077] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-17T19:03:21.458437] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:03:21.567342] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-17T19:03:21.572082] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-17T19:03:21.579947] [INFO ] [REMOTE ] FUBO: Full fetch complete (77868 records). [2025-10-17T19:03:21.580057] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-17T19:03:21.969164] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-17T19:03:21.969254] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-17T19:03:21.970218] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-17T19:03:21.970281] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-17T19:03:21.971722] [DEBUG] [LOCAL ] FUBO: Trimmed 77868 records to 54497 (keeping 200 days of data) [2025-10-17T19:03:22.279627] [DEBUG] [LOCAL ] FUBO: Primary data saved (54497 records). [2025-10-17T19:03:22.279784] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-17T19:03:22.280511] [INFO ] [MAIN ] Update Progress: 883/2368 symbols completed. FUBO took 32.5s. Estimated remaining: 3h 27m 22s. Rate: 7.2 symbols/min [2025-10-17T19:03:22.361042] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-17T19:03:22.458306] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:22.497164] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T19:03:22.525039] [DEBUG] [LOCAL ] FVR: Loaded 21309 existing records from primary storage. [2025-10-17T19:03:22.525309] [INFO ] [MAIN ] FVR: Loaded 21309 existing records. [2025-10-17T19:03:22.699454] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:22.699668] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-17T19:03:22.699729] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-17T19:03:22.699948] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-17T19:03:22.700003] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-17T19:03:23.059534] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:23.098921] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T19:03:23.157986] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-17T19:03:23.968183] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-17T19:03:23.970860] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:03:24.671472] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:03:24.758006] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-17T19:03:25.063201] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T19:03:25.558062] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-17T19:03:26.273429] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:03:26.358026] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-17T19:03:26.669470] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:03:27.158028] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-17T19:03:27.957999] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-17T19:03:28.055150] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:03:28.412377] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T19:03:28.758085] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-17T19:03:28.925256] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:03:29.558069] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-17T19:03:30.358035] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-17T19:03:30.422567] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T19:03:30.642201] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:03:31.158048] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-17T19:03:31.958053] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-17T19:03:32.222274] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T19:03:32.229723] [INFO ] [REMOTE ] FTV: Full fetch complete (76625 records). [2025-10-17T19:03:32.229854] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-17T19:03:32.623666] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-17T19:03:32.623754] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-17T19:03:32.624708] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-17T19:03:32.624775] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-17T19:03:32.626188] [DEBUG] [LOCAL ] FTV: Trimmed 76625 records to 53827 (keeping 200 days of data) [2025-10-17T19:03:32.758497] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-17T19:03:32.896988] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T19:03:32.897972] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:03:33.025245] [DEBUG] [LOCAL ] FTV: Primary data saved (53827 records). [2025-10-17T19:03:33.025397] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-17T19:03:33.025478] [INFO ] [MAIN ] Update Progress: 884/2368 symbols completed. FTV took 43.2s. Estimated remaining: 3h 27m 18s. Rate: 7.2 symbols/min [2025-10-17T19:03:33.198612] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:33.236789] [DEBUG] [LOCAL ] FVRR: Loaded 40901 existing records from primary storage. [2025-10-17T19:03:33.237130] [INFO ] [MAIN ] FVRR: Loaded 40901 existing records. [2025-10-17T19:03:33.413536] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:33.413787] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-17T19:03:33.413856] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-17T19:03:33.414116] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-17T19:03:33.414187] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-17T19:03:33.570494] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-17T19:03:33.780868] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:34.110419] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T19:03:34.358066] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-17T19:03:34.750582] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T19:03:35.158038] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-17T19:03:35.958063] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-17T19:03:36.120947] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T19:03:36.575743] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:03:36.758250] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-17T19:03:37.333093] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:03:37.558041] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-17T19:03:38.194719] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:03:38.201780] [INFO ] [REMOTE ] FUL: Full fetch complete (47816 records). [2025-10-17T19:03:38.201953] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-17T19:03:38.363243] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-17T19:03:38.608374] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-17T19:03:38.608470] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-17T19:03:38.609251] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-17T19:03:38.609319] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-17T19:03:38.610523] [DEBUG] [LOCAL ] FUL: Trimmed 47816 records to 32752 (keeping 200 days of data) [2025-10-17T19:03:38.834617] [DEBUG] [LOCAL ] FUL: Primary data saved (32752 records). [2025-10-17T19:03:38.834885] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-17T19:03:38.835050] [INFO ] [MAIN ] Update Progress: 885/2368 symbols completed. FUL took 39.7s. Estimated remaining: 3h 27m 5s. Rate: 7.2 symbols/min [2025-10-17T19:03:39.056010] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:39.059912] [DEBUG] [LOCAL ] FXED: Loaded 1251 existing records from primary storage. [2025-10-17T19:03:39.060053] [INFO ] [MAIN ] FXED: Loaded 1251 existing records. [2025-10-17T19:03:39.162156] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-17T19:03:39.258666] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:39.259590] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-17T19:03:39.259773] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-17T19:03:39.259996] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-17T19:03:39.260104] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-17T19:03:39.474631] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T19:03:39.674078] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:39.687533] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T19:03:39.958034] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-17T19:03:40.309615] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T19:03:40.758005] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-17T19:03:40.812921] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T19:03:41.558052] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-17T19:03:41.985238] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T19:03:42.358018] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-17T19:03:42.544809] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T19:03:43.158037] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-17T19:03:43.957306] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:03:43.965100] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-17T19:03:44.298271] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T19:03:44.758014] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-17T19:03:44.963270] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:03:44.970947] [INFO ] [REMOTE ] FUN: Full fetch complete (73407 records). [2025-10-17T19:03:44.971069] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-17T19:03:45.133198] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-17T19:03:45.384201] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-17T19:03:45.384305] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-17T19:03:45.385289] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-17T19:03:45.385355] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-17T19:03:45.386740] [DEBUG] [LOCAL ] FUN: Trimmed 73407 records to 52679 (keeping 200 days of data) [2025-10-17T19:03:45.560218] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-17T19:03:45.695325] [DEBUG] [LOCAL ] FUN: Primary data saved (52679 records). [2025-10-17T19:03:45.695462] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-17T19:03:45.696029] [INFO ] [MAIN ] Update Progress: 886/2368 symbols completed. FUN took 26.8s. Estimated remaining: 3h 26m 54s. Rate: 7.2 symbols/min [2025-10-17T19:03:45.862866] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:45.908313] [DEBUG] [LOCAL ] G: Loaded 50433 existing records from primary storage. [2025-10-17T19:03:45.908614] [INFO ] [MAIN ] G: Loaded 50433 existing records. [2025-10-17T19:03:46.086288] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:46.086515] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-17T19:03:46.086604] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-17T19:03:46.086867] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-17T19:03:46.086926] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-17T19:03:46.363632] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-17T19:03:46.442706] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:46.820512] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-17T19:03:47.158022] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-17T19:03:47.198353] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:03:47.958049] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-17T19:03:48.763112] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-17T19:03:48.770964] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:03:48.958895] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:03:49.558035] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-17T19:03:49.906031] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T19:03:49.909691] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T19:03:50.358061] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-17T19:03:51.158050] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-17T19:03:51.554238] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-17T19:03:51.558130] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T19:03:51.958028] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-17T19:03:52.758038] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-17T19:03:53.029027] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T19:03:53.558032] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-17T19:03:54.233596] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:03:54.358014] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-17T19:03:54.600177] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T19:03:55.158062] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-17T19:03:55.828936] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:03:55.958012] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-17T19:03:56.677276] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:03:56.758035] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-17T19:03:56.906630] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T19:03:57.558040] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-17T19:03:58.358064] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-17T19:03:58.418903] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:03:59.148102] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:03:59.158080] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-17T19:03:59.347028] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:03:59.349705] [INFO ] [REMOTE ] FVR: Full fetch complete (29542 records). [2025-10-17T19:03:59.349779] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-17T19:03:59.713930] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-17T19:03:59.714011] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-17T19:03:59.714598] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-17T19:03:59.714638] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-17T19:03:59.715406] [DEBUG] [LOCAL ] FVR: Trimmed 29542 records to 21415 (keeping 200 days of data) [2025-10-17T19:03:59.844673] [DEBUG] [LOCAL ] FVR: Primary data saved (21415 records). [2025-10-17T19:03:59.844811] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-17T19:03:59.844897] [INFO ] [MAIN ] Update Progress: 887/2368 symbols completed. FVR took 37.6s. Estimated remaining: 3h 26m 56s. Rate: 7.2 symbols/min [2025-10-17T19:03:59.963184] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-17T19:04:00.029132] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:00.059464] [DEBUG] [LOCAL ] GAB: Loaded 27933 existing records from primary storage. [2025-10-17T19:04:00.059796] [INFO ] [MAIN ] GAB: Loaded 27933 existing records. [2025-10-17T19:04:00.242513] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:00.242762] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-17T19:04:00.242814] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-17T19:04:00.243060] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-17T19:04:00.243116] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-17T19:04:00.595630] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:00.758036] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-17T19:04:01.561226] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-17T19:04:01.579954] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T19:04:01.906190] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T19:04:01.968914] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T19:04:02.358002] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-17T19:04:02.785242] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T19:04:02.811830] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:04:03.158030] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-17T19:04:03.606737] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T19:04:03.958012] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-17T19:04:04.758008] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-17T19:04:05.079290] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T19:04:05.558028] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-17T19:04:06.358042] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-17T19:04:06.745436] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:04:07.067822] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-17T19:04:07.104969] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:04:07.106098] [INFO ] [REMOTE ] FXED: Full fetch complete (1786 records). [2025-10-17T19:04:07.106190] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-17T19:04:07.166561] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-17T19:04:07.509796] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-17T19:04:07.509885] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-17T19:04:07.509991] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-17T19:04:07.510071] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-17T19:04:07.510465] [DEBUG] [LOCAL ] FXED: Trimmed 1786 records to 1259 (keeping 200 days of data) [2025-10-17T19:04:07.519118] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-10-17T19:04:07.519181] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-17T19:04:07.519250] [INFO ] [MAIN ] Update Progress: 888/2368 symbols completed. FXED took 28.7s. Estimated remaining: 3h 26m 46s. Rate: 7.2 symbols/min [2025-10-17T19:04:07.707377] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:07.714602] [DEBUG] [LOCAL ] GAM: Loaded 3940 existing records from primary storage. [2025-10-17T19:04:07.714853] [INFO ] [MAIN ] GAM: Loaded 3940 existing records. [2025-10-17T19:04:07.909103] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:07.909368] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-17T19:04:07.909436] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-17T19:04:07.909579] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-17T19:04:07.909635] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-17T19:04:07.970157] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-17T19:04:08.265573] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:08.758103] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-17T19:04:08.878275] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T19:04:09.559916] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-17T19:04:09.563108] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:04:09.822395] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:04:09.829556] [INFO ] [REMOTE ] FVRR: Full fetch complete (59300 records). [2025-10-17T19:04:09.829802] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-17T19:04:10.242198] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-17T19:04:10.242274] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-17T19:04:10.243130] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-17T19:04:10.243192] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-17T19:04:10.244304] [DEBUG] [LOCAL ] FVRR: Trimmed 59300 records to 41187 (keeping 200 days of data) [2025-10-17T19:04:10.358134] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-17T19:04:10.486702] [DEBUG] [LOCAL ] FVRR: Primary data saved (41187 records). [2025-10-17T19:04:10.486833] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-17T19:04:10.486916] [INFO ] [MAIN ] Update Progress: 889/2368 symbols completed. FVRR took 37.5s. Estimated remaining: 3h 26m 29s. Rate: 7.2 symbols/min [2025-10-17T19:04:10.668327] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:10.724372] [DEBUG] [LOCAL ] GAP: Loaded 54043 existing records from primary storage. [2025-10-17T19:04:10.724797] [INFO ] [MAIN ] GAP: Loaded 54043 existing records. [2025-10-17T19:04:10.927130] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:10.927401] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-17T19:04:10.927455] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-17T19:04:10.927896] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-17T19:04:10.927969] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-17T19:04:11.163145] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-17T19:04:11.294794] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:11.321427] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:04:11.487417] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:04:11.828685] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T19:04:11.957999] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-17T19:04:12.758033] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-17T19:04:13.389593] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T19:04:13.558020] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-17T19:04:13.739018] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:04:14.358027] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-17T19:04:15.079258] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T19:04:15.157988] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-17T19:04:15.292452] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:04:15.769504] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:04:15.957999] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-17T19:04:16.600573] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:04:16.758021] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-17T19:04:17.558009] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-17T19:04:17.992822] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T19:04:18.124355] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T19:04:18.358049] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-17T19:04:19.158044] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-17T19:04:19.788064] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T19:04:19.958054] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-17T19:04:20.019528] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:04:20.540415] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:04:20.758042] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-17T19:04:21.237773] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T19:04:21.558024] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-17T19:04:22.358114] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-17T19:04:23.158083] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-17T19:04:23.209966] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T19:04:23.213870] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:04:23.214017] [INFO ] [REMOTE ] GAM: Full fetch complete (6510 records). [2025-10-17T19:04:23.224187] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-17T19:04:23.594853] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-17T19:04:23.594974] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-17T19:04:23.595187] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-17T19:04:23.595229] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-17T19:04:23.595638] [DEBUG] [LOCAL ] GAM: Trimmed 6510 records to 3971 (keeping 200 days of data) [2025-10-17T19:04:23.619237] [DEBUG] [LOCAL ] GAM: Primary data saved (3971 records). [2025-10-17T19:04:23.619378] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-17T19:04:23.619462] [INFO ] [MAIN ] Update Progress: 890/2368 symbols completed. GAM took 16.1s. Estimated remaining: 3h 26m 28s. Rate: 7.2 symbols/min [2025-10-17T19:04:23.787340] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:23.810715] [DEBUG] [LOCAL ] GATX: Loaded 18184 existing records from primary storage. [2025-10-17T19:04:23.811002] [INFO ] [MAIN ] GATX: Loaded 18184 existing records. [2025-10-17T19:04:23.963785] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-17T19:04:23.996523] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:23.996800] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-17T19:04:23.996889] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-17T19:04:23.997219] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-17T19:04:23.997305] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-17T19:04:24.386811] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:24.607389] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:04:24.758028] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-17T19:04:25.558035] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-17T19:04:25.688044] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T19:04:26.358094] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-17T19:04:26.581074] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T19:04:26.606564] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:04:26.614184] [INFO ] [REMOTE ] G: Full fetch complete (72206 records). [2025-10-17T19:04:26.614355] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-17T19:04:27.002347] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-17T19:04:27.002440] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-17T19:04:27.003391] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-17T19:04:27.003454] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-17T19:04:27.004848] [DEBUG] [LOCAL ] G: Trimmed 72206 records to 50816 (keeping 200 days of data) [2025-10-17T19:04:27.178950] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-17T19:04:27.311329] [DEBUG] [LOCAL ] G: Primary data saved (50816 records). [2025-10-17T19:04:27.311470] [INFO ] [MAIN ] G: Full history saved. [2025-10-17T19:04:27.311970] [INFO ] [MAIN ] Update Progress: 891/2368 symbols completed. G took 41.6s. Estimated remaining: 3h 26m 12s. Rate: 7.2 symbols/min [2025-10-17T19:04:27.487138] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:27.504383] [DEBUG] [LOCAL ] GBAB: Loaded 12918 existing records from primary storage. [2025-10-17T19:04:27.504608] [INFO ] [MAIN ] GBAB: Loaded 12918 existing records. [2025-10-17T19:04:27.664667] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:04:27.711703] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:27.712400] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-17T19:04:27.712461] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-17T19:04:27.713053] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-17T19:04:27.713112] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-17T19:04:27.963168] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-17T19:04:28.064330] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:28.256888] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:04:28.758103] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-17T19:04:29.185035] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:04:29.558041] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-17T19:04:29.657191] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T19:04:30.358032] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-17T19:04:30.613995] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:04:31.090804] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T19:04:31.157998] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-17T19:04:31.958041] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-17T19:04:32.027344] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T19:04:32.758047] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-17T19:04:32.783998] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T19:04:33.558008] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-17T19:04:33.595145] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T19:04:34.358065] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-17T19:04:35.037704] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:04:35.136506] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T19:04:35.158016] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-17T19:04:35.958052] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-17T19:04:36.127902] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T19:04:36.758082] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-17T19:04:37.558018] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-17T19:04:37.869949] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:04:38.005289] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T19:04:38.308707] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T19:04:38.358048] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-17T19:04:39.158016] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-17T19:04:39.474421] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T19:04:39.958061] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-17T19:04:40.540534] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T19:04:40.758041] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-17T19:04:41.558034] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-17T19:04:41.645851] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:04:41.930222] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T19:04:42.358045] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-17T19:04:42.823398] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T19:04:42.827459] [INFO ] [REMOTE ] GAB: Full fetch complete (39395 records). [2025-10-17T19:04:42.827538] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-17T19:04:43.166854] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-17T19:04:43.199569] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-17T19:04:43.199690] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-17T19:04:43.200416] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-17T19:04:43.200460] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-17T19:04:43.201394] [DEBUG] [LOCAL ] GAB: Trimmed 39395 records to 28162 (keeping 200 days of data) [2025-10-17T19:04:43.301510] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T19:04:43.381258] [DEBUG] [LOCAL ] GAB: Primary data saved (28162 records). [2025-10-17T19:04:43.381414] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-17T19:04:43.381520] [INFO ] [MAIN ] Update Progress: 892/2368 symbols completed. GAB took 43.5s. Estimated remaining: 3h 26m 16s. Rate: 7.2 symbols/min [2025-10-17T19:04:43.545463] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:43.585016] [DEBUG] [LOCAL ] GBCI: Loaded 41242 existing records from primary storage. [2025-10-17T19:04:43.585311] [INFO ] [MAIN ] GBCI: Loaded 41242 existing records. [2025-10-17T19:04:43.756668] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:43.756904] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-17T19:04:43.756950] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-17T19:04:43.757274] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-17T19:04:43.757332] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-17T19:04:43.968329] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-17T19:04:44.125484] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:44.757996] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-17T19:04:44.848371] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T19:04:45.125519] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T19:04:45.558005] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-17T19:04:45.773305] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T19:04:46.203678] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-17T19:04:46.358027] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-17T19:04:47.158028] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-17T19:04:47.363061] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T19:04:47.958029] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-17T19:04:48.560760] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:04:48.758012] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-17T19:04:49.077127] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:04:49.558028] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-17T19:04:50.189695] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:04:50.244505] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T19:04:50.358021] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-17T19:04:51.158035] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-17T19:04:51.958003] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-17T19:04:52.400865] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:04:52.402550] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T19:04:52.415566] [INFO ] [REMOTE ] GBAB: Full fetch complete (18875 records). [2025-10-17T19:04:52.415755] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-17T19:04:52.771855] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-17T19:04:52.784122] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-17T19:04:52.784196] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-17T19:04:52.784718] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-17T19:04:52.784785] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-17T19:04:52.785675] [DEBUG] [LOCAL ] GBAB: Trimmed 18875 records to 12974 (keeping 200 days of data) [2025-10-17T19:04:52.869062] [DEBUG] [LOCAL ] GBAB: Primary data saved (12974 records). [2025-10-17T19:04:52.869269] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-17T19:04:52.869469] [INFO ] [MAIN ] Update Progress: 893/2368 symbols completed. GBAB took 25.6s. Estimated remaining: 3h 26m 10s. Rate: 7.2 symbols/min [2025-10-17T19:04:53.037879] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:53.038088] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-17T19:04:53.038184] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-17T19:04:53.038412] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-17T19:04:53.038545] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-17T19:04:53.038613] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-17T19:04:53.038750] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-17T19:04:53.150596] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:04:53.416156] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:53.558052] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-17T19:04:54.358052] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-17T19:04:54.745164] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T19:04:54.774079] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T19:04:54.950830] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:04:55.158062] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-17T19:04:55.564373] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-17T19:04:55.958031] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-17T19:04:56.193066] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-17T19:04:56.758011] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-17T19:04:57.558066] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-17T19:04:58.358014] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-17T19:04:58.618845] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T19:04:58.621295] [INFO ] [REMOTE ] GATX: Full fetch complete (24854 records). [2025-10-17T19:04:58.621379] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-17T19:04:59.047899] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-17T19:04:59.048857] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-17T19:04:59.049547] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-17T19:04:59.051515] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-17T19:04:59.051385] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-17T19:04:59.064107] [DEBUG] [LOCAL ] GATX: Trimmed 24854 records to 18269 (keeping 200 days of data) [2025-10-17T19:04:59.159052] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-17T19:04:59.189750] [DEBUG] [LOCAL ] GATX: Primary data saved (18269 records). [2025-10-17T19:04:59.189981] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-17T19:04:59.190139] [INFO ] [MAIN ] Update Progress: 894/2368 symbols completed. GATX took 35.6s. Estimated remaining: 3h 25m 58s. Rate: 7.2 symbols/min [2025-10-17T19:04:59.366563] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:59.406822] [DEBUG] [LOCAL ] GBTG: Loaded 40545 existing records from primary storage. [2025-10-17T19:04:59.407352] [INFO ] [MAIN ] GBTG: Loaded 40545 existing records. [2025-10-17T19:04:59.592719] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:59.593153] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-17T19:04:59.593277] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-17T19:04:59.593684] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-17T19:04:59.593833] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-17T19:04:59.863837] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:04:59.973738] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-17T19:05:00.017758] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:00.758026] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-17T19:05:01.558075] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-17T19:05:01.679911] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-17T19:05:01.869279] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:05:02.068241] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T19:05:02.358110] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-17T19:05:02.797015] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-17T19:05:03.158077] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-17T19:05:03.440179] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-17T19:05:03.459124] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-17T19:05:03.958046] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-17T19:05:04.239998] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-17T19:05:04.758055] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-17T19:05:05.558058] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-17T19:05:06.358038] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-17T19:05:06.717756] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-17T19:05:06.941475] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T19:05:06.950575] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-17T19:05:06.950836] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-17T19:05:07.126174] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T19:05:07.166831] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-17T19:05:07.402866] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-17T19:05:07.402995] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-17T19:05:07.404117] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-17T19:05:07.404184] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-17T19:05:07.405799] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 54433 (keeping 200 days of data) [2025-10-17T19:05:07.748498] [DEBUG] [LOCAL ] GAP: Primary data saved (54433 records). [2025-10-17T19:05:07.748708] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-17T19:05:07.748860] [INFO ] [MAIN ] Update Progress: 895/2368 symbols completed. GAP took 57.3s. Estimated remaining: 3h 25m 50s. Rate: 7.2 symbols/min [2025-10-17T19:05:07.914354] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:07.945389] [DEBUG] [LOCAL ] GBX: Loaded 29120 existing records from primary storage. [2025-10-17T19:05:07.945701] [INFO ] [MAIN ] GBX: Loaded 29120 existing records. [2025-10-17T19:05:07.966078] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-17T19:05:08.124156] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:08.124366] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-17T19:05:08.124413] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-17T19:05:08.124627] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-17T19:05:08.124712] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-17T19:05:08.473552] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:08.654896] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T19:05:08.758009] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-17T19:05:09.558008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-17T19:05:09.655125] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T19:05:10.003297] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T19:05:10.079896] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:05:10.358041] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-17T19:05:11.158039] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-17T19:05:11.941514] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:05:11.957994] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-17T19:05:12.725377] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:05:12.757989] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-17T19:05:13.119791] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T19:05:13.408811] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:05:13.558000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-17T19:05:14.358078] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-17T19:05:15.158002] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-17T19:05:15.181757] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T19:05:15.576007] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T19:05:15.576746] [INFO ] [REMOTE ] GBLI: Full fetch complete (1273 records). [2025-10-17T19:05:15.576833] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-17T19:05:15.809290] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-17T19:05:15.809623] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:05:15.809780] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:05:15.809912] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-17T19:05:15.810112] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-17T19:05:15.810183] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-17T19:05:15.810365] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-17T19:05:15.810445] [INFO ] [MAIN ] Update Progress: 896/2368 symbols completed. GBLI took 22.9s. Estimated remaining: 3h 25m 41s. Rate: 7.2 symbols/min [2025-10-17T19:05:15.961910] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-17T19:05:15.980062] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:16.006357] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T19:05:16.055568] [DEBUG] [LOCAL ] GCI: Loaded 44182 existing records from primary storage. [2025-10-17T19:05:16.055894] [INFO ] [MAIN ] GCI: Loaded 44182 existing records. [2025-10-17T19:05:16.227111] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:16.227346] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-17T19:05:16.227415] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-17T19:05:16.227795] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-17T19:05:16.227853] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-17T19:05:16.577676] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:16.758005] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-17T19:05:17.174995] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T19:05:17.558028] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-17T19:05:18.259630] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:05:18.358017] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-17T19:05:18.426837] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T19:05:19.158070] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-17T19:05:19.786361] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:05:19.958040] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-17T19:05:20.758024] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-17T19:05:20.960128] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T19:05:20.968520] [INFO ] [REMOTE ] GBCI: Full fetch complete (59214 records). [2025-10-17T19:05:20.968832] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-17T19:05:21.412451] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-17T19:05:21.412674] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-17T19:05:21.414499] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-17T19:05:21.414608] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-17T19:05:21.416666] [DEBUG] [LOCAL ] GBCI: Trimmed 59214 records to 41621 (keeping 200 days of data) [2025-10-17T19:05:21.556601] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:05:21.560980] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-17T19:05:21.745564] [DEBUG] [LOCAL ] GBCI: Primary data saved (41621 records). [2025-10-17T19:05:21.745762] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-17T19:05:21.746430] [INFO ] [MAIN ] Update Progress: 897/2368 symbols completed. GBCI took 38.4s. Estimated remaining: 3h 25m 29s. Rate: 7.2 symbols/min [2025-10-17T19:05:21.974148] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:22.011523] [DEBUG] [LOCAL ] GCO: Loaded 23761 existing records from primary storage. [2025-10-17T19:05:22.011942] [INFO ] [MAIN ] GCO: Loaded 23761 existing records. [2025-10-17T19:05:22.307244] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:22.323250] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-17T19:05:22.325712] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T19:05:22.324234] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-17T19:05:22.333171] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-17T19:05:22.333700] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-17T19:05:22.363368] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-17T19:05:22.862375] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:23.082456] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T19:05:23.158081] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-17T19:05:23.778155] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T19:05:23.958049] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-17T19:05:24.214984] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:05:24.758044] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-17T19:05:25.558013] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-17T19:05:26.050147] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T19:05:26.358017] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-17T19:05:26.416907] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:05:26.833849] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:05:27.158070] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-17T19:05:27.744944] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:05:27.958081] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-17T19:05:28.317721] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:05:28.758084] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-17T19:05:29.332533] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:05:29.560810] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-17T19:05:29.879126] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:05:30.358025] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-17T19:05:31.106066] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:05:31.158016] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-17T19:05:31.401014] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T19:05:31.958059] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-17T19:05:32.622564] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T19:05:32.628296] [INFO ] [REMOTE ] GBTG: Full fetch complete (56752 records). [2025-10-17T19:05:32.628407] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-17T19:05:32.765091] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-17T19:05:33.011715] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-17T19:05:33.011786] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-17T19:05:33.012564] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-17T19:05:33.012605] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-17T19:05:33.013759] [DEBUG] [LOCAL ] GBTG: Trimmed 56752 records to 40850 (keeping 200 days of data) [2025-10-17T19:05:33.239253] [DEBUG] [LOCAL ] GBTG: Primary data saved (40850 records). [2025-10-17T19:05:33.239414] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-17T19:05:33.239510] [INFO ] [MAIN ] Update Progress: 898/2368 symbols completed. GBTG took 34.0s. Estimated remaining: 3h 25m 25s. Rate: 7.2 symbols/min [2025-10-17T19:05:33.411121] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:05:33.436875] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:33.468635] [DEBUG] [LOCAL ] GCTS: Loaded 20570 existing records from primary storage. [2025-10-17T19:05:33.468985] [INFO ] [MAIN ] GCTS: Loaded 20570 existing records. [2025-10-17T19:05:33.563136] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-17T19:05:33.658873] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:33.659095] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-17T19:05:33.659143] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-17T19:05:33.659439] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-17T19:05:33.659499] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-17T19:05:34.036661] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:34.263832] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T19:05:34.358004] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-17T19:05:34.706686] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:05:35.130609] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:05:35.157992] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-17T19:05:35.958042] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-17T19:05:36.252519] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T19:05:36.704367] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T19:05:36.757997] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-17T19:05:37.558025] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-17T19:05:38.042497] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T19:05:38.358042] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-17T19:05:38.573112] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:05:38.578854] [INFO ] [REMOTE ] GBX: Full fetch complete (42863 records). [2025-10-17T19:05:38.578987] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-17T19:05:38.965548] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-17T19:05:38.965626] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-17T19:05:38.966368] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-17T19:05:38.966420] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-17T19:05:38.967371] [DEBUG] [LOCAL ] GBX: Trimmed 42863 records to 29290 (keeping 200 days of data) [2025-10-17T19:05:39.138337] [DEBUG] [LOCAL ] GBX: Primary data saved (29290 records). [2025-10-17T19:05:39.138463] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-17T19:05:39.138544] [INFO ] [MAIN ] Update Progress: 899/2368 symbols completed. GBX took 31.4s. Estimated remaining: 3h 25m 13s. Rate: 7.2 symbols/min [2025-10-17T19:05:39.163160] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-17T19:05:39.312898] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:39.322319] [DEBUG] [LOCAL ] GCV: Loaded 7864 existing records from primary storage. [2025-10-17T19:05:39.322502] [INFO ] [MAIN ] GCV: Loaded 7864 existing records. [2025-10-17T19:05:39.421862] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:05:39.511908] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:39.512189] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-17T19:05:39.512238] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-17T19:05:39.512381] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-17T19:05:39.512420] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-17T19:05:39.886862] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:39.958036] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-17T19:05:40.564970] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T19:05:40.631958] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T19:05:40.758016] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-17T19:05:41.365118] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T19:05:41.558057] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-17T19:05:42.358090] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-17T19:05:43.118887] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:05:43.158019] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-17T19:05:43.502701] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T19:05:43.958043] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-17T19:05:44.696956] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T19:05:44.758065] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-17T19:05:45.009706] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:05:45.558035] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-17T19:05:45.970684] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:05:46.217874] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T19:05:46.358019] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-17T19:05:47.158019] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-17T19:05:47.286894] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T19:05:47.958010] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-17T19:05:48.196871] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T19:05:48.758029] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-17T19:05:48.932206] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T19:05:49.558004] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-17T19:05:49.687252] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T19:05:50.358039] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-17T19:05:50.726042] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T19:05:50.766508] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T19:05:51.158028] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-17T19:05:51.914862] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:05:51.958019] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-17T19:05:52.758050] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-17T19:05:53.558035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-17T19:05:53.658862] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:05:53.828796] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T19:05:54.358081] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-17T19:05:54.787004] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T19:05:55.158007] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-17T19:05:55.454493] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:05:55.457129] [INFO ] [REMOTE ] GCO: Full fetch complete (34981 records). [2025-10-17T19:05:55.457204] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-17T19:05:55.822471] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-17T19:05:55.822549] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-17T19:05:55.823232] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-17T19:05:55.823295] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-17T19:05:55.824106] [DEBUG] [LOCAL ] GCO: Trimmed 34981 records to 23845 (keeping 200 days of data) [2025-10-17T19:05:55.957033] [DEBUG] [LOCAL ] GCO: Primary data saved (23845 records). [2025-10-17T19:05:55.957162] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-17T19:05:55.957243] [INFO ] [MAIN ] Update Progress: 900/2368 symbols completed. GCO took 34.2s. Estimated remaining: 3h 25m 18s. Rate: 7.2 symbols/min [2025-10-17T19:05:55.968242] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-17T19:05:56.124787] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:56.171963] [DEBUG] [LOCAL ] GD: Loaded 47051 existing records from primary storage. [2025-10-17T19:05:56.172265] [INFO ] [MAIN ] GD: Loaded 47051 existing records. [2025-10-17T19:05:56.344195] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:56.344401] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-17T19:05:56.344447] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-17T19:05:56.344842] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-17T19:05:56.344900] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-17T19:05:56.710073] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:56.748615] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T19:05:56.763120] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-17T19:05:56.777330] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T19:05:57.558027] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-17T19:05:57.837161] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T19:05:58.358077] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-17T19:05:59.044910] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T19:05:59.164279] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-17T19:05:59.182466] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T19:05:59.923993] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T19:05:59.957989] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-17T19:06:00.758003] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-17T19:06:01.004524] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:06:01.558032] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-17T19:06:02.358020] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-17T19:06:02.789162] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T19:06:03.158069] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-17T19:06:03.333308] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T19:06:03.516452] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-10-17T19:06:03.943593] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:06:03.945670] [INFO ] [REMOTE ] GCV: Full fetch complete (9854 records). [2025-10-17T19:06:03.945779] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-17T19:06:03.963217] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-17T19:06:04.308842] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-17T19:06:04.308926] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-17T19:06:04.309250] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-17T19:06:04.309322] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-17T19:06:04.310145] [DEBUG] [LOCAL ] GCV: Trimmed 9854 records to 7903 (keeping 200 days of data) [2025-10-17T19:06:04.356962] [DEBUG] [LOCAL ] GCV: Primary data saved (7903 records). [2025-10-17T19:06:04.357106] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-17T19:06:04.357190] [INFO ] [MAIN ] Update Progress: 901/2368 symbols completed. GCV took 25.2s. Estimated remaining: 3h 25m 10s. Rate: 7.2 symbols/min [2025-10-17T19:06:04.525767] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:04.572798] [DEBUG] [LOCAL ] GDDY: Loaded 50151 existing records from primary storage. [2025-10-17T19:06:04.573145] [INFO ] [MAIN ] GDDY: Loaded 50151 existing records. [2025-10-17T19:06:04.750237] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:04.750436] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-17T19:06:04.750481] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-17T19:06:04.750770] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-17T19:06:04.750834] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-17T19:06:04.763350] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-17T19:06:05.099203] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:05.503904] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T19:06:05.510149] [INFO ] [REMOTE ] GCI: Full fetch complete (63437 records). [2025-10-17T19:06:05.510278] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-17T19:06:05.564745] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-17T19:06:05.901694] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-17T19:06:05.901781] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-17T19:06:05.902665] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-17T19:06:05.902731] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-17T19:06:05.904075] [DEBUG] [LOCAL ] GCI: Trimmed 63437 records to 44504 (keeping 200 days of data) [2025-10-17T19:06:06.157792] [DEBUG] [LOCAL ] GCI: Primary data saved (44504 records). [2025-10-17T19:06:06.157927] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-17T19:06:06.158421] [INFO ] [MAIN ] Update Progress: 902/2368 symbols completed. GCI took 50.3s. Estimated remaining: 3h 24m 51s. Rate: 7.2 symbols/min [2025-10-17T19:06:06.325033] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:06.332802] [DEBUG] [LOCAL ] GDIV: Loaded 3621 existing records from primary storage. [2025-10-17T19:06:06.333070] [INFO ] [MAIN ] GDIV: Loaded 3621 existing records. [2025-10-17T19:06:06.363978] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-17T19:06:06.511665] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:06.511891] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-17T19:06:06.511939] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-17T19:06:06.512084] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-17T19:06:06.512124] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-17T19:06:06.866012] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:06.894583] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T19:06:07.158041] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-17T19:06:07.438427] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T19:06:07.528193] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T19:06:07.958036] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-17T19:06:08.758013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-17T19:06:08.972878] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T19:06:09.012308] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T19:06:09.015424] [INFO ] [REMOTE ] GCTS: Full fetch complete (26950 records). [2025-10-17T19:06:09.015530] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-17T19:06:09.317683] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T19:06:09.403115] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-17T19:06:09.403192] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-17T19:06:09.403720] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-17T19:06:09.403782] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-17T19:06:09.404421] [DEBUG] [LOCAL ] GCTS: Trimmed 26950 records to 20642 (keeping 200 days of data) [2025-10-17T19:06:09.515090] [DEBUG] [LOCAL ] GCTS: Primary data saved (20642 records). [2025-10-17T19:06:09.515215] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-17T19:06:09.515297] [INFO ] [MAIN ] Update Progress: 903/2368 symbols completed. GCTS took 36.3s. Estimated remaining: 3h 24m 34s. Rate: 7.2 symbols/min [2025-10-17T19:06:09.567022] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-17T19:06:09.682301] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:09.686827] [DEBUG] [LOCAL ] GDL: Loaded 2541 existing records from primary storage. [2025-10-17T19:06:09.686974] [INFO ] [MAIN ] GDL: Loaded 2541 existing records. [2025-10-17T19:06:09.857809] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:09.858000] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-17T19:06:09.858047] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-17T19:06:09.858179] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-17T19:06:09.858219] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-17T19:06:10.206102] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:10.357988] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-17T19:06:10.829908] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T19:06:11.158001] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-17T19:06:11.274302] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T19:06:11.644825] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T19:06:11.958053] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-17T19:06:12.758020] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-17T19:06:13.558107] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-17T19:06:13.710966] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:06:14.200197] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T19:06:14.223926] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T19:06:14.358125] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-17T19:06:15.158124] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-17T19:06:15.616969] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T19:06:15.958045] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-17T19:06:16.266231] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:06:16.545776] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T19:06:16.758027] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-17T19:06:17.343294] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:06:17.558054] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-17T19:06:18.004778] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T19:06:18.358016] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-17T19:06:19.010480] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T19:06:19.158042] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-17T19:06:19.644706] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T19:06:19.958036] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-17T19:06:20.758038] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-17T19:06:21.219191] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T19:06:21.558003] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-17T19:06:21.823708] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T19:06:21.934502] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-17T19:06:22.358032] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-17T19:06:23.158098] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-17T19:06:23.801198] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:06:23.958002] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-17T19:06:24.078028] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:06:24.758020] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-17T19:06:25.315726] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T19:06:25.558003] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-17T19:06:25.639972] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:06:26.026106] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T19:06:26.358016] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-17T19:06:27.158080] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-17T19:06:27.719473] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:06:27.958030] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-17T19:06:27.993303] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:06:28.609769] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-17T19:06:28.758035] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-17T19:06:29.558031] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-17T19:06:30.358040] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-17T19:06:30.435421] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:06:30.940432] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T19:06:31.158060] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-17T19:06:31.274638] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:06:31.664807] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T19:06:31.958034] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-17T19:06:32.758027] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-17T19:06:33.229392] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-17T19:06:33.558038] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-17T19:06:33.617523] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:06:34.168844] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T19:06:34.169832] [INFO ] [REMOTE ] GDIV: Full fetch complete (5415 records). [2025-10-17T19:06:34.169901] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-17T19:06:34.364507] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-17T19:06:34.520029] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-17T19:06:34.520106] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-17T19:06:34.520258] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-17T19:06:34.520294] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-17T19:06:34.520665] [DEBUG] [LOCAL ] GDIV: Trimmed 5415 records to 3630 (keeping 200 days of data) [2025-10-17T19:06:34.542526] [DEBUG] [LOCAL ] GDIV: Primary data saved (3630 records). [2025-10-17T19:06:34.542611] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-17T19:06:34.542711] [INFO ] [MAIN ] Update Progress: 904/2368 symbols completed. GDIV took 28.4s. Estimated remaining: 3h 24m 53s. Rate: 7.1 symbols/min [2025-10-17T19:06:34.705346] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:34.713783] [DEBUG] [LOCAL ] GDO: Loaded 5863 existing records from primary storage. [2025-10-17T19:06:34.713965] [INFO ] [MAIN ] GDO: Loaded 5863 existing records. [2025-10-17T19:06:34.889355] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:34.889581] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-17T19:06:34.889635] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-17T19:06:34.889974] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-17T19:06:34.890030] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-17T19:06:35.159798] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-17T19:06:35.239250] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:35.958041] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-17T19:06:36.059441] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T19:06:36.504732] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T19:06:36.505592] [INFO ] [REMOTE ] GDL: Full fetch complete (3493 records). [2025-10-17T19:06:36.505684] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-17T19:06:36.763230] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-17T19:06:36.855880] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-17T19:06:36.855957] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-17T19:06:36.856082] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-17T19:06:36.856122] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-17T19:06:36.856458] [DEBUG] [LOCAL ] GDL: Trimmed 3493 records to 2550 (keeping 200 days of data) [2025-10-17T19:06:36.871309] [DEBUG] [LOCAL ] GDL: Primary data saved (2550 records). [2025-10-17T19:06:36.871383] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-17T19:06:36.871453] [INFO ] [MAIN ] Update Progress: 905/2368 symbols completed. GDL took 27.4s. Estimated remaining: 3h 24m 35s. Rate: 7.2 symbols/min [2025-10-17T19:06:37.039799] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:37.066744] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:06:37.107140] [DEBUG] [LOCAL ] GDOT: Loaded 38078 existing records from primary storage. [2025-10-17T19:06:37.107448] [INFO ] [MAIN ] GDOT: Loaded 38078 existing records. [2025-10-17T19:06:37.283091] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:37.283320] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-17T19:06:37.283376] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-17T19:06:37.283695] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-17T19:06:37.283758] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-17T19:06:37.559880] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-17T19:06:37.641428] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:37.691338] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:06:38.358040] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-17T19:06:39.158038] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-17T19:06:39.299803] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T19:06:39.835916] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T19:06:39.957987] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-17T19:06:40.137377] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:06:40.143575] [INFO ] [REMOTE ] GD: Full fetch complete (69753 records). [2025-10-17T19:06:40.143717] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-17T19:06:40.527034] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-17T19:06:40.527217] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-17T19:06:40.528272] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-17T19:06:40.528339] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-17T19:06:40.529687] [DEBUG] [LOCAL ] GD: Trimmed 69753 records to 47354 (keeping 200 days of data) [2025-10-17T19:06:40.626184] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T19:06:40.759994] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-17T19:06:40.841829] [DEBUG] [LOCAL ] GD: Primary data saved (47354 records). [2025-10-17T19:06:40.842011] [INFO ] [MAIN ] GD: Full history saved. [2025-10-17T19:06:40.842601] [INFO ] [MAIN ] Update Progress: 906/2368 symbols completed. GD took 44.9s. Estimated remaining: 3h 24m 19s. Rate: 7.2 symbols/min [2025-10-17T19:06:41.011512] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:41.032026] [DEBUG] [LOCAL ] GDV: Loaded 19620 existing records from primary storage. [2025-10-17T19:06:41.032298] [INFO ] [MAIN ] GDV: Loaded 19620 existing records. [2025-10-17T19:06:41.206194] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:41.206407] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-17T19:06:41.206457] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-17T19:06:41.206761] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-17T19:06:41.206832] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-17T19:06:41.557950] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:41.558062] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-17T19:06:42.064293] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T19:06:42.077164] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T19:06:42.358031] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-17T19:06:43.039274] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T19:06:43.158065] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-17T19:06:43.759487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T19:06:43.958059] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-17T19:06:44.758042] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-17T19:06:45.089529] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:06:45.558071] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-17T19:06:46.063029] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T19:06:46.358026] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-17T19:06:46.657324] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T19:06:47.158039] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-17T19:06:47.958046] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-17T19:06:48.217120] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:06:48.291126] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:06:48.757992] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-17T19:06:49.155504] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T19:06:49.557987] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-17T19:06:49.723938] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T19:06:50.152313] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T19:06:50.358026] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-17T19:06:51.051925] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T19:06:51.158137] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-17T19:06:51.762011] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T19:06:51.958036] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-17T19:06:52.758131] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-17T19:06:53.558071] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-17T19:06:53.608505] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T19:06:54.358071] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-17T19:06:54.451123] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:06:54.667061] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:06:55.158122] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-17T19:06:55.814780] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:06:55.958047] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-17T19:06:56.758062] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-17T19:06:56.948931] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:06:56.956410] [INFO ] [REMOTE ] GDDY: Full fetch complete (72181 records). [2025-10-17T19:06:56.956555] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-17T19:06:57.348706] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-17T19:06:57.348910] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-17T19:06:57.349864] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-17T19:06:57.349947] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-17T19:06:57.351821] [DEBUG] [LOCAL ] GDDY: Trimmed 72181 records to 50516 (keeping 200 days of data) [2025-10-17T19:06:57.416328] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T19:06:57.443495] [INFO ] [REMOTE ] GDO: Full fetch complete (8529 records). [2025-10-17T19:06:57.451316] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-17T19:06:57.516591] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:06:57.583426] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-17T19:06:57.994884] [DEBUG] [LOCAL ] GDDY: Primary data saved (50516 records). [2025-10-17T19:06:58.022148] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-17T19:06:58.024748] [INFO ] [MAIN ] Update Progress: 907/2368 symbols completed. GDDY took 53.7s. Estimated remaining: 3h 24m 25s. Rate: 7.1 symbols/min [2025-10-17T19:06:58.189820] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-17T19:06:58.189964] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-17T19:06:58.190231] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-17T19:06:58.190309] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-17T19:06:58.206759] [DEBUG] [LOCAL ] GDO: Trimmed 8529 records to 5892 (keeping 200 days of data) [2025-10-17T19:06:58.288783] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:58.295018] [DEBUG] [LOCAL ] GDO: Primary data saved (5892 records). [2025-10-17T19:06:58.295133] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-17T19:06:58.295486] [INFO ] [MAIN ] Update Progress: 908/2368 symbols completed. GDO took 23.8s. Estimated remaining: 3h 24m 3s. Rate: 7.2 symbols/min [2025-10-17T19:06:58.368339] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-17T19:06:58.466230] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:58.508598] [DEBUG] [LOCAL ] GE: Loaded 54088 existing records from primary storage. [2025-10-17T19:06:58.508950] [INFO ] [MAIN ] GE: Loaded 54088 existing records. [2025-10-17T19:06:58.616183] [DEBUG] [LOCAL ] GEF: Loaded 20966 existing records from primary storage. [2025-10-17T19:06:58.616458] [INFO ] [MAIN ] GEF: Loaded 20966 existing records. [2025-10-17T19:06:58.802624] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:58.846343] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-17T19:06:58.855561] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-17T19:06:58.870539] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-17T19:06:58.883223] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:58.883547] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-17T19:06:58.883672] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-17T19:06:58.883364] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-17T19:06:58.918906] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-17T19:06:58.925463] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-17T19:06:59.465075] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T19:06:59.585859] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:59.625885] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:59.621102] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-17T19:06:59.668853] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:06:59.958040] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-17T19:07:00.758026] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-17T19:07:01.287361] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T19:07:01.457808] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T19:07:01.558067] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-17T19:07:02.358070] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-17T19:07:02.721074] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T19:07:03.158118] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-17T19:07:03.696243] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-17T19:07:03.958049] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-17T19:07:04.143304] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T19:07:04.396139] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T19:07:04.758031] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-17T19:07:05.531251] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:07:05.558044] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-17T19:07:06.358030] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-17T19:07:06.689773] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:07:06.861269] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-17T19:07:07.158037] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-17T19:07:07.889451] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:07:07.895503] [INFO ] [REMOTE ] GDOT: Full fetch complete (53599 records). [2025-10-17T19:07:07.895604] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-17T19:07:07.963180] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-17T19:07:08.281714] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-17T19:07:08.281924] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-17T19:07:08.282853] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-17T19:07:08.283048] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-17T19:07:08.299887] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T19:07:08.305226] [DEBUG] [LOCAL ] GDOT: Trimmed 53599 records to 38316 (keeping 200 days of data) [2025-10-17T19:07:08.526900] [DEBUG] [LOCAL ] GDOT: Primary data saved (38316 records). [2025-10-17T19:07:08.527072] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-17T19:07:08.527204] [INFO ] [MAIN ] Update Progress: 909/2368 symbols completed. GDOT took 31.7s. Estimated remaining: 3h 23m 58s. Rate: 7.2 symbols/min [2025-10-17T19:07:08.700471] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:08.732539] [DEBUG] [LOCAL ] GEL: Loaded 31983 existing records from primary storage. [2025-10-17T19:07:08.732864] [INFO ] [MAIN ] GEL: Loaded 31983 existing records. [2025-10-17T19:07:08.763688] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-17T19:07:08.920423] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:08.920693] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-17T19:07:08.920768] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-17T19:07:08.920994] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-17T19:07:08.921050] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-17T19:07:09.274154] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:09.558035] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-17T19:07:09.847516] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T19:07:10.045444] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T19:07:10.358028] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-17T19:07:10.693715] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T19:07:11.158047] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-17T19:07:11.958069] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-17T19:07:12.535954] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-17T19:07:12.572742] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T19:07:12.758050] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-17T19:07:12.860570] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T19:07:13.558042] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-17T19:07:14.358075] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-17T19:07:14.891145] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T19:07:15.041635] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-17T19:07:15.065105] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T19:07:15.158006] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-17T19:07:15.958089] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-17T19:07:16.758059] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-17T19:07:17.526768] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T19:07:17.558049] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-17T19:07:17.632717] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:07:17.802254] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:07:17.806046] [INFO ] [REMOTE ] GDV: Full fetch complete (28412 records). [2025-10-17T19:07:17.806159] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-17T19:07:18.201959] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-17T19:07:18.202102] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-17T19:07:18.203173] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-17T19:07:18.203260] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-17T19:07:18.204890] [DEBUG] [LOCAL ] GDV: Trimmed 28412 records to 19698 (keeping 200 days of data) [2025-10-17T19:07:18.335625] [DEBUG] [LOCAL ] GDV: Primary data saved (19698 records). [2025-10-17T19:07:18.335869] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-17T19:07:18.335978] [INFO ] [MAIN ] Update Progress: 910/2368 symbols completed. GDV took 37.5s. Estimated remaining: 3h 23m 52s. Rate: 7.2 symbols/min [2025-10-17T19:07:18.366684] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-17T19:07:18.511949] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:18.571062] [DEBUG] [LOCAL ] GENI: Loaded 53328 existing records from primary storage. [2025-10-17T19:07:18.571498] [INFO ] [MAIN ] GENI: Loaded 53328 existing records. [2025-10-17T19:07:18.747568] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:18.747869] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-17T19:07:18.747919] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-17T19:07:18.748232] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-17T19:07:18.748305] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-17T19:07:19.115580] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:19.158044] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-17T19:07:19.489867] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T19:07:19.742692] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T19:07:19.958040] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-17T19:07:20.515663] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T19:07:20.758012] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-17T19:07:21.558007] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-17T19:07:21.941385] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:07:22.268067] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-17T19:07:22.357995] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-17T19:07:23.158014] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-17T19:07:23.232867] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:07:23.958103] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-17T19:07:24.167813] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T19:07:24.522605] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T19:07:24.758029] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-17T19:07:25.558014] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-17T19:07:25.601774] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T19:07:26.006311] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T19:07:26.358033] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-17T19:07:27.158046] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-17T19:07:27.471205] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:07:27.829248] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T19:07:27.958028] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-17T19:07:28.758016] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-17T19:07:28.970586] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:07:29.421969] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:07:29.558027] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-17T19:07:29.692138] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T19:07:30.358037] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-17T19:07:30.901626] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:07:31.158117] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-17T19:07:31.908209] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:07:31.958004] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-17T19:07:32.201807] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T19:07:32.758032] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-17T19:07:33.558014] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-17T19:07:33.762560] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T19:07:34.292142] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:07:34.358040] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-17T19:07:34.411610] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T19:07:34.419718] [INFO ] [REMOTE ] GE: Full fetch complete (77864 records). [2025-10-17T19:07:34.419952] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-17T19:07:34.827312] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-17T19:07:34.827454] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-17T19:07:34.828866] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-17T19:07:34.828937] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-17T19:07:34.831232] [DEBUG] [LOCAL ] GE: Trimmed 77864 records to 54478 (keeping 200 days of data) [2025-10-17T19:07:35.167696] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-17T19:07:35.202401] [DEBUG] [LOCAL ] GE: Primary data saved (54478 records). [2025-10-17T19:07:35.202690] [INFO ] [MAIN ] GE: Full history saved. [2025-10-17T19:07:35.203965] [INFO ] [MAIN ] Update Progress: 911/2368 symbols completed. GE took 37.2s. Estimated remaining: 3h 23m 57s. Rate: 7.1 symbols/min [2025-10-17T19:07:35.382837] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:35.453319] [DEBUG] [LOCAL ] GEO: Loaded 52187 existing records from primary storage. [2025-10-17T19:07:35.453799] [INFO ] [MAIN ] GEO: Loaded 52187 existing records. [2025-10-17T19:07:35.606616] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:07:35.678148] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:35.678559] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-17T19:07:35.678626] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-17T19:07:35.679069] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-17T19:07:35.679129] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-17T19:07:35.963272] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-17T19:07:36.074887] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:36.272748] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:07:36.758068] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-17T19:07:37.102455] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T19:07:37.558059] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-17T19:07:38.358071] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-17T19:07:38.674456] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T19:07:38.878157] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T19:07:39.158072] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-17T19:07:39.884598] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:07:39.888062] [INFO ] [REMOTE ] GEL: Full fetch complete (48143 records). [2025-10-17T19:07:39.888138] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-17T19:07:39.963204] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-17T19:07:40.258607] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-17T19:07:40.258712] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-17T19:07:40.259482] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-17T19:07:40.259527] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-17T19:07:40.260533] [DEBUG] [LOCAL ] GEL: Trimmed 48143 records to 32124 (keeping 200 days of data) [2025-10-17T19:07:40.445594] [DEBUG] [LOCAL ] GEL: Primary data saved (32124 records). [2025-10-17T19:07:40.445752] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-17T19:07:40.445839] [INFO ] [MAIN ] Update Progress: 912/2368 symbols completed. GEL took 31.9s. Estimated remaining: 3h 23m 44s. Rate: 7.1 symbols/min [2025-10-17T19:07:40.610553] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:40.646409] [DEBUG] [LOCAL ] GES: Loaded 38584 existing records from primary storage. [2025-10-17T19:07:40.646703] [INFO ] [MAIN ] GES: Loaded 38584 existing records. [2025-10-17T19:07:40.763170] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-17T19:07:40.822285] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:40.822600] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-17T19:07:40.822823] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-17T19:07:40.823566] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-17T19:07:40.823635] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-17T19:07:41.175144] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:41.203343] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T19:07:41.563098] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-17T19:07:41.580347] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T19:07:41.916502] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:07:41.919708] [INFO ] [REMOTE ] GEF: Full fetch complete (29393 records). [2025-10-17T19:07:41.919780] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-17T19:07:42.277926] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-17T19:07:42.278001] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-17T19:07:42.278561] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-17T19:07:42.278600] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-17T19:07:42.279269] [DEBUG] [LOCAL ] GEF: Trimmed 29393 records to 21098 (keeping 200 days of data) [2025-10-17T19:07:42.367901] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-17T19:07:42.409797] [DEBUG] [LOCAL ] GEF: Primary data saved (21098 records). [2025-10-17T19:07:42.409909] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-17T19:07:42.409998] [INFO ] [MAIN ] Update Progress: 913/2368 symbols completed. GEF took 44.1s. Estimated remaining: 3h 23m 25s. Rate: 7.2 symbols/min [2025-10-17T19:07:42.580410] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:42.617013] [DEBUG] [LOCAL ] GETY: Loaded 35351 existing records from primary storage. [2025-10-17T19:07:42.617321] [INFO ] [MAIN ] GETY: Loaded 35351 existing records. [2025-10-17T19:07:42.796670] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:42.796900] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-17T19:07:42.796948] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-17T19:07:42.797139] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-17T19:07:42.797195] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-17T19:07:43.145106] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:43.166914] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-17T19:07:43.171914] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:07:43.957999] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-17T19:07:44.241438] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T19:07:44.618766] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:07:44.758041] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-17T19:07:45.513881] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:07:45.557990] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-17T19:07:46.358107] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-17T19:07:46.624388] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T19:07:47.093272] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:07:47.158018] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-17T19:07:47.907720] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:07:47.958027] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-17T19:07:48.758023] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-17T19:07:48.824840] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:07:49.558026] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-17T19:07:49.778815] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:07:50.358014] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-17T19:07:50.689069] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T19:07:50.756070] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:07:51.158042] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-17T19:07:51.958035] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-17T19:07:52.494711] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T19:07:52.503609] [INFO ] [REMOTE ] GENI: Full fetch complete (76063 records). [2025-10-17T19:07:52.503854] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-17T19:07:52.764156] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-17T19:07:52.775803] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:07:53.021571] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-17T19:07:53.021732] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-17T19:07:53.023030] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-17T19:07:53.023112] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-17T19:07:53.025449] [DEBUG] [LOCAL ] GENI: Trimmed 76063 records to 53717 (keeping 200 days of data) [2025-10-17T19:07:53.362094] [DEBUG] [LOCAL ] GENI: Primary data saved (53717 records). [2025-10-17T19:07:53.362309] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-17T19:07:53.363137] [INFO ] [MAIN ] Update Progress: 914/2368 symbols completed. GENI took 35.0s. Estimated remaining: 3h 23m 21s. Rate: 7.2 symbols/min [2025-10-17T19:07:53.556306] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:53.558022] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-17T19:07:53.611439] [DEBUG] [LOCAL ] GEV: Loaded 53389 existing records from primary storage. [2025-10-17T19:07:53.611807] [INFO ] [MAIN ] GEV: Loaded 53389 existing records. [2025-10-17T19:07:53.791524] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:53.791937] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-17T19:07:53.792092] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-17T19:07:53.792381] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-17T19:07:53.792464] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-17T19:07:54.096310] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-17T19:07:54.205995] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:54.229070] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T19:07:54.358076] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-17T19:07:55.118714] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:07:55.158007] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-17T19:07:55.958077] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-17T19:07:56.569417] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T19:07:56.665415] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T19:07:56.758032] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-17T19:07:57.558048] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-17T19:07:57.824789] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T19:07:58.139273] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T19:07:58.358038] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-17T19:07:59.158039] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-17T19:07:59.821769] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:07:59.958023] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-17T19:08:00.093345] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-17T19:08:00.758021] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-17T19:08:01.558040] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-17T19:08:01.591311] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-17T19:08:01.762140] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:08:02.358056] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-17T19:08:03.124334] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:08:03.158046] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-17T19:08:03.375574] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T19:08:03.509741] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-17T19:08:03.958027] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-17T19:08:04.757995] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-17T19:08:05.140472] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T19:08:05.558030] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-17T19:08:06.147808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-17T19:08:06.177453] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:08:06.358039] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-17T19:08:07.158037] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-17T19:08:07.320244] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:08:07.837192] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:08:07.842279] [INFO ] [REMOTE ] GETY: Full fetch complete (55671 records). [2025-10-17T19:08:07.842366] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-17T19:08:07.963183] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-17T19:08:08.221390] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-17T19:08:08.221477] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-17T19:08:08.222344] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-17T19:08:08.222407] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-17T19:08:08.223448] [DEBUG] [LOCAL ] GETY: Trimmed 55671 records to 35677 (keeping 200 days of data) [2025-10-17T19:08:08.416479] [DEBUG] [LOCAL ] GETY: Primary data saved (35677 records). [2025-10-17T19:08:08.416611] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-17T19:08:08.417190] [INFO ] [MAIN ] Update Progress: 915/2368 symbols completed. GETY took 26.0s. Estimated remaining: 3h 23m 23s. Rate: 7.1 symbols/min [2025-10-17T19:08:08.582566] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:08.588430] [DEBUG] [LOCAL ] GF: Loaded 2700 existing records from primary storage. [2025-10-17T19:08:08.588620] [INFO ] [MAIN ] GF: Loaded 2700 existing records. [2025-10-17T19:08:08.779448] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-17T19:08:08.784127] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:08.784368] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-17T19:08:08.784464] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-17T19:08:08.785484] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-17T19:08:08.785546] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-17T19:08:09.138221] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:09.567754] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-17T19:08:09.587184] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T19:08:09.906260] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T19:08:10.196302] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T19:08:10.358075] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-17T19:08:10.395812] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T19:08:11.158076] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-17T19:08:11.737231] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T19:08:11.958012] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-17T19:08:12.211302] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:08:12.222263] [INFO ] [REMOTE ] GEO: Full fetch complete (75571 records). [2025-10-17T19:08:12.222586] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-17T19:08:12.611591] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-17T19:08:12.611792] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-17T19:08:12.616375] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-17T19:08:12.616526] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-17T19:08:12.617289] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T19:08:12.619967] [DEBUG] [LOCAL ] GEO: Trimmed 75571 records to 52550 (keeping 200 days of data) [2025-10-17T19:08:12.788760] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-17T19:08:12.929243] [DEBUG] [LOCAL ] GEO: Primary data saved (52550 records). [2025-10-17T19:08:12.929397] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-17T19:08:12.929480] [INFO ] [MAIN ] Update Progress: 916/2368 symbols completed. GEO took 37.7s. Estimated remaining: 3h 23m 8s. Rate: 7.1 symbols/min [2025-10-17T19:08:13.096491] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:13.124720] [DEBUG] [LOCAL ] GFF: Loaded 30148 existing records from primary storage. [2025-10-17T19:08:13.124973] [INFO ] [MAIN ] GFF: Loaded 30148 existing records. [2025-10-17T19:08:13.311517] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:13.311750] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-17T19:08:13.311808] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-17T19:08:13.312007] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-17T19:08:13.312088] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-17T19:08:13.563294] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-17T19:08:13.655783] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T19:08:13.678379] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:14.358089] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-17T19:08:15.149393] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:08:15.157939] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-17T19:08:15.775367] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T19:08:15.958028] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-17T19:08:16.560815] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T19:08:16.758042] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-17T19:08:17.189403] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T19:08:17.319300] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:08:17.558035] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-17T19:08:18.358042] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-17T19:08:18.869946] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:08:18.875091] [INFO ] [REMOTE ] GES: Full fetch complete (58646 records). [2025-10-17T19:08:18.875210] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-17T19:08:19.163251] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-17T19:08:19.283555] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-17T19:08:19.283719] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-17T19:08:19.285027] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-17T19:08:19.285095] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-17T19:08:19.286327] [DEBUG] [LOCAL ] GES: Trimmed 58646 records to 38876 (keeping 200 days of data) [2025-10-17T19:08:19.519212] [DEBUG] [LOCAL ] GES: Primary data saved (38876 records). [2025-10-17T19:08:19.519354] [INFO ] [MAIN ] GES: Full history saved. [2025-10-17T19:08:19.519436] [INFO ] [MAIN ] Update Progress: 917/2368 symbols completed. GES took 39.1s. Estimated remaining: 3h 22m 57s. Rate: 7.1 symbols/min [2025-10-17T19:08:19.958097] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-17T19:08:20.584554] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T19:08:20.597714] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:08:20.755369] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-17T19:08:20.759417] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-17T19:08:21.343338] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T19:08:21.558017] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-17T19:08:22.011507] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T19:08:22.358013] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-17T19:08:23.158065] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-17T19:08:23.758833] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T19:08:23.958046] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-17T19:08:24.063772] [DEBUG] [REMOTE ] GF: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T19:08:24.064094] [WARN ] [REMOTE ] GF: No data returned for month 2025-08 [2025-10-17T19:08:24.064183] [FATAL] [REMOTE ] GF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:08:24.064260] [FATAL] [MAIN ] GF: Failed to fetch primary data. [2025-10-17T19:08:24.064322] [WARN ] [MAIN ] GF: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:08:24.064394] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-17T19:08:24.064457] [DEBUG] [LOCAL ] GF: No primary data file found to delete. [2025-10-17T19:08:24.064493] [INFO ] [LOCAL ] GF: Starting deletion of derivative data. [2025-10-17T19:08:24.064671] [DEBUG] [LOCAL ] GF: Deleted derivative data file. [2025-10-17T19:08:24.064756] [INFO ] [MAIN ] Update Progress: 918/2368 symbols completed. GF took 15.6s. Estimated remaining: 3h 22m 43s. Rate: 7.2 symbols/min [2025-10-17T19:08:24.758009] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-17T19:08:25.305198] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-17T19:08:25.558026] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-17T19:08:26.260118] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:08:26.358041] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-17T19:08:27.792229] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:08:27.800265] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-17T19:08:27.929041] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T19:08:27.957992] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-17T19:08:28.952214] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:08:28.958319] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-17T19:08:30.188120] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T19:08:30.194687] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-17T19:08:30.295226] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T19:08:30.358038] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-17T19:08:31.570379] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:08:31.578519] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-17T19:08:32.710335] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T19:08:32.716224] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-17T19:08:32.842383] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T19:08:32.854313] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-17T19:08:33.978163] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T19:08:33.982875] [INFO ] [REMOTE ] GFF: Full fetch complete (43937 records). [2025-10-17T19:08:33.983033] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-17T19:08:34.377214] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-17T19:08:34.377354] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-17T19:08:34.378579] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-17T19:08:34.378672] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-17T19:08:34.380058] [DEBUG] [LOCAL ] GFF: Trimmed 43937 records to 30283 (keeping 200 days of data) [2025-10-17T19:08:34.584115] [DEBUG] [LOCAL ] GFF: Primary data saved (30283 records). [2025-10-17T19:08:34.584334] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-17T19:08:34.584499] [INFO ] [MAIN ] Update Progress: 919/2368 symbols completed. GFF took 21.7s. Estimated remaining: 3h 22m 38s. Rate: 7.2 symbols/min [2025-10-17T19:08:35.420329] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-17T19:08:35.427746] [INFO ] [REMOTE ] GEV: Full fetch complete (77035 records). [2025-10-17T19:08:35.427891] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-17T19:08:35.819792] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-17T19:08:35.819888] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-17T19:08:35.820946] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-17T19:08:35.821012] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-17T19:08:35.822515] [DEBUG] [LOCAL ] GEV: Trimmed 77035 records to 53772 (keeping 200 days of data) [2025-10-17T19:08:36.173223] [DEBUG] [LOCAL ] GEV: Primary data saved (53772 records). [2025-10-17T19:08:36.173369] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-17T19:08:36.173930] [INFO ] [MAIN ] Update Progress: 920/2368 symbols completed. GEV took 42.8s. Estimated remaining: 3h 22m 18s. Rate: 7.2 symbols/min [2025-10-17T19:08:36.811766] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.788917] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.906184] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.926070] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.932699] [DEBUG] [LOCAL ] GFR: Loaded 7789 existing records from primary storage. [2025-10-17T19:08:36.933533] [INFO ] [MAIN ] GFR: Loaded 7789 existing records. [2025-10-17T19:08:37.201228] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:37.204260] [DEBUG] [LOCAL ] GFL: Loaded 48000 existing records from primary storage. [2025-10-17T19:08:37.204764] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-17T19:08:37.205002] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-17T19:08:37.205528] [INFO ] [MAIN ] GFL: Loaded 48000 existing records. [2025-10-17T19:08:37.217018] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-17T19:08:37.261886] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-17T19:08:37.326493] [DEBUG] [LOCAL ] GGB: Loaded 51854 existing records from primary storage. [2025-10-17T19:08:37.364364] [INFO ] [MAIN ] GGB: Loaded 51854 existing records. [2025-10-17T19:08:37.457674] [DEBUG] [LOCAL ] GFI: Loaded 53505 existing records from primary storage. [2025-10-17T19:08:37.501340] [INFO ] [MAIN ] GFI: Loaded 53505 existing records. [2025-10-17T19:08:37.900360] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:37.926563] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-17T19:08:37.964121] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-17T19:08:37.962160] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:38.044427] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-17T19:08:38.050081] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-17T19:08:38.038960] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-17T19:08:38.086950] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-17T19:08:38.147936] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:38.233686] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-17T19:08:38.200145] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-17T19:08:38.254397] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-17T19:08:38.254293] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-17T19:08:38.333936] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-17T19:08:38.369582] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-17T19:08:38.735722] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:38.771420] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-17T19:08:39.380949] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:39.415089] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-17T19:08:39.512601] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:39.515385] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:39.515845] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-17T19:08:39.516069] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-17T19:08:39.852299] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T19:08:39.855549] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-17T19:08:40.597229] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T19:08:40.599715] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-17T19:08:40.996686] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:08:41.005686] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-17T19:08:41.094098] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:08:41.104173] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-17T19:08:41.251480] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:08:41.262328] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-17T19:08:41.487288] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T19:08:41.489589] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-17T19:08:42.335525] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T19:08:42.338628] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-17T19:08:42.578589] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:08:42.587978] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-17T19:08:42.669400] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T19:08:43.005971] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T19:08:43.045947] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T19:08:43.158056] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-17T19:08:43.885297] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:08:43.920087] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:08:43.957987] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-17T19:08:44.399318] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:08:44.758040] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-17T19:08:45.411587] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T19:08:45.558036] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-17T19:08:46.196467] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T19:08:46.358091] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-17T19:08:47.067734] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T19:08:47.158060] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-17T19:08:47.958083] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-17T19:08:48.758145] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-17T19:08:48.830716] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:08:49.557999] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-17T19:08:49.788589] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:08:50.358051] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-17T19:08:50.395947] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:08:50.982784] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:08:51.104891] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:08:51.106524] [INFO ] [REMOTE ] GFR: Full fetch complete (12093 records). [2025-10-17T19:08:51.106631] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-17T19:08:51.163219] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-17T19:08:51.467963] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-17T19:08:51.468049] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-17T19:08:51.468317] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-17T19:08:51.468358] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-17T19:08:51.468838] [DEBUG] [LOCAL ] GFR: Trimmed 12093 records to 7837 (keeping 200 days of data) [2025-10-17T19:08:51.515409] [DEBUG] [LOCAL ] GFR: Primary data saved (7837 records). [2025-10-17T19:08:51.515550] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-17T19:08:51.515702] [INFO ] [MAIN ] Update Progress: 921/2368 symbols completed. GFR took 15.3s. Estimated remaining: 3h 22m 21s. Rate: 7.2 symbols/min [2025-10-17T19:08:51.713528] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:51.752983] [DEBUG] [LOCAL ] GGG: Loaded 40973 existing records from primary storage. [2025-10-17T19:08:51.753271] [INFO ] [MAIN ] GGG: Loaded 40973 existing records. [2025-10-17T19:08:51.937075] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:51.937252] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-17T19:08:51.937335] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-17T19:08:51.937662] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-17T19:08:51.937738] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-17T19:08:51.969043] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-17T19:08:52.295615] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:52.757995] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-17T19:08:53.192973] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T19:08:53.298725] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T19:08:53.558040] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-17T19:08:54.056563] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:08:54.358069] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-17T19:08:54.709939] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T19:08:55.158124] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-17T19:08:55.958089] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-17T19:08:56.512038] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T19:08:56.758086] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-17T19:08:56.891675] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:08:57.404510] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T19:08:57.558028] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-17T19:08:58.358038] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-17T19:08:58.576232] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:08:59.118992] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:08:59.157985] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-17T19:08:59.958043] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-17T19:09:00.105695] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:09:00.674506] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:09:00.757996] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-17T19:09:01.558012] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-17T19:09:01.972538] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T19:09:02.358004] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-17T19:09:02.792196] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T19:09:03.158008] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-17T19:09:03.487776] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T19:09:03.958095] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-17T19:09:04.201803] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:09:04.365145] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:09:04.758035] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-17T19:09:05.559231] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-17T19:09:05.564291] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T19:09:06.358048] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-17T19:09:06.890436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T19:09:07.132538] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:09:07.157991] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-17T19:09:07.958108] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-17T19:09:08.017369] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:09:08.758005] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-17T19:09:09.423109] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-17T19:09:09.558115] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-17T19:09:09.612473] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T19:09:10.358047] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-17T19:09:10.568569] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:09:10.575162] [INFO ] [REMOTE ] GFL: Full fetch complete (69538 records). [2025-10-17T19:09:10.575287] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-17T19:09:10.955760] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-17T19:09:10.955843] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-17T19:09:10.956741] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-17T19:09:10.956808] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-17T19:09:10.958195] [DEBUG] [LOCAL ] GFL: Trimmed 69538 records to 48336 (keeping 200 days of data) [2025-10-17T19:09:11.180687] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-17T19:09:11.270055] [DEBUG] [LOCAL ] GFL: Primary data saved (48336 records). [2025-10-17T19:09:11.270188] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-17T19:09:11.270285] [INFO ] [MAIN ] Update Progress: 922/2368 symbols completed. GFL took 35.1s. Estimated remaining: 3h 22m 30s. Rate: 7.1 symbols/min [2025-10-17T19:09:11.468704] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:11.471358] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T19:09:11.494813] [DEBUG] [LOCAL ] GGT: Loaded 14507 existing records from primary storage. [2025-10-17T19:09:11.495043] [INFO ] [MAIN ] GGT: Loaded 14507 existing records. [2025-10-17T19:09:11.670305] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:11.670524] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-17T19:09:11.670583] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-17T19:09:11.670799] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-17T19:09:11.670866] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-17T19:09:11.958196] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-17T19:09:12.032514] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:12.057201] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:09:12.758049] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-17T19:09:13.446718] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T19:09:13.454740] [INFO ] [REMOTE ] GFI: Full fetch complete (76872 records). [2025-10-17T19:09:13.454908] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-17T19:09:13.559450] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-17T19:09:13.874848] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-17T19:09:13.875200] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-17T19:09:13.887198] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-17T19:09:13.900379] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-17T19:09:13.914228] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T19:09:13.925918] [DEBUG] [LOCAL ] GFI: Trimmed 76872 records to 53895 (keeping 200 days of data) [2025-10-17T19:09:14.039254] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T19:09:14.310558] [DEBUG] [LOCAL ] GFI: Primary data saved (53895 records). [2025-10-17T19:09:14.310813] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-17T19:09:14.311181] [INFO ] [MAIN ] Update Progress: 923/2368 symbols completed. GFI took 38.1s. Estimated remaining: 3h 22m 14s. Rate: 7.1 symbols/min [2025-10-17T19:09:14.365036] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-17T19:09:14.502378] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:14.513581] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:09:14.521383] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-10-17T19:09:14.521719] [INFO ] [MAIN ] GGZ: Loaded 2437 existing records. [2025-10-17T19:09:14.703723] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:14.703970] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-17T19:09:14.704020] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-17T19:09:14.704153] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-17T19:09:14.704192] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-17T19:09:15.050202] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:15.158023] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-17T19:09:15.723716] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T19:09:15.958038] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-17T19:09:16.468687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T19:09:16.476446] [INFO ] [REMOTE ] GGB: Full fetch complete (74334 records). [2025-10-17T19:09:16.476590] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-17T19:09:16.609174] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T19:09:16.763234] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-17T19:09:16.903133] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-17T19:09:16.903269] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-17T19:09:16.904928] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-17T19:09:16.905010] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-17T19:09:16.907301] [DEBUG] [LOCAL ] GGB: Trimmed 74334 records to 52241 (keeping 200 days of data) [2025-10-17T19:09:17.234239] [DEBUG] [LOCAL ] GGB: Primary data saved (52241 records). [2025-10-17T19:09:17.234448] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-17T19:09:17.234555] [INFO ] [MAIN ] Update Progress: 924/2368 symbols completed. GGB took 41.1s. Estimated remaining: 3h 21m 57s. Rate: 7.2 symbols/min [2025-10-17T19:09:17.321258] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T19:09:17.435463] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:17.444989] [DEBUG] [LOCAL ] GHC: Loaded 2948 existing records from primary storage. [2025-10-17T19:09:17.445338] [INFO ] [MAIN ] GHC: Loaded 2948 existing records. [2025-10-17T19:09:17.563202] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-17T19:09:17.666361] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:17.666703] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-17T19:09:17.666771] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-17T19:09:17.667029] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-17T19:09:17.667090] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-17T19:09:18.023429] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:18.339903] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:09:18.357991] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-17T19:09:19.103285] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T19:09:19.158002] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-17T19:09:19.817363] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T19:09:19.958003] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-17T19:09:20.411932] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T19:09:20.758015] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-17T19:09:21.363740] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:09:21.558002] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-17T19:09:22.358020] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-17T19:09:22.368191] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T19:09:22.895858] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T19:09:23.158039] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-17T19:09:23.536241] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-17T19:09:23.958054] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-17T19:09:24.758042] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-17T19:09:24.865227] [DEBUG] [REMOTE ] GGT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T19:09:24.865519] [WARN ] [REMOTE ] GGT: No data returned for month 2025-05 [2025-10-17T19:09:24.865610] [FATAL] [REMOTE ] GGT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:09:24.865736] [FATAL] [MAIN ] GGT: Failed to fetch primary data. [2025-10-17T19:09:24.865802] [WARN ] [MAIN ] GGT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:09:24.865887] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-17T19:09:24.865961] [DEBUG] [LOCAL ] GGT: No primary data file found to delete. [2025-10-17T19:09:24.865999] [INFO ] [LOCAL ] GGT: Starting deletion of derivative data. [2025-10-17T19:09:24.866123] [DEBUG] [LOCAL ] GGT: Deleted derivative data file. [2025-10-17T19:09:24.866206] [INFO ] [MAIN ] Update Progress: 925/2368 symbols completed. GGT took 13.6s. Estimated remaining: 3h 21m 47s. Rate: 7.2 symbols/min [2025-10-17T19:09:25.031260] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:25.036605] [DEBUG] [LOCAL ] GHG: Loaded 3303 existing records from primary storage. [2025-10-17T19:09:25.036785] [INFO ] [MAIN ] GHG: Loaded 3303 existing records. [2025-10-17T19:09:25.211467] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:25.211697] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-17T19:09:25.211754] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-17T19:09:25.211888] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-17T19:09:25.211925] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-17T19:09:25.558722] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-17T19:09:25.558584] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:25.586577] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T19:09:26.032198] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T19:09:26.358037] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-17T19:09:27.158024] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-17T19:09:27.649407] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T19:09:27.816899] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:09:27.958035] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-17T19:09:28.758015] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-17T19:09:29.220539] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T19:09:29.389414] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:09:29.558025] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-17T19:09:30.358023] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-17T19:09:30.800583] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:09:30.945223] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:09:30.950702] [INFO ] [REMOTE ] GGG: Full fetch complete (59469 records). [2025-10-17T19:09:30.950807] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-17T19:09:31.163193] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-17T19:09:31.335701] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-17T19:09:31.335781] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-17T19:09:31.336597] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-17T19:09:31.336638] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-17T19:09:31.338024] [DEBUG] [LOCAL ] GGG: Trimmed 59469 records to 41252 (keeping 200 days of data) [2025-10-17T19:09:31.581677] [DEBUG] [LOCAL ] GGG: Primary data saved (41252 records). [2025-10-17T19:09:31.581801] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-17T19:09:31.581879] [INFO ] [MAIN ] Update Progress: 926/2368 symbols completed. GGG took 40.1s. Estimated remaining: 3h 21m 36s. Rate: 7.2 symbols/min [2025-10-17T19:09:31.748252] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:31.758475] [DEBUG] [LOCAL ] GHI: Loaded 7465 existing records from primary storage. [2025-10-17T19:09:31.758674] [INFO ] [MAIN ] GHI: Loaded 7465 existing records. [2025-10-17T19:09:31.840208] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T19:09:31.940220] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:31.940543] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-17T19:09:31.940600] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-17T19:09:31.940797] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-17T19:09:31.940859] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-17T19:09:31.963275] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-17T19:09:32.288148] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:32.490812] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T19:09:32.758024] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-17T19:09:33.558021] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-17T19:09:33.746266] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T19:09:33.925503] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T19:09:34.358049] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-17T19:09:35.000448] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T19:09:35.001378] [INFO ] [REMOTE ] GGZ: Full fetch complete (3910 records). [2025-10-17T19:09:35.001447] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-17T19:09:35.170460] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-17T19:09:35.356093] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-17T19:09:35.356184] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-17T19:09:35.356333] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-17T19:09:35.356374] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-17T19:09:35.356735] [DEBUG] [LOCAL ] GGZ: Trimmed 3910 records to 2448 (keeping 200 days of data) [2025-10-17T19:09:35.371765] [DEBUG] [LOCAL ] GGZ: Primary data saved (2448 records). [2025-10-17T19:09:35.371827] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-17T19:09:35.371891] [INFO ] [MAIN ] Update Progress: 927/2368 symbols completed. GGZ took 21.1s. Estimated remaining: 3h 21m 21s. Rate: 7.2 symbols/min [2025-10-17T19:09:35.537823] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:35.544737] [DEBUG] [LOCAL ] GHLD: Loaded 4312 existing records from primary storage. [2025-10-17T19:09:35.544923] [INFO ] [MAIN ] GHLD: Loaded 4312 existing records. [2025-10-17T19:09:35.719088] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:35.719356] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-17T19:09:35.719416] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-17T19:09:35.719568] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-17T19:09:35.719624] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-17T19:09:35.963269] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-17T19:09:36.068736] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:09:36.087769] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:36.443419] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:09:36.758030] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-17T19:09:37.217371] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T19:09:37.558024] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-17T19:09:38.140015] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T19:09:38.358031] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-17T19:09:38.806876] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T19:09:39.158094] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-17T19:09:39.619175] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-17T19:09:39.958027] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-17T19:09:40.386401] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T19:09:40.758009] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-17T19:09:41.118110] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-17T19:09:41.558038] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-17T19:09:42.210748] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T19:09:42.358019] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-17T19:09:43.138602] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T19:09:43.157993] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-17T19:09:43.882907] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T19:09:43.958081] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-17T19:09:44.569423] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:09:44.758056] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-17T19:09:45.376436] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-17T19:09:45.558030] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-17T19:09:46.211050] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T19:09:46.358057] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-17T19:09:46.900453] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T19:09:47.158037] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-17T19:09:47.797959] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:09:47.958045] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-17T19:09:48.416048] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-17T19:09:48.758076] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-17T19:09:49.303631] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T19:09:49.558032] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-17T19:09:50.025006] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T19:09:50.358056] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-17T19:09:50.988887] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T19:09:51.158094] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-17T19:09:51.658369] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-17T19:09:51.957992] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-17T19:09:52.581729] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:09:52.758060] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-17T19:09:53.336510] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T19:09:53.558044] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-17T19:09:54.030023] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T19:09:54.358052] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-17T19:09:55.025395] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T19:09:55.026480] [INFO ] [REMOTE ] GHG: Full fetch complete (4168 records). [2025-10-17T19:09:55.026549] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-17T19:09:55.163133] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-17T19:09:55.380493] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-17T19:09:55.380570] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-17T19:09:55.380721] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-17T19:09:55.380782] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-17T19:09:55.381199] [DEBUG] [LOCAL ] GHG: Trimmed 4168 records to 3317 (keeping 200 days of data) [2025-10-17T19:09:55.402697] [DEBUG] [LOCAL ] GHG: Primary data saved (3317 records). [2025-10-17T19:09:55.402843] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-17T19:09:55.402953] [INFO ] [MAIN ] Update Progress: 928/2368 symbols completed. GHG took 30.5s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-17T19:09:55.567230] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:55.581931] [DEBUG] [LOCAL ] GHM: Loaded 14491 existing records from primary storage. [2025-10-17T19:09:55.582129] [INFO ] [MAIN ] GHM: Loaded 14491 existing records. [2025-10-17T19:09:55.768820] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T19:09:55.768664] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:55.770417] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-17T19:09:55.770468] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-17T19:09:55.770613] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-17T19:09:55.770687] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-17T19:09:55.967347] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-17T19:09:56.123546] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:56.537668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T19:09:56.758070] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-17T19:09:57.558013] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-17T19:09:57.704099] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:09:58.085668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T19:09:58.358004] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-17T19:09:58.801801] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T19:09:59.158048] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-17T19:09:59.751451] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T19:09:59.958032] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-17T19:10:00.758009] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-17T19:10:00.823270] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T19:10:01.558068] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-17T19:10:02.358118] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-17T19:10:02.740863] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T19:10:02.866119] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:10:02.867205] [INFO ] [REMOTE ] GHC: Full fetch complete (3644 records). [2025-10-17T19:10:02.867293] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-17T19:10:03.150613] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T19:10:03.163383] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-17T19:10:03.234268] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-17T19:10:03.234343] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-17T19:10:03.234460] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-17T19:10:03.234499] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-17T19:10:03.234913] [DEBUG] [LOCAL ] GHC: Trimmed 3644 records to 2977 (keeping 200 days of data) [2025-10-17T19:10:03.253852] [DEBUG] [LOCAL ] GHC: Primary data saved (2977 records). [2025-10-17T19:10:03.253934] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-17T19:10:03.254011] [INFO ] [MAIN ] Update Progress: 929/2368 symbols completed. GHC took 46.0s. Estimated remaining: 3h 21m 21s. Rate: 7.1 symbols/min [2025-10-17T19:10:03.419235] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:03.440837] [DEBUG] [LOCAL ] GHY: Loaded 21076 existing records from primary storage. [2025-10-17T19:10:03.441090] [INFO ] [MAIN ] GHY: Loaded 21076 existing records. [2025-10-17T19:10:03.613482] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:03.613710] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-17T19:10:03.613769] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-17T19:10:03.614022] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-17T19:10:03.614253] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-17T19:10:03.962745] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-17T19:10:03.962664] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:04.135988] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:10:04.534701] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T19:10:04.758096] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-17T19:10:05.558039] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-17T19:10:05.651065] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T19:10:06.357999] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-17T19:10:06.686640] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:10:07.158002] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-17T19:10:07.370613] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T19:10:07.950021] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T19:10:07.957978] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-17T19:10:08.758028] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-17T19:10:09.221919] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:10:09.558048] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-17T19:10:09.747208] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:10:10.358052] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-17T19:10:10.525848] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T19:10:10.527989] [INFO ] [REMOTE ] GHI: Full fetch complete (11273 records). [2025-10-17T19:10:10.528096] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-17T19:10:10.901142] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-17T19:10:10.901218] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-17T19:10:10.901469] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-17T19:10:10.901508] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-17T19:10:10.901959] [DEBUG] [LOCAL ] GHI: Trimmed 11273 records to 7591 (keeping 200 days of data) [2025-10-17T19:10:10.948513] [DEBUG] [LOCAL ] GHI: Primary data saved (7591 records). [2025-10-17T19:10:10.948673] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-17T19:10:10.948782] [INFO ] [MAIN ] Update Progress: 930/2368 symbols completed. GHI took 39.4s. Estimated remaining: 3h 21m 12s. Rate: 7.1 symbols/min [2025-10-17T19:10:11.158776] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-17T19:10:11.161850] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:11.195842] [DEBUG] [LOCAL ] GIB: Loaded 31938 existing records from primary storage. [2025-10-17T19:10:11.196263] [INFO ] [MAIN ] GIB: Loaded 31938 existing records. [2025-10-17T19:10:11.314679] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T19:10:11.401452] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:11.401744] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-17T19:10:11.401811] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-17T19:10:11.402044] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-17T19:10:11.402099] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-17T19:10:11.778281] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:11.910022] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:10:11.911284] [INFO ] [REMOTE ] GHLD: Full fetch complete (5100 records). [2025-10-17T19:10:11.911354] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-17T19:10:11.963433] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-17T19:10:12.271201] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-17T19:10:12.271275] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-17T19:10:12.271417] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-17T19:10:12.271475] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-17T19:10:12.271876] [DEBUG] [LOCAL ] GHLD: Trimmed 5100 records to 4348 (keeping 200 days of data) [2025-10-17T19:10:12.297304] [DEBUG] [LOCAL ] GHLD: Primary data saved (4348 records). [2025-10-17T19:10:12.297400] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-17T19:10:12.297485] [INFO ] [MAIN ] Update Progress: 931/2368 symbols completed. GHLD took 36.9s. Estimated remaining: 3h 20m 52s. Rate: 7.2 symbols/min [2025-10-17T19:10:12.464872] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:12.480022] [DEBUG] [LOCAL ] GIC: Loaded 13495 existing records from primary storage. [2025-10-17T19:10:12.480299] [INFO ] [MAIN ] GIC: Loaded 13495 existing records. [2025-10-17T19:10:12.664858] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:12.665051] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-17T19:10:12.665099] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-17T19:10:12.665250] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-17T19:10:12.665288] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-17T19:10:12.763163] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-17T19:10:12.973428] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T19:10:13.034153] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:13.558032] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-17T19:10:13.925463] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T19:10:14.358071] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-17T19:10:14.483369] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:10:15.158005] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-17T19:10:15.552398] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T19:10:15.958000] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-17T19:10:16.109032] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T19:10:16.758069] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-17T19:10:16.776267] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T19:10:17.558033] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-17T19:10:17.941232] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T19:10:18.358033] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-17T19:10:18.637202] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:10:19.158052] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-17T19:10:19.336486] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T19:10:19.958010] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-17T19:10:20.136501] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T19:10:20.758016] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-17T19:10:20.939136] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T19:10:21.558020] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-17T19:10:22.058182] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T19:10:22.358075] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-17T19:10:22.431590] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T19:10:23.158051] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-17T19:10:23.765365] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:10:23.958034] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-17T19:10:24.528352] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T19:10:24.758014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-17T19:10:24.901534] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T19:10:25.396867] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T19:10:25.558032] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-17T19:10:26.358060] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-17T19:10:26.499200] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:10:27.158057] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-17T19:10:27.808477] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T19:10:27.907847] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T19:10:27.958064] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-17T19:10:28.758106] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-17T19:10:28.926004] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T19:10:29.558685] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-17T19:10:29.866852] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:10:29.869763] [INFO ] [REMOTE ] GHM: Full fetch complete (22080 records). [2025-10-17T19:10:29.869838] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-17T19:10:30.242549] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-17T19:10:30.242626] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-17T19:10:30.243101] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-17T19:10:30.243152] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-17T19:10:30.243762] [DEBUG] [LOCAL ] GHM: Trimmed 22080 records to 14580 (keeping 200 days of data) [2025-10-17T19:10:30.326877] [DEBUG] [LOCAL ] GHM: Primary data saved (14580 records). [2025-10-17T19:10:30.327009] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-17T19:10:30.327090] [INFO ] [MAIN ] Update Progress: 932/2368 symbols completed. GHM took 34.9s. Estimated remaining: 3h 20m 59s. Rate: 7.1 symbols/min [2025-10-17T19:10:30.364380] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-17T19:10:30.501448] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:30.542370] [DEBUG] [LOCAL ] GIL: Loaded 44162 existing records from primary storage. [2025-10-17T19:10:30.542697] [INFO ] [MAIN ] GIL: Loaded 44162 existing records. [2025-10-17T19:10:30.657935] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T19:10:30.738029] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:30.738257] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-17T19:10:30.738305] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-17T19:10:30.738673] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-17T19:10:30.738731] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-17T19:10:31.080023] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:31.157990] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-17T19:10:31.964560] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-17T19:10:31.980213] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:10:32.568204] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:10:32.758005] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-17T19:10:33.117427] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:10:33.121174] [INFO ] [REMOTE ] GHY: Full fetch complete (32570 records). [2025-10-17T19:10:33.121253] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-17T19:10:33.498192] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-17T19:10:33.498528] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-17T19:10:33.499305] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-17T19:10:33.499370] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-17T19:10:33.500175] [DEBUG] [LOCAL ] GHY: Trimmed 32570 records to 21330 (keeping 200 days of data) [2025-10-17T19:10:33.562411] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-17T19:10:33.638936] [DEBUG] [LOCAL ] GHY: Primary data saved (21330 records). [2025-10-17T19:10:33.639107] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-17T19:10:33.639217] [INFO ] [MAIN ] Update Progress: 933/2368 symbols completed. GHY took 30.4s. Estimated remaining: 3h 20m 42s. Rate: 7.1 symbols/min [2025-10-17T19:10:33.814606] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:33.868308] [DEBUG] [LOCAL ] GIS: Loaded 54063 existing records from primary storage. [2025-10-17T19:10:33.868665] [INFO ] [MAIN ] GIS: Loaded 54063 existing records. [2025-10-17T19:10:34.048098] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:34.048640] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-17T19:10:34.048937] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-17T19:10:34.049543] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-17T19:10:34.068107] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-17T19:10:34.119426] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:10:34.365313] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-17T19:10:34.462924] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:34.470753] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T19:10:35.158015] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-17T19:10:35.651756] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:10:35.716818] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:10:35.958059] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-17T19:10:36.758044] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-17T19:10:37.180869] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:10:37.558039] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-17T19:10:38.146920] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:10:38.358032] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-17T19:10:38.399439] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T19:10:39.158043] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-17T19:10:39.880405] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:10:39.957984] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-17T19:10:40.608101] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:10:40.758027] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-17T19:10:41.558034] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-17T19:10:41.602371] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:10:41.692890] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T19:10:42.358015] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-17T19:10:42.665305] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T19:10:43.158026] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-17T19:10:43.958065] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-17T19:10:44.258434] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T19:10:44.345502] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:10:44.758059] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-17T19:10:45.464453] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:10:45.558010] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-17T19:10:45.691390] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:10:46.358050] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-17T19:10:46.887092] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:10:47.158064] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-17T19:10:47.318886] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T19:10:47.321856] [INFO ] [REMOTE ] GIC: Full fetch complete (19918 records). [2025-10-17T19:10:47.321973] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-17T19:10:47.682810] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-17T19:10:47.682910] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-17T19:10:47.683394] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-17T19:10:47.683435] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-17T19:10:47.684100] [DEBUG] [LOCAL ] GIC: Trimmed 19918 records to 13587 (keeping 200 days of data) [2025-10-17T19:10:47.766051] [DEBUG] [LOCAL ] GIC: Primary data saved (13587 records). [2025-10-17T19:10:47.766195] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-17T19:10:47.766278] [INFO ] [MAIN ] Update Progress: 934/2368 symbols completed. GIC took 35.5s. Estimated remaining: 3h 20m 43s. Rate: 7.1 symbols/min [2025-10-17T19:10:47.930924] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:47.967356] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-17T19:10:47.970456] [DEBUG] [LOCAL ] GKOS: Loaded 42824 existing records from primary storage. [2025-10-17T19:10:47.970879] [INFO ] [MAIN ] GKOS: Loaded 42824 existing records. [2025-10-17T19:10:48.146085] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:48.146291] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-17T19:10:48.146337] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-17T19:10:48.146540] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-17T19:10:48.146596] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-17T19:10:48.503007] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:48.606388] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:10:48.758075] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-17T19:10:49.440941] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T19:10:49.446520] [INFO ] [REMOTE ] GIB: Full fetch complete (46221 records). [2025-10-17T19:10:49.446662] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-17T19:10:49.563140] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-17T19:10:49.834861] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-17T19:10:49.834947] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-17T19:10:49.835773] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-17T19:10:49.835838] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-17T19:10:49.836872] [DEBUG] [LOCAL ] GIB: Trimmed 46221 records to 32143 (keeping 200 days of data) [2025-10-17T19:10:50.032922] [DEBUG] [LOCAL ] GIB: Primary data saved (32143 records). [2025-10-17T19:10:50.033072] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-17T19:10:50.034162] [INFO ] [MAIN ] Update Progress: 935/2368 symbols completed. GIB took 39.1s. Estimated remaining: 3h 20m 25s. Rate: 7.2 symbols/min [2025-10-17T19:10:50.211944] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:50.257709] [DEBUG] [LOCAL ] GL: Loaded 37863 existing records from primary storage. [2025-10-17T19:10:50.258021] [INFO ] [MAIN ] GL: Loaded 37863 existing records. [2025-10-17T19:10:50.359829] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-17T19:10:50.442251] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:50.442596] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-17T19:10:50.442740] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-17T19:10:50.442977] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-17T19:10:50.443128] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-17T19:10:50.622477] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:10:50.873598] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:50.895580] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T19:10:51.158057] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-17T19:10:51.958030] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-17T19:10:52.225035] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:10:52.758020] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-17T19:10:52.783338] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T19:10:53.402307] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:10:53.558038] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-17T19:10:54.358034] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-17T19:10:54.604812] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T19:10:55.020720] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T19:10:55.157994] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-17T19:10:55.712611] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:10:55.958104] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-17T19:10:56.758057] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-17T19:10:57.152369] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T19:10:57.547526] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:10:57.553924] [INFO ] [REMOTE ] GIL: Full fetch complete (62402 records). [2025-10-17T19:10:57.554067] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-17T19:10:57.567291] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-17T19:10:57.948862] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-17T19:10:57.948962] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-17T19:10:57.949845] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-17T19:10:57.949929] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-17T19:10:57.951231] [DEBUG] [LOCAL ] GIL: Trimmed 62402 records to 44482 (keeping 200 days of data) [2025-10-17T19:10:58.221057] [DEBUG] [LOCAL ] GIL: Primary data saved (44482 records). [2025-10-17T19:10:58.221185] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-17T19:10:58.221868] [INFO ] [MAIN ] Update Progress: 936/2368 symbols completed. GIL took 27.9s. Estimated remaining: 3h 20m 16s. Rate: 7.2 symbols/min [2025-10-17T19:10:58.369241] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-17T19:10:58.391592] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:58.423946] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:10:58.477558] [DEBUG] [LOCAL ] GLOB: Loaded 48330 existing records from primary storage. [2025-10-17T19:10:58.477931] [INFO ] [MAIN ] GLOB: Loaded 48330 existing records. [2025-10-17T19:10:58.656918] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:58.657121] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-17T19:10:58.657168] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-17T19:10:58.657362] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-17T19:10:58.657419] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-17T19:10:59.012512] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:59.095145] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T19:10:59.157987] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-17T19:10:59.958007] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-17T19:11:00.433355] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T19:11:00.589906] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:11:00.758053] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-17T19:11:01.558003] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-17T19:11:01.657427] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:11:02.358019] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-17T19:11:02.852314] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T19:11:03.006495] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-17T19:11:03.158023] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-17T19:11:03.902478] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:11:03.957990] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-17T19:11:04.666068] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:11:04.758000] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-17T19:11:05.369621] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:11:05.558042] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-17T19:11:06.358007] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-17T19:11:06.720178] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T19:11:07.157996] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-17T19:11:07.239321] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:11:07.885816] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:11:07.958065] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-17T19:11:08.725787] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T19:11:08.757994] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-17T19:11:09.558031] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-17T19:11:09.776442] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:11:09.869198] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:11:10.358086] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-17T19:11:11.158020] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-17T19:11:11.252461] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:11:11.834437] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:11:11.958076] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-17T19:11:12.618375] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:11:12.758043] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-17T19:11:13.170444] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T19:11:13.558026] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-17T19:11:14.357998] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-17T19:11:14.422358] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T19:11:14.452018] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T19:11:14.459572] [INFO ] [REMOTE ] GIS: Full fetch complete (77838 records). [2025-10-17T19:11:14.459787] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-17T19:11:14.854051] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-17T19:11:14.854149] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-17T19:11:14.855145] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-17T19:11:14.855210] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-17T19:11:14.856723] [DEBUG] [LOCAL ] GIS: Trimmed 77838 records to 54452 (keeping 200 days of data) [2025-10-17T19:11:15.168121] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-17T19:11:15.198095] [DEBUG] [LOCAL ] GIS: Primary data saved (54452 records). [2025-10-17T19:11:15.198202] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-17T19:11:15.198989] [INFO ] [MAIN ] Update Progress: 937/2368 symbols completed. GIS took 41.6s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-17T19:11:15.368895] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:15.381515] [DEBUG] [LOCAL ] GLP: Loaded 9346 existing records from primary storage. [2025-10-17T19:11:15.381785] [INFO ] [MAIN ] GLP: Loaded 9346 existing records. [2025-10-17T19:11:15.558568] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:15.558866] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-17T19:11:15.558934] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-17T19:11:15.559114] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-17T19:11:15.559181] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-17T19:11:15.922537] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:15.958007] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-17T19:11:16.204444] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T19:11:16.558181] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T19:11:16.758004] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-17T19:11:16.782848] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T19:11:17.558039] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-17T19:11:18.238951] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T19:11:18.358033] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-17T19:11:19.158046] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-17T19:11:19.279726] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:11:19.958078] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-17T19:11:19.996576] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:11:20.688684] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:11:20.694070] [INFO ] [REMOTE ] GL: Full fetch complete (55071 records). [2025-10-17T19:11:20.694172] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-17T19:11:20.763154] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-17T19:11:20.811770] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T19:11:21.083076] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-17T19:11:21.083156] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-17T19:11:21.083997] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-17T19:11:21.084062] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-17T19:11:21.085162] [DEBUG] [LOCAL ] GL: Trimmed 55071 records to 38100 (keeping 200 days of data) [2025-10-17T19:11:21.325017] [DEBUG] [LOCAL ] GL: Primary data saved (38100 records). [2025-10-17T19:11:21.325160] [INFO ] [MAIN ] GL: Full history saved. [2025-10-17T19:11:21.326043] [INFO ] [MAIN ] Update Progress: 938/2368 symbols completed. GL took 31.3s. Estimated remaining: 3h 20m 9s. Rate: 7.1 symbols/min [2025-10-17T19:11:21.491886] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:21.543218] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-17T19:11:21.543543] [INFO ] [MAIN ] GLW: Loaded 54026 existing records. [2025-10-17T19:11:21.563728] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-17T19:11:21.723845] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:21.724063] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-17T19:11:21.724111] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-17T19:11:21.724324] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-17T19:11:21.724381] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-17T19:11:22.066986] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:22.358110] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-17T19:11:22.563005] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T19:11:23.161829] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-17T19:11:23.162992] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T19:11:23.196329] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:11:23.958042] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-17T19:11:24.758038] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-17T19:11:25.054301] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T19:11:25.219167] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T19:11:25.225917] [INFO ] [REMOTE ] GKOS: Full fetch complete (60358 records). [2025-10-17T19:11:25.226107] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-17T19:11:25.574272] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-17T19:11:25.630118] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-17T19:11:25.630200] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-17T19:11:25.631089] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-17T19:11:25.631155] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-17T19:11:25.632384] [DEBUG] [LOCAL ] GKOS: Trimmed 60358 records to 43111 (keeping 200 days of data) [2025-10-17T19:11:25.894794] [DEBUG] [LOCAL ] GKOS: Primary data saved (43111 records). [2025-10-17T19:11:25.894992] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-17T19:11:25.895118] [INFO ] [MAIN ] Update Progress: 939/2368 symbols completed. GKOS took 38.1s. Estimated remaining: 3h 19m 55s. Rate: 7.1 symbols/min [2025-10-17T19:11:26.078094] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:26.132015] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-17T19:11:26.132366] [INFO ] [MAIN ] GM: Loaded 54119 existing records. [2025-10-17T19:11:26.308565] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:26.308994] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-17T19:11:26.309101] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-17T19:11:26.309382] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-17T19:11:26.309440] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-17T19:11:26.371275] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-17T19:11:26.618597] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T19:11:26.707805] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:27.148994] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:11:27.160578] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-17T19:11:27.331976] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T19:11:27.958044] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-17T19:11:28.758011] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-17T19:11:28.910373] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:11:29.558020] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-17T19:11:29.819299] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T19:11:30.358004] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-17T19:11:30.512967] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:11:31.158022] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-17T19:11:31.261372] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:11:31.958021] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-17T19:11:32.152938] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:11:32.758025] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-17T19:11:33.138849] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T19:11:33.265559] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T19:11:33.284578] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-17T19:11:33.558041] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-17T19:11:34.358025] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-17T19:11:35.109462] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T19:11:35.116092] [INFO ] [REMOTE ] GLOB: Full fetch complete (65823 records). [2025-10-17T19:11:35.116198] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-17T19:11:35.169826] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-17T19:11:35.494519] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-17T19:11:35.494595] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-17T19:11:35.495445] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-17T19:11:35.495507] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-17T19:11:35.496795] [DEBUG] [LOCAL ] GLOB: Trimmed 65823 records to 48655 (keeping 200 days of data) [2025-10-17T19:11:35.784559] [DEBUG] [LOCAL ] GLOB: Primary data saved (48655 records). [2025-10-17T19:11:35.784729] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-17T19:11:35.785238] [INFO ] [MAIN ] Update Progress: 940/2368 symbols completed. GLOB took 37.6s. Estimated remaining: 3h 19m 49s. Rate: 7.1 symbols/min [2025-10-17T19:11:35.953829] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:35.958037] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-17T19:11:36.005400] [DEBUG] [LOCAL ] GME: Loaded 54171 existing records from primary storage. [2025-10-17T19:11:36.005757] [INFO ] [MAIN ] GME: Loaded 54171 existing records. [2025-10-17T19:11:36.119629] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T19:11:36.195748] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:36.195940] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-17T19:11:36.195987] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-17T19:11:36.196267] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-17T19:11:36.196324] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-17T19:11:36.561994] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:36.580639] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-17T19:11:36.757995] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-17T19:11:37.558013] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-17T19:11:38.002433] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T19:11:38.358046] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-17T19:11:38.954308] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T19:11:38.971394] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T19:11:39.158031] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-17T19:11:39.958027] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-17T19:11:40.335002] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-17T19:11:40.758048] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-17T19:11:41.558004] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-17T19:11:41.604226] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-17T19:11:41.882027] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:11:42.279899] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T19:11:42.358052] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-17T19:11:42.886087] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T19:11:43.158063] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-17T19:11:43.415900] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-17T19:11:43.958049] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-17T19:11:44.758013] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-17T19:11:44.888613] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:11:45.562357] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-17T19:11:45.565516] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:11:45.930665] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:11:46.358104] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-17T19:11:47.158090] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-17T19:11:47.895637] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T19:11:47.897485] [INFO ] [REMOTE ] GLP: Full fetch complete (14288 records). [2025-10-17T19:11:47.897557] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-17T19:11:47.961582] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-17T19:11:48.311796] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-17T19:11:48.312143] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-17T19:11:48.314274] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-17T19:11:48.314693] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-17T19:11:48.314891] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-17T19:11:48.325518] [DEBUG] [LOCAL ] GLP: Trimmed 14288 records to 9431 (keeping 200 days of data) [2025-10-17T19:11:48.409897] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T19:11:48.425362] [DEBUG] [LOCAL ] GLP: Primary data saved (9431 records). [2025-10-17T19:11:48.425476] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-17T19:11:48.425555] [INFO ] [MAIN ] Update Progress: 941/2368 symbols completed. GLP took 33.2s. Estimated remaining: 3h 19m 47s. Rate: 7.1 symbols/min [2025-10-17T19:11:48.589121] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:48.639041] [DEBUG] [LOCAL ] GMED: Loaded 48602 existing records from primary storage. [2025-10-17T19:11:48.639399] [INFO ] [MAIN ] GMED: Loaded 48602 existing records. [2025-10-17T19:11:48.763195] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-17T19:11:48.817569] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:48.817818] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-17T19:11:48.817883] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-17T19:11:48.818113] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-17T19:11:48.818185] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-17T19:11:49.164139] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:49.557993] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-17T19:11:49.977363] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T19:11:50.358031] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-17T19:11:50.765668] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T19:11:51.158094] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-17T19:11:51.947501] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-17T19:11:51.958211] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-17T19:11:52.587723] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T19:11:52.757983] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-17T19:11:53.331336] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T19:11:53.558048] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-17T19:11:53.695039] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:11:54.358062] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-17T19:11:54.744964] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T19:11:54.774897] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T19:11:54.782393] [INFO ] [REMOTE ] GLW: Full fetch complete (77793 records). [2025-10-17T19:11:54.782529] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-17T19:11:55.167941] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-17T19:11:55.172912] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-17T19:11:55.172971] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-17T19:11:55.173946] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-17T19:11:55.174093] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-17T19:11:55.175557] [DEBUG] [LOCAL ] GLW: Trimmed 77793 records to 54416 (keeping 200 days of data) [2025-10-17T19:11:55.518148] [DEBUG] [LOCAL ] GLW: Primary data saved (54416 records). [2025-10-17T19:11:55.518292] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-17T19:11:55.518375] [INFO ] [MAIN ] Update Progress: 942/2368 symbols completed. GLW took 34.2s. Estimated remaining: 3h 19m 37s. Rate: 7.1 symbols/min [2025-10-17T19:11:55.684675] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:55.720229] [DEBUG] [LOCAL ] GMRE: Loaded 37278 existing records from primary storage. [2025-10-17T19:11:55.720516] [INFO ] [MAIN ] GMRE: Loaded 37278 existing records. [2025-10-17T19:11:55.897155] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:55.897400] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-17T19:11:55.897465] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-17T19:11:55.897741] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-17T19:11:55.897817] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-17T19:11:55.964499] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-17T19:11:56.271519] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:56.307201] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-17T19:11:56.443789] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T19:11:56.758024] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-17T19:11:57.558057] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-17T19:11:57.978630] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T19:11:58.164013] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:11:58.358022] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-17T19:11:59.156860] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:11:59.165493] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-17T19:11:59.717732] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:11:59.958015] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-17T19:12:00.039972] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:12:00.048779] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-17T19:12:00.049042] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-17T19:12:00.455418] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-17T19:12:00.455518] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-17T19:12:00.456560] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-17T19:12:00.456629] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-17T19:12:00.458222] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54509 (keeping 200 days of data) [2025-10-17T19:12:00.772856] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-17T19:12:00.802071] [DEBUG] [LOCAL ] GM: Primary data saved (54509 records). [2025-10-17T19:12:00.802223] [INFO ] [MAIN ] GM: Full history saved. [2025-10-17T19:12:00.802312] [INFO ] [MAIN ] Update Progress: 943/2368 symbols completed. GM took 34.9s. Estimated remaining: 3h 19m 23s. Rate: 7.1 symbols/min [2025-10-17T19:12:00.970639] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:00.988756] [DEBUG] [LOCAL ] GNE: Loaded 18130 existing records from primary storage. [2025-10-17T19:12:00.989013] [INFO ] [MAIN ] GNE: Loaded 18130 existing records. [2025-10-17T19:12:01.165433] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:01.165687] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-17T19:12:01.165756] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-17T19:12:01.165972] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-17T19:12:01.166052] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-17T19:12:01.522320] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:01.557998] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-17T19:12:01.887051] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T19:12:02.358070] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-17T19:12:03.158062] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-17T19:12:03.245147] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T19:12:03.726333] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-17T19:12:03.963111] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-17T19:12:03.981418] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:12:04.011157] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:12:04.758042] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-17T19:12:05.545246] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T19:12:05.557982] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-17T19:12:06.340962] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T19:12:06.357982] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-17T19:12:06.467203] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-17T19:12:07.158006] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-17T19:12:07.213506] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T19:12:07.958025] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-17T19:12:08.758018] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-17T19:12:08.787897] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T19:12:08.928244] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T19:12:09.558047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-17T19:12:10.093777] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T19:12:10.358043] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-17T19:12:11.157185] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T19:12:11.165901] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-17T19:12:11.958069] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-17T19:12:12.661212] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:12:12.758026] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-17T19:12:12.943948] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-17T19:12:13.321113] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T19:12:13.558010] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-17T19:12:14.184557] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:12:14.358038] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-17T19:12:15.087562] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:12:15.144100] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T19:12:15.157996] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-17T19:12:15.958028] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-17T19:12:16.367871] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:12:16.758061] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-17T19:12:17.557998] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-17T19:12:17.946445] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T19:12:18.358058] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-17T19:12:18.435045] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T19:12:18.977219] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:12:19.158026] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-17T19:12:19.958044] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-17T19:12:20.604212] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:12:20.757984] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-17T19:12:20.799186] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-17T19:12:21.558005] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-17T19:12:21.766831] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:12:21.773904] [INFO ] [REMOTE ] GMED: Full fetch complete (69977 records). [2025-10-17T19:12:21.774076] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-17T19:12:22.167743] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-17T19:12:22.167878] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-17T19:12:22.168948] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-17T19:12:22.169122] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-17T19:12:22.170838] [DEBUG] [LOCAL ] GMED: Trimmed 69977 records to 48880 (keeping 200 days of data) [2025-10-17T19:12:22.320370] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:12:22.366015] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-17T19:12:22.497211] [DEBUG] [LOCAL ] GMED: Primary data saved (48880 records). [2025-10-17T19:12:22.497393] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-17T19:12:22.498016] [INFO ] [MAIN ] Update Progress: 944/2368 symbols completed. GMED took 34.1s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-17T19:12:22.663211] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:22.707092] [DEBUG] [LOCAL ] GNK: Loaded 40280 existing records from primary storage. [2025-10-17T19:12:22.707541] [INFO ] [MAIN ] GNK: Loaded 40280 existing records. [2025-10-17T19:12:22.880253] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:22.880552] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-17T19:12:22.880599] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-17T19:12:22.880913] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-17T19:12:22.880970] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-17T19:12:23.163202] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-17T19:12:23.229172] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:23.541865] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T19:12:23.958003] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-17T19:12:24.112539] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-17T19:12:24.386425] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T19:12:24.758022] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-17T19:12:25.397892] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T19:12:25.558003] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-17T19:12:26.186356] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:12:26.190505] [INFO ] [REMOTE ] GMRE: Full fetch complete (52377 records). [2025-10-17T19:12:26.190619] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-17T19:12:26.367613] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-17T19:12:26.563573] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T19:12:26.596139] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-17T19:12:26.596331] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-17T19:12:26.597474] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-17T19:12:26.597537] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-17T19:12:26.598594] [DEBUG] [LOCAL ] GMRE: Trimmed 52377 records to 37414 (keeping 200 days of data) [2025-10-17T19:12:26.820457] [DEBUG] [LOCAL ] GMRE: Primary data saved (37414 records). [2025-10-17T19:12:26.820592] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-17T19:12:26.820693] [INFO ] [MAIN ] Update Progress: 945/2368 symbols completed. GMRE took 31.3s. Estimated remaining: 3h 19m 21s. Rate: 7.1 symbols/min [2025-10-17T19:12:26.986528] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:27.025544] [DEBUG] [LOCAL ] GNL: Loaded 47059 existing records from primary storage. [2025-10-17T19:12:27.025863] [INFO ] [MAIN ] GNL: Loaded 47059 existing records. [2025-10-17T19:12:27.163174] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-17T19:12:27.202577] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:27.202795] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-17T19:12:27.202844] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-17T19:12:27.203039] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-17T19:12:27.203095] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-17T19:12:27.563086] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:27.958041] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-17T19:12:28.252150] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T19:12:28.254450] [INFO ] [REMOTE ] GNE: Full fetch complete (22515 records). [2025-10-17T19:12:28.254521] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-17T19:12:28.620401] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-17T19:12:28.620485] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-17T19:12:28.621020] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-17T19:12:28.621084] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-17T19:12:28.621893] [DEBUG] [LOCAL ] GNE: Trimmed 22515 records to 18212 (keeping 200 days of data) [2025-10-17T19:12:28.738619] [DEBUG] [LOCAL ] GNE: Primary data saved (18212 records). [2025-10-17T19:12:28.739051] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-17T19:12:28.739146] [INFO ] [MAIN ] Update Progress: 946/2368 symbols completed. GNE took 27.9s. Estimated remaining: 3h 19m 2s. Rate: 7.1 symbols/min [2025-10-17T19:12:28.770940] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-17T19:12:28.919109] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:28.966621] [DEBUG] [LOCAL ] GNRC: Loaded 45849 existing records from primary storage. [2025-10-17T19:12:28.967018] [INFO ] [MAIN ] GNRC: Loaded 45849 existing records. [2025-10-17T19:12:29.190422] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:29.190866] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-17T19:12:29.191112] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-17T19:12:29.191991] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-17T19:12:29.192219] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-17T19:12:29.229300] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-17T19:12:29.311957] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:12:29.344850] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-17T19:12:29.346306] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-17T19:12:29.597450] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-17T19:12:29.966600] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:30.050436] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-17T19:12:30.050537] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-17T19:12:30.051531] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-17T19:12:30.051715] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-17T19:12:30.053384] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 54561 (keeping 200 days of data) [2025-10-17T19:12:30.299390] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:12:30.378515] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-17T19:12:30.432067] [DEBUG] [LOCAL ] GME: Primary data saved (54561 records). [2025-10-17T19:12:30.432189] [INFO ] [MAIN ] GME: Full history saved. [2025-10-17T19:12:30.432269] [INFO ] [MAIN ] Update Progress: 947/2368 symbols completed. GME took 54.6s. Estimated remaining: 3h 18m 44s. Rate: 7.2 symbols/min [2025-10-17T19:12:30.597114] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:30.607231] [DEBUG] [LOCAL ] GNT: Loaded 8541 existing records from primary storage. [2025-10-17T19:12:30.607518] [INFO ] [MAIN ] GNT: Loaded 8541 existing records. [2025-10-17T19:12:30.791891] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:30.792158] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-17T19:12:30.792221] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-17T19:12:30.792404] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-17T19:12:30.792477] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-17T19:12:31.098285] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T19:12:31.164663] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-17T19:12:31.185019] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:31.958025] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-17T19:12:32.009478] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:12:32.729057] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:12:32.758013] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-17T19:12:33.558001] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-17T19:12:33.600189] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:12:34.252787] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T19:12:34.281620] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:12:34.357992] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-17T19:12:35.158037] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-17T19:12:35.958000] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-17T19:12:36.053624] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:12:36.700184] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:12:36.757991] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-17T19:12:37.561722] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-17T19:12:37.566751] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T19:12:38.217980] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:12:38.358030] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-17T19:12:38.955950] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T19:12:39.158005] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-17T19:12:39.299789] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:12:39.958027] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-17T19:12:40.678329] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T19:12:40.706346] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T19:12:40.758032] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-17T19:12:41.558025] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-17T19:12:42.358063] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-17T19:12:42.399712] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:12:43.158072] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-17T19:12:43.217018] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T19:12:43.958010] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-17T19:12:44.124397] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:12:44.544755] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:12:44.758060] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-17T19:12:44.855438] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:12:45.558034] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-17T19:12:46.307465] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T19:12:46.357998] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-17T19:12:46.399856] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:12:47.098504] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T19:12:47.157996] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-17T19:12:47.904878] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T19:12:47.958018] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-17T19:12:48.758033] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-17T19:12:49.554904] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T19:12:49.558299] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-17T19:12:50.156127] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T19:12:50.180041] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T19:12:50.358053] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-17T19:12:50.826829] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T19:12:51.158049] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-17T19:12:51.958035] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-17T19:12:52.669621] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:12:52.763166] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-17T19:12:52.764148] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:12:53.558013] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-17T19:12:54.306416] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T19:12:54.314738] [INFO ] [REMOTE ] GNK: Full fetch complete (57308 records). [2025-10-17T19:12:54.314921] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-17T19:12:54.359208] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-17T19:12:54.423429] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:12:54.468868] [INFO ] [REMOTE ] GNT: Full fetch complete (11303 records). [2025-10-17T19:12:54.511736] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-17T19:12:55.022016] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-17T19:12:55.027506] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-17T19:12:55.061834] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-17T19:12:55.086715] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-17T19:12:55.159284] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-17T19:12:55.202152] [DEBUG] [LOCAL ] GNK: Trimmed 57308 records to 40529 (keeping 200 days of data) [2025-10-17T19:12:55.418745] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-17T19:12:55.419285] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-17T19:12:55.419867] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-17T19:12:55.422070] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-17T19:12:55.425992] [DEBUG] [LOCAL ] GNT: Trimmed 11303 records to 8665 (keeping 200 days of data) [2025-10-17T19:12:55.499404] [DEBUG] [LOCAL ] GNT: Primary data saved (8665 records). [2025-10-17T19:12:55.501014] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-17T19:12:55.501730] [INFO ] [MAIN ] Update Progress: 948/2368 symbols completed. GNT took 25.1s. Estimated remaining: 3h 19m 1s. Rate: 7.1 symbols/min [2025-10-17T19:12:55.683143] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:55.840620] [DEBUG] [LOCAL ] GNW: Loaded 51779 existing records from primary storage. [2025-10-17T19:12:55.842145] [INFO ] [MAIN ] GNW: Loaded 51779 existing records. [2025-10-17T19:12:55.863260] [DEBUG] [LOCAL ] GNK: Primary data saved (40529 records). [2025-10-17T19:12:55.897195] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-17T19:12:55.923279] [INFO ] [MAIN ] Update Progress: 949/2368 symbols completed. GNK took 33.4s. Estimated remaining: 3h 18m 40s. Rate: 7.1 symbols/min [2025-10-17T19:12:56.125953] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:56.130046] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-17T19:12:56.130133] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-17T19:12:56.130665] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-17T19:12:56.141184] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-17T19:12:56.329024] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:56.357403] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T19:12:56.453262] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-17T19:12:56.688541] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:56.689629] [DEBUG] [LOCAL ] GOF: Loaded 42964 existing records from primary storage. [2025-10-17T19:12:56.690271] [INFO ] [MAIN ] GOF: Loaded 42964 existing records. [2025-10-17T19:12:56.761920] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-17T19:12:56.869109] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:56.869478] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-17T19:12:56.869596] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-17T19:12:56.869882] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-17T19:12:56.869941] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-17T19:12:57.071389] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T19:12:57.266943] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:57.558042] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-17T19:12:58.025061] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:12:58.358067] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-17T19:12:58.599522] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:12:58.833839] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:12:59.158064] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-17T19:12:59.958040] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-17T19:13:00.056932] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:13:00.758054] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-17T19:13:01.571809] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-17T19:13:01.574527] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-17T19:13:02.035675] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T19:13:02.358090] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-17T19:13:03.158008] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-17T19:13:03.497342] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-17T19:13:03.940210] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:13:03.957981] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-17T19:13:04.386745] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T19:13:04.510493] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-17T19:13:04.758078] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-17T19:13:05.558049] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-17T19:13:05.752929] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T19:13:06.358014] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-17T19:13:06.404589] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T19:13:07.049392] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:13:07.157996] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-17T19:13:07.958090] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-17T19:13:08.077969] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:13:08.606244] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:13:08.758042] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-17T19:13:09.558050] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-17T19:13:09.731350] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T19:13:09.737994] [INFO ] [REMOTE ] GNL: Full fetch complete (68204 records). [2025-10-17T19:13:09.738141] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-17T19:13:10.130057] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-17T19:13:10.130138] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-17T19:13:10.131131] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-17T19:13:10.131196] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-17T19:13:10.132667] [DEBUG] [LOCAL ] GNL: Trimmed 68204 records to 47399 (keeping 200 days of data) [2025-10-17T19:13:10.358835] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-17T19:13:10.435140] [DEBUG] [LOCAL ] GNL: Primary data saved (47399 records). [2025-10-17T19:13:10.435323] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-17T19:13:10.435421] [INFO ] [MAIN ] Update Progress: 950/2368 symbols completed. GNL took 43.6s. Estimated remaining: 3h 18m 41s. Rate: 7.1 symbols/min [2025-10-17T19:13:10.610877] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:10.641824] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T19:13:10.677849] [DEBUG] [LOCAL ] GOLF: Loaded 31115 existing records from primary storage. [2025-10-17T19:13:10.678140] [INFO ] [MAIN ] GOLF: Loaded 31115 existing records. [2025-10-17T19:13:10.853846] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:10.854129] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-17T19:13:10.854194] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-17T19:13:10.854414] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-17T19:13:10.854484] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-17T19:13:11.182919] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-17T19:13:11.219969] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:11.258349] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:13:11.842544] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:13:11.958037] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-17T19:13:12.758029] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-17T19:13:12.927165] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T19:13:12.933563] [INFO ] [REMOTE ] GNRC: Full fetch complete (65709 records). [2025-10-17T19:13:12.933705] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-17T19:13:13.324294] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-17T19:13:13.324395] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-17T19:13:13.325422] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-17T19:13:13.325561] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-17T19:13:13.348632] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:13:13.358144] [DEBUG] [LOCAL ] GNRC: Trimmed 65709 records to 46194 (keeping 200 days of data) [2025-10-17T19:13:13.565349] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-17T19:13:13.637945] [DEBUG] [LOCAL ] GNRC: Primary data saved (46194 records). [2025-10-17T19:13:13.638083] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-17T19:13:13.638219] [INFO ] [MAIN ] Update Progress: 951/2368 symbols completed. GNRC took 44.9s. Estimated remaining: 3h 18m 25s. Rate: 7.1 symbols/min [2025-10-17T19:13:13.806817] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:13.848903] [DEBUG] [LOCAL ] GOOS: Loaded 44895 existing records from primary storage. [2025-10-17T19:13:13.849216] [INFO ] [MAIN ] GOOS: Loaded 44895 existing records. [2025-10-17T19:13:14.015414] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T19:13:14.049683] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:14.049902] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-17T19:13:14.049949] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-17T19:13:14.050146] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-17T19:13:14.050203] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-17T19:13:14.372010] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-17T19:13:14.413837] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:15.158060] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-17T19:13:15.280404] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:13:15.958091] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-17T19:13:16.069673] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:13:16.132811] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:13:16.758059] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-17T19:13:17.547948] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:13:17.558781] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-17T19:13:18.358004] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-17T19:13:18.423287] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:13:18.596610] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:13:19.158040] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-17T19:13:19.958068] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-17T19:13:20.044999] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:13:20.633929] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T19:13:20.758012] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-17T19:13:21.115250] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:13:21.558048] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-17T19:13:21.935042] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:13:22.358042] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-17T19:13:23.158070] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-17T19:13:23.321480] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T19:13:23.662018] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:13:23.958047] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-17T19:13:24.129296] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T19:13:24.758058] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-17T19:13:25.516951] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:13:25.558014] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-17T19:13:26.359495] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-17T19:13:26.362330] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T19:13:26.796169] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T19:13:27.158025] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-17T19:13:27.958035] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-17T19:13:28.223197] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T19:13:28.230537] [INFO ] [REMOTE ] GNW: Full fetch complete (73875 records). [2025-10-17T19:13:28.230729] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-17T19:13:28.661373] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-17T19:13:28.661490] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-17T19:13:28.662521] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-17T19:13:28.662634] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-17T19:13:28.664567] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:13:28.671934] [DEBUG] [LOCAL ] GNW: Trimmed 73875 records to 52153 (keeping 200 days of data) [2025-10-17T19:13:28.758031] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-17T19:13:28.963104] [DEBUG] [LOCAL ] GNW: Primary data saved (52153 records). [2025-10-17T19:13:28.963243] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-17T19:13:28.963773] [INFO ] [MAIN ] Update Progress: 952/2368 symbols completed. GNW took 33.5s. Estimated remaining: 3h 18m 27s. Rate: 7.1 symbols/min [2025-10-17T19:13:29.129822] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:29.168600] [DEBUG] [LOCAL ] GOTU: Loaded 37487 existing records from primary storage. [2025-10-17T19:13:29.168919] [INFO ] [MAIN ] GOTU: Loaded 37487 existing records. [2025-10-17T19:13:29.342113] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:29.342295] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-17T19:13:29.342340] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-17T19:13:29.342517] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-17T19:13:29.342555] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-17T19:13:29.564135] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-17T19:13:29.700089] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:29.719329] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T19:13:29.726586] [INFO ] [REMOTE ] GOF: Full fetch complete (62482 records). [2025-10-17T19:13:29.726759] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-17T19:13:30.167421] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-17T19:13:30.167532] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-17T19:13:30.168563] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-17T19:13:30.168669] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-17T19:13:30.189884] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:13:30.190049] [DEBUG] [LOCAL ] GOF: Trimmed 62482 records to 43353 (keeping 200 days of data) [2025-10-17T19:13:30.392037] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-17T19:13:30.495144] [DEBUG] [LOCAL ] GOF: Primary data saved (43353 records). [2025-10-17T19:13:30.495309] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-17T19:13:30.495410] [INFO ] [MAIN ] Update Progress: 953/2368 symbols completed. GOF took 34.6s. Estimated remaining: 3h 18m 8s. Rate: 7.1 symbols/min [2025-10-17T19:13:30.678808] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:30.725611] [DEBUG] [LOCAL ] GPC: Loaded 46350 existing records from primary storage. [2025-10-17T19:13:30.725988] [INFO ] [MAIN ] GPC: Loaded 46350 existing records. [2025-10-17T19:13:30.934982] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:30.935322] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-17T19:13:30.935382] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-17T19:13:30.935570] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-17T19:13:30.935610] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-17T19:13:31.163182] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-17T19:13:31.348329] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T19:13:31.373191] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:31.958038] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-17T19:13:32.099021] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:13:32.609571] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:13:32.757998] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-17T19:13:33.508511] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T19:13:33.557994] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-17T19:13:33.575702] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:13:34.358028] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-17T19:13:35.121480] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T19:13:35.157981] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-17T19:13:35.294346] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T19:13:35.298598] [INFO ] [REMOTE ] GOLF: Full fetch complete (45375 records). [2025-10-17T19:13:35.298742] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-17T19:13:35.713322] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-17T19:13:35.713406] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-17T19:13:35.714291] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-17T19:13:35.714360] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-17T19:13:35.715404] [DEBUG] [LOCAL ] GOLF: Trimmed 45375 records to 31259 (keeping 200 days of data) [2025-10-17T19:13:35.936566] [DEBUG] [LOCAL ] GOLF: Primary data saved (31259 records). [2025-10-17T19:13:35.936755] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-17T19:13:35.936903] [INFO ] [MAIN ] Update Progress: 954/2368 symbols completed. GOLF took 25.5s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-10-17T19:13:35.971730] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-17T19:13:36.108576] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:36.125668] [DEBUG] [LOCAL ] GPI: Loaded 15026 existing records from primary storage. [2025-10-17T19:13:36.125911] [INFO ] [MAIN ] GPI: Loaded 15026 existing records. [2025-10-17T19:13:36.297332] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:36.297577] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-17T19:13:36.297626] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-17T19:13:36.297829] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-17T19:13:36.297886] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-17T19:13:36.653420] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:36.758015] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-17T19:13:36.937406] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:13:37.558017] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-17T19:13:37.683456] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:13:37.781152] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T19:13:38.358032] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-17T19:13:39.106103] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:13:39.157992] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-17T19:13:39.958028] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-17T19:13:40.033304] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T19:13:40.683341] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:13:40.758014] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-17T19:13:41.558034] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-17T19:13:41.642810] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T19:13:42.183696] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:13:42.189262] [INFO ] [REMOTE ] GOOS: Full fetch complete (64848 records). [2025-10-17T19:13:42.189371] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-17T19:13:42.360856] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-17T19:13:42.569935] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:13:42.593070] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-17T19:13:42.593152] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-17T19:13:42.594119] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-17T19:13:42.594186] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-17T19:13:42.595545] [DEBUG] [LOCAL ] GOOS: Trimmed 64848 records to 45143 (keeping 200 days of data) [2025-10-17T19:13:42.849558] [DEBUG] [LOCAL ] GOOS: Primary data saved (45143 records). [2025-10-17T19:13:42.849741] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-17T19:13:42.849869] [INFO ] [MAIN ] Update Progress: 955/2368 symbols completed. GOOS took 29.2s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-17T19:13:43.014454] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:43.021042] [DEBUG] [LOCAL ] GPJA: Loaded 4213 existing records from primary storage. [2025-10-17T19:13:43.021225] [INFO ] [MAIN ] GPJA: Loaded 4213 existing records. [2025-10-17T19:13:43.167248] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-17T19:13:43.196887] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:43.197189] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-17T19:13:43.197236] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-17T19:13:43.197404] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-17T19:13:43.197467] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-17T19:13:43.571761] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:43.957996] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-17T19:13:44.106151] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:13:44.189485] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:13:44.502698] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T19:13:44.758044] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-17T19:13:45.541068] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:13:45.557989] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-17T19:13:46.123152] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T19:13:46.358061] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-17T19:13:47.158048] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-17T19:13:47.567888] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T19:13:47.718986] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T19:13:47.958060] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-17T19:13:48.516660] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T19:13:48.758028] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-17T19:13:49.218288] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T19:13:49.558036] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-17T19:13:50.358111] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-17T19:13:50.958547] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T19:13:51.158050] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-17T19:13:51.345875] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T19:13:51.958069] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-17T19:13:52.303962] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T19:13:52.610382] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T19:13:52.758066] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-17T19:13:53.558033] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-17T19:13:53.576037] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T19:13:54.358147] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-17T19:13:55.158076] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-17T19:13:55.295600] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:13:55.736905] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:13:55.958052] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-17T19:13:56.084437] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:13:56.758078] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-17T19:13:57.206910] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T19:13:57.558003] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-17T19:13:57.702531] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T19:13:58.358081] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-17T19:13:59.118704] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:13:59.158016] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-17T19:13:59.435992] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:13:59.958045] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-17T19:14:00.210754] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T19:14:00.758048] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-17T19:14:00.802090] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T19:14:01.558029] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-17T19:14:02.358079] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-17T19:14:02.661634] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:14:02.662574] [INFO ] [REMOTE ] GPJA: Full fetch complete (6944 records). [2025-10-17T19:14:02.662671] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-17T19:14:03.017522] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-17T19:14:03.017599] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-17T19:14:03.017808] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-17T19:14:03.017870] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-17T19:14:03.018270] [DEBUG] [LOCAL ] GPJA: Trimmed 6944 records to 4230 (keeping 200 days of data) [2025-10-17T19:14:03.043518] [DEBUG] [LOCAL ] GPJA: Primary data saved (4230 records). [2025-10-17T19:14:03.043597] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-17T19:14:03.043695] [INFO ] [MAIN ] Update Progress: 956/2368 symbols completed. GPJA took 20.2s. Estimated remaining: 3h 17m 54s. Rate: 7.1 symbols/min [2025-10-17T19:14:03.163112] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-17T19:14:03.225671] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:03.275978] [DEBUG] [LOCAL ] GPK: Loaded 53165 existing records from primary storage. [2025-10-17T19:14:03.276309] [INFO ] [MAIN ] GPK: Loaded 53165 existing records. [2025-10-17T19:14:03.456550] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:03.456943] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-17T19:14:03.457032] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-17T19:14:03.464136] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-17T19:14:03.476891] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-17T19:14:03.555232] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-17T19:14:03.850635] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:03.859032] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T19:14:03.957984] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-17T19:14:04.253276] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:14:04.758103] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-17T19:14:05.438220] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:14:05.558000] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-17T19:14:05.694471] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:14:06.358077] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-17T19:14:06.914392] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:14:07.158081] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-17T19:14:07.799607] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T19:14:07.958034] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-17T19:14:08.758119] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-17T19:14:09.424241] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-17T19:14:09.515779] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:14:09.557993] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-17T19:14:10.358072] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-17T19:14:10.537970] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:14:10.542847] [INFO ] [REMOTE ] GOTU: Full fetch complete (58473 records). [2025-10-17T19:14:10.542969] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-17T19:14:10.940889] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-17T19:14:10.940983] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-17T19:14:10.941939] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-17T19:14:10.942007] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-17T19:14:10.943342] [DEBUG] [LOCAL ] GOTU: Trimmed 58473 records to 37702 (keeping 200 days of data) [2025-10-17T19:14:11.156752] [DEBUG] [LOCAL ] GOTU: Primary data saved (37702 records). [2025-10-17T19:14:11.156896] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-17T19:14:11.157408] [INFO ] [MAIN ] Update Progress: 957/2368 symbols completed. GOTU took 42.2s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-17T19:14:11.157997] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-17T19:14:11.982835] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T19:14:11.993241] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-17T19:14:12.161750] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-17T19:14:12.295843] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:14:12.299995] [INFO ] [REMOTE ] GPI: Full fetch complete (21656 records). [2025-10-17T19:14:12.300109] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-17T19:14:12.667780] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-17T19:14:12.667851] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-17T19:14:12.668319] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-17T19:14:12.668362] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-17T19:14:12.669145] [DEBUG] [LOCAL ] GPI: Trimmed 21656 records to 15097 (keeping 200 days of data) [2025-10-17T19:14:12.763215] [DEBUG] [LOCAL ] GPI: Primary data saved (15097 records). [2025-10-17T19:14:12.761162] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-17T19:14:12.764137] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-17T19:14:12.764231] [INFO ] [MAIN ] Update Progress: 958/2368 symbols completed. GPI took 36.8s. Estimated remaining: 3h 17m 26s. Rate: 7.1 symbols/min [2025-10-17T19:14:13.706314] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:14:13.716958] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-17T19:14:14.384629] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:14:14.395705] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-17T19:14:15.282073] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T19:14:15.291355] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-17T19:14:16.126053] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:14:16.137089] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-17T19:14:16.562122] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T19:14:16.758073] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-17T19:14:17.972501] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:14:17.983779] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-17T19:14:18.037227] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:14:18.043555] [INFO ] [REMOTE ] GPC: Full fetch complete (68688 records). [2025-10-17T19:14:18.043727] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-17T19:14:18.433274] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-17T19:14:18.433363] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-17T19:14:18.434284] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-17T19:14:18.434350] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-17T19:14:18.435716] [DEBUG] [LOCAL ] GPC: Trimmed 68688 records to 46707 (keeping 200 days of data) [2025-10-17T19:14:18.732551] [DEBUG] [LOCAL ] GPC: Primary data saved (46707 records). [2025-10-17T19:14:18.732718] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-17T19:14:18.733331] [INFO ] [MAIN ] Update Progress: 959/2368 symbols completed. GPC took 48.2s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-17T19:14:19.708379] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:14:19.719466] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-17T19:14:21.492586] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:14:21.504450] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-17T19:14:23.391484] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T19:14:23.402824] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-17T19:14:25.021717] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T19:14:25.032911] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-17T19:14:26.831620] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T19:14:26.839079] [INFO ] [REMOTE ] GPK: Full fetch complete (75999 records). [2025-10-17T19:14:26.839235] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-17T19:14:27.241422] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-17T19:14:27.241502] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-17T19:14:27.242508] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-17T19:14:27.242574] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-17T19:14:27.244037] [DEBUG] [LOCAL ] GPK: Trimmed 75999 records to 53548 (keeping 200 days of data) [2025-10-17T19:14:27.569471] [DEBUG] [LOCAL ] GPK: Primary data saved (53548 records). [2025-10-17T19:14:27.569613] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-17T19:14:27.569725] [INFO ] [MAIN ] Update Progress: 960/2368 symbols completed. GPK took 24.5s. Estimated remaining: 3h 17m 7s. Rate: 7.1 symbols/min [2025-10-17T19:14:28.159217] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.263979] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.310814] [DEBUG] [LOCAL ] GPOR: No existing data file found in primary storage. [2025-10-17T19:14:28.310093] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.311547] [WARN ] [MAIN ] GPOR: No existing data found, performing full refresh instead. [2025-10-17T19:14:28.313010] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.313476] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-17T19:14:28.313556] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-17T19:14:28.313931] [DEBUG] [LOCAL ] GPOR: No primary data file found to delete. [2025-10-17T19:14:28.314124] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-17T19:14:28.551444] [DEBUG] [LOCAL ] GPMT: Loaded 26072 existing records from primary storage. [2025-10-17T19:14:28.575253] [INFO ] [MAIN ] GPMT: Loaded 26072 existing records. [2025-10-17T19:14:28.701741] [DEBUG] [LOCAL ] GPRK: Loaded 40056 existing records from primary storage. [2025-10-17T19:14:28.764549] [DEBUG] [LOCAL ] GPN: Loaded 52372 existing records from primary storage. [2025-10-17T19:14:28.764695] [INFO ] [MAIN ] GPRK: Loaded 40056 existing records. [2025-10-17T19:14:28.865493] [INFO ] [MAIN ] GPN: Loaded 52372 existing records. [2025-10-17T19:14:28.891387] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:28.896893] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-17T19:14:29.101607] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:29.152750] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-17T19:14:29.224114] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-17T19:14:29.228284] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:29.228753] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-17T19:14:29.229132] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-17T19:14:29.228690] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-17T19:14:29.239622] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-17T19:14:29.308817] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-17T19:14:29.340379] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-17T19:14:29.450172] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:29.490618] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-17T19:14:29.508023] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-17T19:14:29.565703] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-17T19:14:29.565870] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-17T19:14:30.185428] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:30.250926] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-17T19:14:30.355183] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:30.355857] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-17T19:14:30.438550] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:30.438923] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-17T19:14:30.455046] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:14:30.460889] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-17T19:14:31.529272] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:14:31.535263] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-17T19:14:31.824991] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:14:31.831324] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-17T19:14:31.860973] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T19:14:31.871686] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-17T19:14:31.946070] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:14:31.953759] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-17T19:14:32.778060] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:14:32.783240] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-17T19:14:32.966481] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:14:32.971363] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-17T19:14:33.354819] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T19:14:33.363785] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-17T19:14:33.509885] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:14:33.520330] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-17T19:14:33.903548] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:14:33.908582] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-17T19:14:33.965509] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:14:33.971327] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-17T19:14:34.418921] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T19:14:34.426881] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-17T19:14:35.030726] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T19:14:35.036189] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-17T19:14:35.192587] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:14:35.197915] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-17T19:14:35.266691] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:14:35.539184] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:14:35.957950] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-17T19:14:36.022732] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T19:14:36.042905] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T19:14:36.758111] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-17T19:14:37.417101] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:14:37.558008] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-17T19:14:37.867262] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T19:14:38.358052] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-17T19:14:39.133316] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:14:39.158038] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-17T19:14:39.498625] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T19:14:39.958134] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-17T19:14:40.758049] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-17T19:14:40.953866] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T19:14:41.120807] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T19:14:41.558029] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-17T19:14:42.033952] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T19:14:42.358049] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-17T19:14:42.998325] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T19:14:43.158102] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-17T19:14:43.652166] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:14:43.958023] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-17T19:14:44.758000] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-17T19:14:44.983753] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:14:45.011681] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T19:14:45.015363] [INFO ] [REMOTE ] GPOR: Full fetch complete (34994 records). [2025-10-17T19:14:45.015440] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-17T19:14:45.376489] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-17T19:14:45.376569] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-17T19:14:45.377243] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-17T19:14:45.377334] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-17T19:14:45.378152] [DEBUG] [LOCAL ] GPOR: Trimmed 34994 records to 23691 (keeping 200 days of data) [2025-10-17T19:14:45.520244] [DEBUG] [LOCAL ] GPOR: Primary data saved (23691 records). [2025-10-17T19:14:45.520671] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-17T19:14:45.520764] [INFO ] [MAIN ] Update Progress: 961/2368 symbols completed. GPOR took 17.9s. Estimated remaining: 3h 17m 12s. Rate: 7.1 symbols/min [2025-10-17T19:14:45.563334] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-17T19:14:45.697160] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:45.724111] [DEBUG] [LOCAL ] GRBK: Loaded 27274 existing records from primary storage. [2025-10-17T19:14:45.724467] [INFO ] [MAIN ] GRBK: Loaded 27274 existing records. [2025-10-17T19:14:45.908217] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:45.908399] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-17T19:14:45.908473] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-17T19:14:45.909036] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-17T19:14:45.909099] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-17T19:14:46.272241] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:46.293501] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:14:46.357994] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-17T19:14:47.052116] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:14:47.157998] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-17T19:14:47.222450] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T19:14:47.958037] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-17T19:14:48.610808] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:14:48.758036] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-17T19:14:49.558007] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-17T19:14:49.804451] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T19:14:49.841669] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T19:14:50.358032] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-17T19:14:50.770479] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T19:14:51.008744] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-17T19:14:51.158021] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-17T19:14:51.958010] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-17T19:14:52.597904] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T19:14:52.757989] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-17T19:14:53.558006] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-17T19:14:53.726294] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:14:54.289954] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:14:54.295901] [INFO ] [REMOTE ] GPRK: Full fetch complete (58217 records). [2025-10-17T19:14:54.296018] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-17T19:14:54.363288] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-17T19:14:54.677726] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-17T19:14:54.677809] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-17T19:14:54.678623] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-17T19:14:54.678731] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-17T19:14:54.679920] [DEBUG] [LOCAL ] GPRK: Trimmed 58217 records to 40348 (keeping 200 days of data) [2025-10-17T19:14:54.906880] [DEBUG] [LOCAL ] GPRK: Primary data saved (40348 records). [2025-10-17T19:14:54.907122] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-17T19:14:54.912381] [INFO ] [MAIN ] Update Progress: 962/2368 symbols completed. GPRK took 27.3s. Estimated remaining: 3h 17m 5s. Rate: 7.1 symbols/min [2025-10-17T19:14:54.990023] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:14:55.100392] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:55.111052] [DEBUG] [LOCAL ] GRC: Loaded 9376 existing records from primary storage. [2025-10-17T19:14:55.111256] [INFO ] [MAIN ] GRC: Loaded 9376 existing records. [2025-10-17T19:14:55.163896] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-17T19:14:55.289079] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:55.289337] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-17T19:14:55.289391] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-17T19:14:55.289532] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-17T19:14:55.289571] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-17T19:14:55.675928] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:55.958100] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-17T19:14:56.259118] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T19:14:56.301137] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:14:56.758059] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-17T19:14:56.893245] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:14:57.531916] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T19:14:57.557987] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-17T19:14:58.358019] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-17T19:14:58.402749] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T19:14:59.158012] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-17T19:14:59.433306] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T19:14:59.436363] [INFO ] [REMOTE ] GPMT: Full fetch complete (36657 records). [2025-10-17T19:14:59.436451] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-17T19:14:59.809249] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-17T19:14:59.809335] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-17T19:14:59.810077] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-17T19:14:59.810139] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-17T19:14:59.811025] [DEBUG] [LOCAL ] GPMT: Trimmed 36657 records to 26215 (keeping 200 days of data) [2025-10-17T19:14:59.959942] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-17T19:14:59.962361] [DEBUG] [LOCAL ] GPMT: Primary data saved (26215 records). [2025-10-17T19:14:59.962500] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-17T19:14:59.962592] [INFO ] [MAIN ] Update Progress: 963/2368 symbols completed. GPMT took 32.4s. Estimated remaining: 3h 16m 52s. Rate: 7.1 symbols/min [2025-10-17T19:15:00.130333] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:00.151775] [DEBUG] [LOCAL ] GRDN: Loaded 21092 existing records from primary storage. [2025-10-17T19:15:00.152024] [INFO ] [MAIN ] GRDN: Loaded 21092 existing records. [2025-10-17T19:15:00.349993] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:00.350216] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-17T19:15:00.350263] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-17T19:15:00.350455] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-17T19:15:00.350510] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-17T19:15:00.703186] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:00.757990] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-17T19:15:00.990212] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T19:15:01.558004] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-17T19:15:01.697931] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T19:15:02.358033] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-17T19:15:03.158058] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-17T19:15:03.327735] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-17T19:15:03.395844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:15:03.958025] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-17T19:15:04.619776] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T19:15:04.758025] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-17T19:15:04.800416] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T19:15:04.821612] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T19:15:05.558041] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-17T19:15:06.358005] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-17T19:15:06.380320] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T19:15:06.833605] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T19:15:06.841959] [INFO ] [REMOTE ] GPN: Full fetch complete (75088 records). [2025-10-17T19:15:06.842204] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-17T19:15:07.172973] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-17T19:15:07.231288] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-17T19:15:07.231373] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-17T19:15:07.232371] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-17T19:15:07.232442] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-17T19:15:07.233962] [DEBUG] [LOCAL ] GPN: Trimmed 75088 records to 52716 (keeping 200 days of data) [2025-10-17T19:15:07.563711] [DEBUG] [LOCAL ] GPN: Primary data saved (52716 records). [2025-10-17T19:15:07.563839] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-17T19:15:07.563948] [INFO ] [MAIN ] Update Progress: 964/2368 symbols completed. GPN took 40.0s. Estimated remaining: 3h 16m 42s. Rate: 7.1 symbols/min [2025-10-17T19:15:07.752678] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T19:15:07.755799] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:07.803863] [DEBUG] [LOCAL ] GRMN: Loaded 40670 existing records from primary storage. [2025-10-17T19:15:07.804147] [INFO ] [MAIN ] GRMN: Loaded 40670 existing records. [2025-10-17T19:15:07.958682] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-17T19:15:07.979681] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:07.980997] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-17T19:15:07.981123] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-17T19:15:07.986596] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-17T19:15:07.986760] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-17T19:15:07.992607] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T19:15:08.343779] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:08.758045] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-17T19:15:08.784492] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T19:15:09.558009] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-17T19:15:09.871602] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:15:10.220811] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T19:15:10.357992] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-17T19:15:11.157995] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-17T19:15:11.560272] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T19:15:11.958041] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-17T19:15:12.758082] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-17T19:15:12.970146] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T19:15:12.986226] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T19:15:13.558037] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-17T19:15:14.017038] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:15:14.358024] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-17T19:15:15.115979] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:15:15.157986] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-17T19:15:15.596862] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T19:15:15.958075] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-17T19:15:16.463629] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T19:15:16.723588] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:15:16.758006] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-17T19:15:17.526137] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T19:15:17.557996] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-17T19:15:18.358044] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-17T19:15:18.526343] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T19:15:18.528474] [INFO ] [REMOTE ] GRC: Full fetch complete (13387 records). [2025-10-17T19:15:18.528542] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-17T19:15:18.895864] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-17T19:15:18.895938] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-17T19:15:18.896238] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-17T19:15:18.896276] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-17T19:15:18.896759] [DEBUG] [LOCAL ] GRC: Trimmed 13387 records to 9440 (keeping 200 days of data) [2025-10-17T19:15:18.954628] [DEBUG] [LOCAL ] GRC: Primary data saved (9440 records). [2025-10-17T19:15:18.954788] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-17T19:15:18.954874] [INFO ] [MAIN ] Update Progress: 965/2368 symbols completed. GRC took 24.0s. Estimated remaining: 3h 16m 38s. Rate: 7.1 symbols/min [2025-10-17T19:15:19.123820] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:19.158014] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-17T19:15:19.181968] [DEBUG] [LOCAL ] GRND: Loaded 50505 existing records from primary storage. [2025-10-17T19:15:19.182334] [INFO ] [MAIN ] GRND: Loaded 50505 existing records. [2025-10-17T19:15:19.361523] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:15:19.387811] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:19.392085] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-17T19:15:19.392150] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-17T19:15:19.392345] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-17T19:15:19.392403] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-17T19:15:19.743360] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:19.957996] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-17T19:15:20.348465] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:15:20.758001] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-17T19:15:21.047824] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:15:21.558042] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-17T19:15:22.358033] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-17T19:15:22.622284] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:15:23.084555] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:15:23.157986] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-17T19:15:23.714528] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:15:23.719119] [INFO ] [REMOTE ] GRBK: Full fetch complete (40267 records). [2025-10-17T19:15:23.719282] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-17T19:15:23.963179] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-17T19:15:24.169411] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-17T19:15:24.169517] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-17T19:15:24.170449] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-17T19:15:24.170517] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-17T19:15:24.171442] [DEBUG] [LOCAL ] GRBK: Trimmed 40267 records to 27388 (keeping 200 days of data) [2025-10-17T19:15:24.346409] [DEBUG] [LOCAL ] GRBK: Primary data saved (27388 records). [2025-10-17T19:15:24.346564] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-17T19:15:24.346678] [INFO ] [MAIN ] Update Progress: 966/2368 symbols completed. GRBK took 38.8s. Estimated remaining: 3h 16m 26s. Rate: 7.1 symbols/min [2025-10-17T19:15:24.522718] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:24.559034] [DEBUG] [LOCAL ] GRNT: Loaded 34222 existing records from primary storage. [2025-10-17T19:15:24.559451] [INFO ] [MAIN ] GRNT: Loaded 34222 existing records. [2025-10-17T19:15:24.739225] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:24.739618] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-17T19:15:24.739852] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-17T19:15:24.740103] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-17T19:15:24.740217] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-17T19:15:24.771002] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-17T19:15:24.894486] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:15:25.142088] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:25.557994] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-17T19:15:25.796055] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:15:25.955121] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T19:15:26.358061] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-17T19:15:26.671158] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:15:27.158042] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-17T19:15:27.958045] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-17T19:15:27.988157] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T19:15:28.144950] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T19:15:28.758090] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-17T19:15:29.558051] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-17T19:15:29.777867] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:15:30.194958] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:15:30.358005] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-17T19:15:31.158038] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-17T19:15:31.235759] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:15:31.283299] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:15:31.958062] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-17T19:15:32.030492] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T19:15:32.758031] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-17T19:15:33.558035] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-17T19:15:33.688317] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:15:33.751394] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:15:34.357994] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-17T19:15:34.466910] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T19:15:35.158078] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-17T19:15:35.958043] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-17T19:15:35.995164] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:15:36.452606] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T19:15:36.457836] [INFO ] [REMOTE ] GRDN: Full fetch complete (26337 records). [2025-10-17T19:15:36.457954] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-17T19:15:36.763092] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-17T19:15:36.830344] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-17T19:15:36.830425] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-17T19:15:36.831069] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-17T19:15:36.831134] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-17T19:15:36.832007] [DEBUG] [LOCAL ] GRDN: Trimmed 26337 records to 21216 (keeping 200 days of data) [2025-10-17T19:15:36.965976] [DEBUG] [LOCAL ] GRDN: Primary data saved (21216 records). [2025-10-17T19:15:36.966103] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-17T19:15:36.966194] [INFO ] [MAIN ] Update Progress: 967/2368 symbols completed. GRDN took 37.0s. Estimated remaining: 3h 16m 23s. Rate: 7.1 symbols/min [2025-10-17T19:15:37.140750] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:37.151943] [DEBUG] [LOCAL ] GROV: Loaded 8795 existing records from primary storage. [2025-10-17T19:15:37.152112] [INFO ] [MAIN ] GROV: Loaded 8795 existing records. [2025-10-17T19:15:37.340435] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:37.340630] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-17T19:15:37.340715] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-17T19:15:37.340901] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-17T19:15:37.340968] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-17T19:15:37.563122] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-17T19:15:37.573375] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:15:37.732373] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:38.358004] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-17T19:15:38.414545] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T19:15:39.158046] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-17T19:15:39.419683] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:15:39.672548] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:15:39.958048] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-17T19:15:40.504979] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T19:15:40.758052] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-17T19:15:40.931883] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T19:15:41.358071] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T19:15:41.558027] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-17T19:15:42.358026] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-17T19:15:42.847784] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:15:43.158092] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-17T19:15:43.949179] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T19:15:43.957980] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-17T19:15:43.985556] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:15:44.758034] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-17T19:15:45.514270] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T19:15:45.519708] [INFO ] [REMOTE ] GRMN: Full fetch complete (59673 records). [2025-10-17T19:15:45.519848] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-17T19:15:45.563148] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-17T19:15:45.913131] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-17T19:15:45.913215] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-17T19:15:45.914077] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-17T19:15:45.914143] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-17T19:15:45.921064] [DEBUG] [LOCAL ] GRMN: Trimmed 59673 records to 40933 (keeping 200 days of data) [2025-10-17T19:15:46.175934] [DEBUG] [LOCAL ] GRMN: Primary data saved (40933 records). [2025-10-17T19:15:46.176063] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-17T19:15:46.176948] [INFO ] [MAIN ] Update Progress: 968/2368 symbols completed. GRMN took 38.6s. Estimated remaining: 3h 16m 16s. Rate: 7.1 symbols/min [2025-10-17T19:15:46.365057] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:46.363111] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-17T19:15:46.373998] [DEBUG] [LOCAL ] GRX: Loaded 4828 existing records from primary storage. [2025-10-17T19:15:46.374216] [INFO ] [MAIN ] GRX: Loaded 4828 existing records. [2025-10-17T19:15:46.561805] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:46.562304] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-17T19:15:46.562470] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-17T19:15:46.562713] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-17T19:15:46.562781] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-17T19:15:46.783560] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T19:15:46.843810] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:15:46.970947] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:47.158027] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-17T19:15:47.337040] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:15:47.812731] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-17T19:15:47.958062] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-17T19:15:48.758088] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-17T19:15:49.292616] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:15:49.322159] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T19:15:49.558033] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-17T19:15:50.358050] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-17T19:15:51.051969] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T19:15:51.158054] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-17T19:15:51.770716] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T19:15:51.775993] [INFO ] [REMOTE ] GRNT: Full fetch complete (48330 records). [2025-10-17T19:15:51.776162] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-17T19:15:51.958870] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-17T19:15:52.171295] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-17T19:15:52.171371] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-17T19:15:52.172127] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-17T19:15:52.172188] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-17T19:15:52.173166] [DEBUG] [LOCAL ] GRNT: Trimmed 48330 records to 34443 (keeping 200 days of data) [2025-10-17T19:15:52.375475] [DEBUG] [LOCAL ] GRNT: Primary data saved (34443 records). [2025-10-17T19:15:52.375637] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-17T19:15:52.375765] [INFO ] [MAIN ] Update Progress: 969/2368 symbols completed. GRNT took 28.0s. Estimated remaining: 3h 16m 4s. Rate: 7.1 symbols/min [2025-10-17T19:15:52.560953] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:52.561164] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:15:52.611444] [DEBUG] [LOCAL ] GS: Loaded 52170 existing records from primary storage. [2025-10-17T19:15:52.611782] [INFO ] [MAIN ] GS: Loaded 52170 existing records. [2025-10-17T19:15:52.759030] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-17T19:15:52.789980] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:52.790372] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-17T19:15:52.790477] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-17T19:15:52.790832] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-17T19:15:52.790943] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-17T19:15:52.952546] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T19:15:53.216828] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:53.558003] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-17T19:15:53.573943] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T19:15:54.358021] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-17T19:15:55.114277] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:15:55.158007] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-17T19:15:55.336740] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:15:55.931505] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T19:15:55.957996] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-17T19:15:56.758074] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-17T19:15:56.821541] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T19:15:57.558043] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-17T19:15:58.113066] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T19:15:58.358007] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-17T19:15:58.813402] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T19:15:59.158031] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-17T19:15:59.387917] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T19:15:59.958025] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-17T19:16:00.649852] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T19:16:00.758043] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-17T19:16:01.403670] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T19:16:01.412671] [INFO ] [REMOTE ] GRND: Full fetch complete (71655 records). [2025-10-17T19:16:01.412808] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-17T19:16:01.563160] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-17T19:16:01.838830] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-17T19:16:01.838919] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-17T19:16:01.839861] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-17T19:16:01.839926] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-17T19:16:01.841345] [DEBUG] [LOCAL ] GRND: Trimmed 71655 records to 50893 (keeping 200 days of data) [2025-10-17T19:16:02.071933] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:16:02.140178] [DEBUG] [LOCAL ] GRND: Primary data saved (50893 records). [2025-10-17T19:16:02.140322] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-17T19:16:02.140406] [INFO ] [MAIN ] Update Progress: 970/2368 symbols completed. GRND took 43.2s. Estimated remaining: 3h 15m 58s. Rate: 7.1 symbols/min [2025-10-17T19:16:02.310158] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:02.348073] [DEBUG] [LOCAL ] GSBD: Loaded 39923 existing records from primary storage. [2025-10-17T19:16:02.348399] [INFO ] [MAIN ] GSBD: Loaded 39923 existing records. [2025-10-17T19:16:02.363170] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-17T19:16:02.527554] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:02.527758] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-17T19:16:02.527832] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-17T19:16:02.528081] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-17T19:16:02.528149] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-17T19:16:02.870282] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:03.158024] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-17T19:16:03.249745] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T19:16:03.948480] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-17T19:16:03.958591] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-17T19:16:04.551853] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:16:04.758016] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-17T19:16:04.815766] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T19:16:05.312322] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T19:16:05.558036] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-17T19:16:06.280913] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T19:16:06.282369] [INFO ] [REMOTE ] GROV: Full fetch complete (13902 records). [2025-10-17T19:16:06.282439] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-17T19:16:06.363141] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-17T19:16:06.637929] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-17T19:16:06.638009] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-17T19:16:06.638351] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-17T19:16:06.638395] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-17T19:16:06.638916] [DEBUG] [LOCAL ] GROV: Trimmed 13902 records to 8805 (keeping 200 days of data) [2025-10-17T19:16:06.687681] [DEBUG] [LOCAL ] GROV: Primary data saved (8805 records). [2025-10-17T19:16:06.687793] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-17T19:16:06.687871] [INFO ] [MAIN ] Update Progress: 971/2368 symbols completed. GROV took 29.7s. Estimated remaining: 3h 15m 44s. Rate: 7.1 symbols/min [2025-10-17T19:16:06.855364] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:06.910249] [DEBUG] [LOCAL ] GSK: Loaded 53895 existing records from primary storage. [2025-10-17T19:16:06.910563] [INFO ] [MAIN ] GSK: Loaded 53895 existing records. [2025-10-17T19:16:07.084837] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T19:16:07.089900] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:07.091908] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-17T19:16:07.091963] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-17T19:16:07.092460] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-17T19:16:07.092518] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-17T19:16:07.163241] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-17T19:16:07.443602] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:07.958071] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-17T19:16:08.588753] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T19:16:08.758056] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-17T19:16:08.793443] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:16:09.558021] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-17T19:16:10.358093] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-17T19:16:10.652876] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T19:16:11.077749] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T19:16:11.158040] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-17T19:16:11.603724] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T19:16:11.929016] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T19:16:11.930444] [INFO ] [REMOTE ] GRX: Full fetch complete (6523 records). [2025-10-17T19:16:11.930517] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-17T19:16:11.963188] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-17T19:16:12.287247] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-17T19:16:12.287378] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-17T19:16:12.287612] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-17T19:16:12.287682] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-17T19:16:12.288078] [DEBUG] [LOCAL ] GRX: Trimmed 6523 records to 4862 (keeping 200 days of data) [2025-10-17T19:16:12.316365] [DEBUG] [LOCAL ] GRX: Primary data saved (4862 records). [2025-10-17T19:16:12.316471] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-17T19:16:12.316554] [INFO ] [MAIN ] Update Progress: 972/2368 symbols completed. GRX took 26.1s. Estimated remaining: 3h 15m 32s. Rate: 7.1 symbols/min [2025-10-17T19:16:12.483509] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:12.516925] [DEBUG] [LOCAL ] GSL: Loaded 33526 existing records from primary storage. [2025-10-17T19:16:12.517205] [INFO ] [MAIN ] GSL: Loaded 33526 existing records. [2025-10-17T19:16:12.703503] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:12.703780] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-17T19:16:12.703831] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-17T19:16:12.704032] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-17T19:16:12.704087] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-17T19:16:12.766161] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-17T19:16:13.057758] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:13.558026] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-17T19:16:14.252004] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T19:16:14.358019] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-17T19:16:14.905171] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T19:16:15.138095] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:16:15.157984] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-17T19:16:15.958046] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-17T19:16:16.732590] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-17T19:16:16.758073] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-17T19:16:17.025258] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T19:16:17.447533] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:16:17.558029] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-17T19:16:17.806309] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:16:18.358136] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-17T19:16:19.158076] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-17T19:16:19.638546] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T19:16:19.958080] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-17T19:16:20.266417] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:16:20.758018] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-17T19:16:20.834206] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:16:21.558024] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-17T19:16:21.718597] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:16:22.358074] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-17T19:16:22.472252] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T19:16:22.659200] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:16:23.158030] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-17T19:16:23.958066] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-17T19:16:24.618149] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T19:16:24.648341] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:16:24.758030] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-17T19:16:25.558009] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-17T19:16:25.801448] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:16:26.358050] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-17T19:16:27.041000] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-17T19:16:27.113444] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:16:27.158019] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-17T19:16:27.874153] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T19:16:27.958042] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-17T19:16:28.735282] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T19:16:28.758026] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-17T19:16:29.558037] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-17T19:16:30.154984] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T19:16:30.217278] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:16:30.358038] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-17T19:16:31.059367] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:16:31.158008] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-17T19:16:31.182203] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T19:16:31.189685] [INFO ] [REMOTE ] GS: Full fetch complete (75827 records). [2025-10-17T19:16:31.189815] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-17T19:16:31.591333] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-17T19:16:31.591428] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-17T19:16:31.592509] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-17T19:16:31.592582] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-17T19:16:31.594128] [DEBUG] [LOCAL ] GS: Trimmed 75827 records to 52558 (keeping 200 days of data) [2025-10-17T19:16:31.927207] [DEBUG] [LOCAL ] GS: Primary data saved (52558 records). [2025-10-17T19:16:31.927380] [INFO ] [MAIN ] GS: Full history saved. [2025-10-17T19:16:31.927884] [INFO ] [MAIN ] Update Progress: 973/2368 symbols completed. GS took 39.6s. Estimated remaining: 3h 15m 39s. Rate: 7.1 symbols/min [2025-10-17T19:16:31.963206] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-17T19:16:32.098223] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:32.152700] [DEBUG] [LOCAL ] GTES: Loaded 50766 existing records from primary storage. [2025-10-17T19:16:32.153032] [INFO ] [MAIN ] GTES: Loaded 50766 existing records. [2025-10-17T19:16:32.330377] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:32.330588] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-17T19:16:32.330662] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-17T19:16:32.330948] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-17T19:16:32.331006] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-17T19:16:32.693175] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:32.757999] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-17T19:16:32.795472] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:16:33.558004] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-17T19:16:33.910479] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:16:34.358010] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-17T19:16:34.432477] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:16:34.948883] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T19:16:35.158046] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-17T19:16:35.958029] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-17T19:16:36.079380] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T19:16:36.637242] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T19:16:36.758084] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-17T19:16:37.199382] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:16:37.558028] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-17T19:16:38.106388] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:16:38.358043] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-17T19:16:39.168952] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-17T19:16:39.174449] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:16:39.750333] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:16:39.958072] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-17T19:16:40.714638] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T19:16:40.724873] [INFO ] [REMOTE ] GSBD: Full fetch complete (58689 records). [2025-10-17T19:16:40.725067] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-17T19:16:40.763203] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-17T19:16:41.225905] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-17T19:16:41.226075] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-17T19:16:41.227211] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-17T19:16:41.227324] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-17T19:16:41.229147] [DEBUG] [LOCAL ] GSBD: Trimmed 58689 records to 40293 (keeping 200 days of data) [2025-10-17T19:16:41.561764] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-17T19:16:41.562955] [DEBUG] [LOCAL ] GSBD: Primary data saved (40293 records). [2025-10-17T19:16:41.564518] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-17T19:16:41.564844] [INFO ] [MAIN ] Update Progress: 974/2368 symbols completed. GSBD took 39.4s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-17T19:16:41.803671] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:41.849504] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:16:41.911453] [DEBUG] [LOCAL ] GTLS: Loaded 43612 existing records from primary storage. [2025-10-17T19:16:41.911869] [INFO ] [MAIN ] GTLS: Loaded 43612 existing records. [2025-10-17T19:16:42.100158] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:42.100503] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-17T19:16:42.100558] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-17T19:16:42.100779] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-17T19:16:42.100836] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-17T19:16:42.365326] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-17T19:16:42.460577] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:42.707558] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T19:16:43.156603] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:16:43.163394] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-17T19:16:43.958055] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-17T19:16:44.758037] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-17T19:16:44.860957] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-17T19:16:45.150142] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T19:16:45.558040] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-17T19:16:46.090221] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T19:16:46.097908] [INFO ] [REMOTE ] GSK: Full fetch complete (77636 records). [2025-10-17T19:16:46.098081] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-17T19:16:46.362666] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-17T19:16:46.529473] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:16:46.560787] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-17T19:16:46.560902] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-17T19:16:46.562221] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-17T19:16:46.562285] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-17T19:16:46.563719] [DEBUG] [LOCAL ] GSK: Trimmed 77636 records to 54285 (keeping 200 days of data) [2025-10-17T19:16:46.922862] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:16:46.943148] [DEBUG] [LOCAL ] GSK: Primary data saved (54285 records). [2025-10-17T19:16:46.943278] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-17T19:16:46.943824] [INFO ] [MAIN ] Update Progress: 975/2368 symbols completed. GSK took 40.3s. Estimated remaining: 3h 15m 20s. Rate: 7.1 symbols/min [2025-10-17T19:16:47.128879] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:47.158044] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-17T19:16:47.174367] [DEBUG] [LOCAL ] GTN: Loaded 45496 existing records from primary storage. [2025-10-17T19:16:47.174737] [INFO ] [MAIN ] GTN: Loaded 45496 existing records. [2025-10-17T19:16:47.370675] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:47.370891] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-17T19:16:47.370940] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-17T19:16:47.371217] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-17T19:16:47.371322] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-17T19:16:47.752933] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:47.937957] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:16:47.957982] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-17T19:16:48.575205] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:16:48.758055] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-17T19:16:49.008248] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:16:49.558039] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-17T19:16:50.343372] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T19:16:50.357987] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-17T19:16:50.920408] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:16:50.925372] [INFO ] [REMOTE ] GSL: Full fetch complete (48330 records). [2025-10-17T19:16:50.925493] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-17T19:16:51.169399] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-17T19:16:51.308776] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-17T19:16:51.308864] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-17T19:16:51.309718] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-17T19:16:51.309783] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-17T19:16:51.310943] [DEBUG] [LOCAL ] GSL: Trimmed 48330 records to 33725 (keeping 200 days of data) [2025-10-17T19:16:51.521666] [DEBUG] [LOCAL ] GSL: Primary data saved (33725 records). [2025-10-17T19:16:51.522054] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-17T19:16:51.522145] [INFO ] [MAIN ] Update Progress: 976/2368 symbols completed. GSL took 39.2s. Estimated remaining: 3h 15m 6s. Rate: 7.1 symbols/min [2025-10-17T19:16:51.693930] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:51.722954] [DEBUG] [LOCAL ] GTY: Loaded 30529 existing records from primary storage. [2025-10-17T19:16:51.723230] [INFO ] [MAIN ] GTY: Loaded 30529 existing records. [2025-10-17T19:16:51.902922] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:51.903183] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-17T19:16:51.903281] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-17T19:16:51.903895] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-17T19:16:51.903953] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-17T19:16:51.965164] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-17T19:16:52.208597] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:16:52.295136] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:52.758071] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-17T19:16:52.813442] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:16:53.557998] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-17T19:16:53.642607] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:16:53.954039] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T19:16:54.358039] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-17T19:16:55.158022] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-17T19:16:55.305367] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T19:16:55.749675] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T19:16:55.958016] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-17T19:16:56.758055] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-17T19:16:56.829240] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T19:16:57.089033] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:16:57.558050] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-17T19:16:58.358011] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-17T19:16:58.421883] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:16:58.991919] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:16:59.158007] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-17T19:16:59.808807] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T19:16:59.958090] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-17T19:17:00.679567] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:17:00.758028] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-17T19:17:01.557999] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-17T19:17:01.804237] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T19:17:02.281995] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:17:02.358059] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-17T19:17:03.158088] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-17T19:17:03.704902] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:17:03.958068] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-17T19:17:04.716683] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T19:17:04.758011] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-17T19:17:05.558010] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-17T19:17:05.699523] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T19:17:05.706807] [INFO ] [REMOTE ] GTES: Full fetch complete (73945 records). [2025-10-17T19:17:05.706944] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-17T19:17:06.097086] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-17T19:17:06.097187] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-17T19:17:06.098228] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-17T19:17:06.098290] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-17T19:17:06.099724] [DEBUG] [LOCAL ] GTES: Trimmed 73945 records to 51134 (keeping 200 days of data) [2025-10-17T19:17:06.387266] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (4.83 seconds). [2025-10-17T19:17:06.419240] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-17T19:17:06.443125] [DEBUG] [LOCAL ] GTES: Primary data saved (51134 records). [2025-10-17T19:17:06.443378] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-17T19:17:06.444534] [INFO ] [MAIN ] Update Progress: 977/2368 symbols completed. GTES took 34.5s. Estimated remaining: 3h 15m 7s. Rate: 7.1 symbols/min [2025-10-17T19:17:06.622236] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:17:06.657074] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:06.672532] [DEBUG] [LOCAL ] GUG: Loaded 12217 existing records from primary storage. [2025-10-17T19:17:06.672804] [INFO ] [MAIN ] GUG: Loaded 12217 existing records. [2025-10-17T19:17:06.880406] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:06.883111] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:17:06.883386] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-17T19:17:06.883629] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-17T19:17:06.892193] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-17T19:17:06.892252] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-17T19:17:07.159635] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-17T19:17:07.236300] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:07.958014] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-17T19:17:08.136475] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:17:08.223032] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:17:08.758038] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-17T19:17:09.541876] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:17:09.557982] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-17T19:17:09.975096] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T19:17:10.358053] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-17T19:17:11.135601] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T19:17:11.141902] [INFO ] [REMOTE ] GTLS: Full fetch complete (61667 records). [2025-10-17T19:17:11.142063] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-17T19:17:11.163146] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-17T19:17:11.478977] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:17:11.551727] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-17T19:17:11.551808] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-17T19:17:11.552754] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-17T19:17:11.552818] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-17T19:17:11.553986] [DEBUG] [LOCAL ] GTLS: Trimmed 61667 records to 43892 (keeping 200 days of data) [2025-10-17T19:17:11.805959] [DEBUG] [LOCAL ] GTLS: Primary data saved (43892 records). [2025-10-17T19:17:11.806086] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-17T19:17:11.806178] [INFO ] [MAIN ] Update Progress: 978/2368 symbols completed. GTLS took 30.2s. Estimated remaining: 3h 14m 54s. Rate: 7.1 symbols/min [2025-10-17T19:17:11.971779] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:11.969137] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-17T19:17:11.988961] [DEBUG] [LOCAL ] GUT: Loaded 15736 existing records from primary storage. [2025-10-17T19:17:11.989192] [INFO ] [MAIN ] GUT: Loaded 15736 existing records. [2025-10-17T19:17:12.162187] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:12.162417] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-17T19:17:12.162465] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-17T19:17:12.162740] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-17T19:17:12.162808] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-17T19:17:12.518113] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:12.534524] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T19:17:12.757990] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-17T19:17:13.052697] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:17:13.558011] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-17T19:17:13.763405] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T19:17:14.358043] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-17T19:17:15.003061] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T19:17:15.007861] [INFO ] [REMOTE ] GTY: Full fetch complete (43896 records). [2025-10-17T19:17:15.007990] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-17T19:17:15.164403] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-17T19:17:15.386090] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-17T19:17:15.386168] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-17T19:17:15.386908] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-17T19:17:15.386972] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-17T19:17:15.387972] [DEBUG] [LOCAL ] GTY: Trimmed 43896 records to 30765 (keeping 200 days of data) [2025-10-17T19:17:15.581012] [DEBUG] [LOCAL ] GTY: Primary data saved (30765 records). [2025-10-17T19:17:15.581245] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-17T19:17:15.581392] [INFO ] [MAIN ] Update Progress: 979/2368 symbols completed. GTY took 24.1s. Estimated remaining: 3h 14m 39s. Rate: 7.1 symbols/min [2025-10-17T19:17:15.756857] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:15.785931] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T19:17:15.824036] [DEBUG] [LOCAL ] GVA: Loaded 32925 existing records from primary storage. [2025-10-17T19:17:15.824325] [INFO ] [MAIN ] GVA: Loaded 32925 existing records. [2025-10-17T19:17:15.963223] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-17T19:17:16.003312] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:16.003516] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-17T19:17:16.003564] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-17T19:17:16.003781] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-17T19:17:16.003838] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-17T19:17:16.140395] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T19:17:16.380972] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:16.758037] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-17T19:17:16.979245] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-17T19:17:17.558039] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-17T19:17:17.597201] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T19:17:18.358087] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-17T19:17:19.068531] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:17:19.158040] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-17T19:17:19.933440] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:17:19.957988] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-17T19:17:20.632471] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:17:20.758033] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-17T19:17:21.452062] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:17:21.558047] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-17T19:17:21.874445] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:17:22.358047] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-17T19:17:22.907426] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:17:22.930988] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T19:17:23.158030] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-17T19:17:23.874784] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T19:17:23.958046] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-17T19:17:24.758058] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-17T19:17:25.010088] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:17:25.558033] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-17T19:17:26.347492] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:17:26.357974] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-17T19:17:26.454609] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T19:17:27.158066] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-17T19:17:27.883898] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:17:27.958027] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-17T19:17:27.985231] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T19:17:28.758054] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-17T19:17:29.546142] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:17:29.547068] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T19:17:29.557007] [INFO ] [REMOTE ] GTN: Full fetch complete (66069 records). [2025-10-17T19:17:29.557128] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-17T19:17:29.563134] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-17T19:17:29.950530] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-17T19:17:29.950622] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-17T19:17:29.951624] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-17T19:17:29.951721] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-17T19:17:29.953409] [DEBUG] [LOCAL ] GTN: Trimmed 66069 records to 45765 (keeping 200 days of data) [2025-10-17T19:17:30.217809] [DEBUG] [LOCAL ] GTN: Primary data saved (45765 records). [2025-10-17T19:17:30.217940] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-17T19:17:30.218593] [INFO ] [MAIN ] Update Progress: 980/2368 symbols completed. GTN took 43.3s. Estimated remaining: 3h 14m 39s. Rate: 7.1 symbols/min [2025-10-17T19:17:30.336348] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T19:17:30.366954] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-17T19:17:30.404768] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:30.428873] [DEBUG] [LOCAL ] GWH: Loaded 19024 existing records from primary storage. [2025-10-17T19:17:30.429157] [INFO ] [MAIN ] GWH: Loaded 19024 existing records. [2025-10-17T19:17:30.613746] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:30.614016] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-17T19:17:30.614087] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-17T19:17:30.614320] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-17T19:17:30.614384] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-17T19:17:30.958932] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:31.157987] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-17T19:17:31.352540] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:17:31.957988] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-17T19:17:32.025121] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T19:17:32.758004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-17T19:17:32.783007] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T19:17:32.784888] [INFO ] [REMOTE ] GUG: Full fetch complete (18955 records). [2025-10-17T19:17:32.784957] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-17T19:17:33.137912] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-17T19:17:33.137984] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-17T19:17:33.138350] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-17T19:17:33.138390] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-17T19:17:33.138953] [DEBUG] [LOCAL ] GUG: Trimmed 18955 records to 12286 (keeping 200 days of data) [2025-10-17T19:17:33.214803] [DEBUG] [LOCAL ] GUG: Primary data saved (12286 records). [2025-10-17T19:17:33.214938] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-17T19:17:33.215046] [INFO ] [MAIN ] Update Progress: 981/2368 symbols completed. GUG took 26.8s. Estimated remaining: 3h 14m 23s. Rate: 7.1 symbols/min [2025-10-17T19:17:33.391685] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:33.439813] [DEBUG] [LOCAL ] GWRE: Loaded 40226 existing records from primary storage. [2025-10-17T19:17:33.440170] [INFO ] [MAIN ] GWRE: Loaded 40226 existing records. [2025-10-17T19:17:33.561293] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-17T19:17:33.650812] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:33.651223] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-17T19:17:33.651291] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-17T19:17:33.651529] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-17T19:17:33.651600] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-17T19:17:34.069357] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T19:17:34.154403] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:34.358089] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-17T19:17:35.121390] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:17:35.158062] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-17T19:17:35.218753] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T19:17:35.804010] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T19:17:35.958043] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-17T19:17:36.758001] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-17T19:17:36.991683] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:17:37.435782] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T19:17:37.558028] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-17T19:17:38.358018] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-17T19:17:38.417465] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T19:17:39.158049] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-17T19:17:39.920565] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:17:39.958022] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-17T19:17:39.971526] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T19:17:40.758023] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-17T19:17:41.333266] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T19:17:41.466530] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T19:17:41.558037] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-17T19:17:42.358064] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-17T19:17:42.913626] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T19:17:43.158051] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-17T19:17:43.521274] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T19:17:43.958050] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-17T19:17:44.589065] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:17:44.758068] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-17T19:17:45.226367] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T19:17:45.558051] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-17T19:17:46.110225] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:17:46.358032] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-17T19:17:46.637694] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:17:47.158075] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-17T19:17:47.333358] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T19:17:47.958083] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-17T19:17:48.290487] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T19:17:48.758066] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-17T19:17:49.448125] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:17:49.558029] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-17T19:17:49.873917] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T19:17:50.358004] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-17T19:17:50.512221] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:17:51.158092] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-17T19:17:51.958031] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-17T19:17:52.020675] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:17:52.087088] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:17:52.758080] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-17T19:17:52.924791] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:17:53.504693] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:17:53.507673] [INFO ] [REMOTE ] GUT: Full fetch complete (22566 records). [2025-10-17T19:17:53.507788] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-17T19:17:53.563279] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-17T19:17:53.873368] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-17T19:17:53.873447] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-17T19:17:53.873930] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-17T19:17:53.873994] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-17T19:17:53.874595] [DEBUG] [LOCAL ] GUT: Trimmed 22566 records to 15859 (keeping 200 days of data) [2025-10-17T19:17:53.966239] [DEBUG] [LOCAL ] GUT: Primary data saved (15859 records). [2025-10-17T19:17:53.966388] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-17T19:17:53.966489] [INFO ] [MAIN ] Update Progress: 982/2368 symbols completed. GUT took 42.2s. Estimated remaining: 3h 14m 32s. Rate: 7.1 symbols/min [2025-10-17T19:17:54.137898] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:54.158225] [DEBUG] [LOCAL ] GWW: Loaded 19681 existing records from primary storage. [2025-10-17T19:17:54.158498] [INFO ] [MAIN ] GWW: Loaded 19681 existing records. [2025-10-17T19:17:54.334198] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:54.334414] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-17T19:17:54.334461] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-17T19:17:54.334633] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-17T19:17:54.334727] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-17T19:17:54.365077] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-17T19:17:54.694996] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:54.921088] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:17:55.158083] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-17T19:17:55.958124] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-17T19:17:56.065455] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T19:17:56.421131] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T19:17:56.427399] [INFO ] [REMOTE ] GWH: Full fetch complete (23794 records). [2025-10-17T19:17:56.427569] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-17T19:17:56.766757] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-17T19:17:56.814066] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-17T19:17:56.814149] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-17T19:17:56.814676] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-17T19:17:56.814735] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-17T19:17:56.815477] [DEBUG] [LOCAL ] GWH: Trimmed 23794 records to 19414 (keeping 200 days of data) [2025-10-17T19:17:56.922448] [DEBUG] [LOCAL ] GWH: Primary data saved (19414 records). [2025-10-17T19:17:56.922597] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-17T19:17:56.922706] [INFO ] [MAIN ] Update Progress: 983/2368 symbols completed. GWH took 26.7s. Estimated remaining: 3h 14m 16s. Rate: 7.1 symbols/min [2025-10-17T19:17:57.091707] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:57.140377] [DEBUG] [LOCAL ] GXO: Loaded 47088 existing records from primary storage. [2025-10-17T19:17:57.140710] [INFO ] [MAIN ] GXO: Loaded 47088 existing records. [2025-10-17T19:17:57.324746] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:57.325037] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-17T19:17:57.325092] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-17T19:17:57.325407] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-17T19:17:57.325463] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-17T19:17:57.565676] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-17T19:17:57.699367] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:57.727035] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T19:17:58.019941] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T19:17:58.358117] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-17T19:17:58.759938] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T19:17:58.765201] [INFO ] [REMOTE ] GVA: Full fetch complete (48436 records). [2025-10-17T19:17:58.765525] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-17T19:17:59.163534] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-17T19:17:59.214038] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-17T19:17:59.214155] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-17T19:17:59.215205] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-17T19:17:59.215274] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-17T19:17:59.216789] [DEBUG] [LOCAL ] GVA: Trimmed 48436 records to 33145 (keeping 200 days of data) [2025-10-17T19:17:59.447922] [DEBUG] [LOCAL ] GVA: Primary data saved (33145 records). [2025-10-17T19:17:59.448132] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-17T19:17:59.448258] [INFO ] [MAIN ] Update Progress: 984/2368 symbols completed. GVA took 43.9s. Estimated remaining: 3h 13m 60s. Rate: 7.1 symbols/min [2025-10-17T19:17:59.629070] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:59.633920] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-10-17T19:17:59.634122] [INFO ] [MAIN ] GYLD: Loaded 1553 existing records. [2025-10-17T19:17:59.821751] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:59.822053] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-17T19:17:59.822228] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-17T19:17:59.822524] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-17T19:17:59.822589] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-17T19:17:59.969539] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-17T19:18:00.164606] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:18:00.263006] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:00.758037] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-17T19:18:01.444923] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:18:01.498923] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-17T19:18:01.558006] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-17T19:18:02.329162] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:18:02.358054] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-17T19:18:03.158081] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-17T19:18:03.335338] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:18:03.600163] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T19:18:03.958044] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-17T19:18:04.103993] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:18:04.758010] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-17T19:18:05.158085] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:18:05.558041] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-17T19:18:06.360719] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-17T19:18:06.374683] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:18:06.672490] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:18:07.158040] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-17T19:18:07.834994] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:18:07.958035] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-17T19:18:08.758049] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-17T19:18:08.834632] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:18:09.203058] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T19:18:09.541037] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:18:09.557973] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-17T19:18:10.358087] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-17T19:18:11.084878] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:18:11.089960] [INFO ] [REMOTE ] GWRE: Full fetch complete (60304 records). [2025-10-17T19:18:11.090060] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-17T19:18:11.163240] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-17T19:18:11.473963] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-17T19:18:11.474100] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-17T19:18:11.474981] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-17T19:18:11.475046] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-17T19:18:11.476313] [DEBUG] [LOCAL ] GWRE: Trimmed 60304 records to 40437 (keeping 200 days of data) [2025-10-17T19:18:11.569484] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T19:18:11.725097] [DEBUG] [LOCAL ] GWRE: Primary data saved (40437 records). [2025-10-17T19:18:11.725260] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-17T19:18:11.725963] [INFO ] [MAIN ] Update Progress: 985/2368 symbols completed. GWRE took 38.5s. Estimated remaining: 3h 13m 57s. Rate: 7.1 symbols/min [2025-10-17T19:18:11.894123] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:11.894290] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-17T19:18:11.894329] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-17T19:18:11.894451] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-17T19:18:11.894514] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-17T19:18:11.894584] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-17T19:18:11.894631] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-17T19:18:11.962765] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-17T19:18:12.302743] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:12.298777] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T19:18:12.322270] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T19:18:12.758032] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-17T19:18:13.127598] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-17T19:18:13.558041] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-17T19:18:13.992725] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T19:18:14.358085] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-17T19:18:15.158034] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-17T19:18:15.344211] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T19:18:15.958091] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-17T19:18:16.358775] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T19:18:16.758010] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-17T19:18:17.125768] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T19:18:17.195989] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:18:17.558036] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-17T19:18:18.358091] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-17T19:18:19.112616] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:18:19.158092] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-17T19:18:19.474787] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T19:18:19.958027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-17T19:18:20.757996] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-17T19:18:20.841621] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:18:21.003726] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T19:18:21.275890] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T19:18:21.558057] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-17T19:18:22.358037] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-17T19:18:22.680224] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T19:18:22.683226] [INFO ] [REMOTE ] GWW: Full fetch complete (29138 records). [2025-10-17T19:18:22.683300] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-17T19:18:22.813475] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T19:18:23.069479] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-17T19:18:23.069554] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-17T19:18:23.070175] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-17T19:18:23.070237] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-17T19:18:23.070937] [DEBUG] [LOCAL ] GWW: Trimmed 29138 records to 19822 (keeping 200 days of data) [2025-10-17T19:18:23.160807] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-17T19:18:23.199006] [DEBUG] [LOCAL ] GWW: Primary data saved (19822 records). [2025-10-17T19:18:23.199141] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-17T19:18:23.199221] [INFO ] [MAIN ] Update Progress: 986/2368 symbols completed. GWW took 29.2s. Estimated remaining: 3h 13m 52s. Rate: 7.1 symbols/min [2025-10-17T19:18:23.366763] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:23.403206] [DEBUG] [LOCAL ] HAE: Loaded 39700 existing records from primary storage. [2025-10-17T19:18:23.403512] [INFO ] [MAIN ] HAE: Loaded 39700 existing records. [2025-10-17T19:18:23.578720] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:23.578927] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-17T19:18:23.578976] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-17T19:18:23.579199] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-17T19:18:23.579256] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-17T19:18:23.936881] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:23.957982] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-17T19:18:24.768481] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-17T19:18:24.773815] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T19:18:25.403956] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T19:18:25.425249] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:18:25.558002] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-17T19:18:26.358027] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-17T19:18:26.901328] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T19:18:26.902143] [INFO ] [REMOTE ] GYLD: Full fetch complete (2099 records). [2025-10-17T19:18:26.902210] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-17T19:18:27.104151] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:18:27.173556] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-17T19:18:27.299026] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-17T19:18:27.299106] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-17T19:18:27.299212] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-17T19:18:27.299251] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-17T19:18:27.299578] [DEBUG] [LOCAL ] GYLD: Trimmed 2099 records to 1562 (keeping 200 days of data) [2025-10-17T19:18:27.309391] [DEBUG] [LOCAL ] GYLD: Primary data saved (1562 records). [2025-10-17T19:18:27.309449] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-17T19:18:27.309516] [INFO ] [MAIN ] Update Progress: 987/2368 symbols completed. GYLD took 27.9s. Estimated remaining: 3h 13m 38s. Rate: 7.1 symbols/min [2025-10-17T19:18:27.475518] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:27.513578] [DEBUG] [LOCAL ] HAFN: Loaded 43242 existing records from primary storage. [2025-10-17T19:18:27.513916] [INFO ] [MAIN ] HAFN: Loaded 43242 existing records. [2025-10-17T19:18:27.689008] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:27.689199] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-17T19:18:27.689250] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-17T19:18:27.689531] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-17T19:18:27.689597] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-17T19:18:27.960729] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-17T19:18:28.040318] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:28.758032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-17T19:18:28.981268] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:18:29.558004] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-17T19:18:29.635148] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:18:30.111817] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:18:30.358030] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-17T19:18:31.167415] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-17T19:18:31.193044] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:18:31.958029] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-17T19:18:32.186253] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T19:18:32.758048] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-17T19:18:32.802974] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:18:33.506004] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:18:33.558039] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-17T19:18:34.324388] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T19:18:34.357987] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-17T19:18:35.139620] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:18:35.157999] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-17T19:18:35.517474] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T19:18:35.958055] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-17T19:18:36.591099] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:18:36.758006] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-17T19:18:37.558015] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-17T19:18:37.598377] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:18:38.358001] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-17T19:18:38.446798] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:18:39.091064] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:18:39.158105] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-17T19:18:39.953579] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:18:39.963109] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-17T19:18:40.758000] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-17T19:18:40.866872] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T19:18:41.442278] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:18:41.558005] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-17T19:18:42.358110] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-17T19:18:42.457348] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:18:43.158026] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-17T19:18:43.196016] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:18:43.477559] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:18:43.958027] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-17T19:18:44.753041] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T19:18:44.758699] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-17T19:18:44.760320] [INFO ] [REMOTE ] H: Full fetch complete (63021 records). [2025-10-17T19:18:44.760503] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-17T19:18:45.149551] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-17T19:18:45.149732] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-17T19:18:45.150693] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-17T19:18:45.150851] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-17T19:18:45.152132] [DEBUG] [LOCAL ] H: Trimmed 63021 records to 45047 (keeping 200 days of data) [2025-10-17T19:18:45.276024] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T19:18:45.454618] [DEBUG] [LOCAL ] H: Primary data saved (45047 records). [2025-10-17T19:18:45.454774] [INFO ] [MAIN ] H: Full history saved. [2025-10-17T19:18:45.454853] [INFO ] [MAIN ] Update Progress: 988/2368 symbols completed. H took 33.7s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-17T19:18:45.563189] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-17T19:18:45.623841] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:45.678902] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-17T19:18:45.679235] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-10-17T19:18:45.851247] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:45.851498] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-17T19:18:45.851543] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-17T19:18:45.851822] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-17T19:18:45.851878] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-17T19:18:46.206258] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:46.358042] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-17T19:18:46.537531] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T19:18:47.040088] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:18:47.158061] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-17T19:18:47.958095] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-17T19:18:48.265936] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:18:48.742506] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:18:48.757997] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-17T19:18:49.536561] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T19:18:49.557983] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-17T19:18:50.358042] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-17T19:18:50.422585] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T19:18:50.428744] [INFO ] [REMOTE ] GXO: Full fetch complete (69560 records). [2025-10-17T19:18:50.428847] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-17T19:18:50.807276] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-17T19:18:50.807384] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-17T19:18:50.808315] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-17T19:18:50.808379] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-17T19:18:50.809807] [DEBUG] [LOCAL ] GXO: Trimmed 69560 records to 47418 (keeping 200 days of data) [2025-10-17T19:18:51.087952] [DEBUG] [LOCAL ] GXO: Primary data saved (47418 records). [2025-10-17T19:18:51.088335] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-17T19:18:51.089158] [INFO ] [MAIN ] Update Progress: 989/2368 symbols completed. GXO took 54.2s. Estimated remaining: 3h 13m 31s. Rate: 7.1 symbols/min [2025-10-17T19:18:51.163007] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-17T19:18:51.283989] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:18:51.287236] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:51.346001] [DEBUG] [LOCAL ] HASI: Loaded 48039 existing records from primary storage. [2025-10-17T19:18:51.346314] [INFO ] [MAIN ] HASI: Loaded 48039 existing records. [2025-10-17T19:18:51.528359] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:51.528663] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-17T19:18:51.528727] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-17T19:18:51.529250] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-17T19:18:51.529309] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-17T19:18:51.900634] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:51.924681] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T19:18:51.957996] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-17T19:18:52.758021] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-17T19:18:53.121260] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T19:18:53.529033] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:18:53.558024] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-17T19:18:54.349018] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:18:54.358234] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-17T19:18:55.158040] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-17T19:18:55.206204] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T19:18:55.930191] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:18:55.957983] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-17T19:18:56.689619] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:18:56.758013] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-17T19:18:57.551870] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:18:57.558024] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-17T19:18:57.557917] [INFO ] [REMOTE ] HAFN: Full fetch complete (64878 records). [2025-10-17T19:18:57.558231] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-17T19:18:57.971397] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-17T19:18:57.971478] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-17T19:18:57.972413] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-17T19:18:57.972483] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-17T19:18:57.973936] [DEBUG] [LOCAL ] HAFN: Trimmed 64878 records to 43553 (keeping 200 days of data) [2025-10-17T19:18:58.227585] [DEBUG] [LOCAL ] HAFN: Primary data saved (43553 records). [2025-10-17T19:18:58.227741] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-17T19:18:58.227832] [INFO ] [MAIN ] Update Progress: 990/2368 symbols completed. HAFN took 30.9s. Estimated remaining: 3h 13m 21s. Rate: 7.1 symbols/min [2025-10-17T19:18:58.367101] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-17T19:18:58.429806] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:58.432380] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:18:58.485239] [DEBUG] [LOCAL ] HAYW: Loaded 49275 existing records from primary storage. [2025-10-17T19:18:58.485562] [INFO ] [MAIN ] HAYW: Loaded 49275 existing records. [2025-10-17T19:18:58.657906] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:58.658146] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-17T19:18:58.658193] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-17T19:18:58.658394] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-17T19:18:58.658449] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-17T19:18:59.010003] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:59.157985] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-17T19:18:59.602497] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T19:18:59.941269] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T19:18:59.947397] [INFO ] [REMOTE ] HAE: Full fetch complete (59081 records). [2025-10-17T19:18:59.947616] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-17T19:18:59.968792] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-17T19:19:00.378137] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-17T19:19:00.378253] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-17T19:19:00.379299] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-17T19:19:00.379390] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-17T19:19:00.381045] [DEBUG] [LOCAL ] HAE: Trimmed 59081 records to 40001 (keeping 200 days of data) [2025-10-17T19:19:00.636679] [DEBUG] [LOCAL ] HAE: Primary data saved (40001 records). [2025-10-17T19:19:00.636896] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-17T19:19:00.637095] [INFO ] [MAIN ] Update Progress: 991/2368 symbols completed. HAE took 37.4s. Estimated remaining: 3h 13m 4s. Rate: 7.1 symbols/min [2025-10-17T19:19:00.762516] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-17T19:19:00.855408] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:00.893281] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:19:00.908401] [DEBUG] [LOCAL ] HBB: Loaded 6511 existing records from primary storage. [2025-10-17T19:19:00.908664] [INFO ] [MAIN ] HBB: Loaded 6511 existing records. [2025-10-17T19:19:01.092086] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:01.092306] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-17T19:19:01.092354] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-17T19:19:01.092542] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-17T19:19:01.092599] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-17T19:19:01.443726] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:01.558021] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-17T19:19:02.358136] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-17T19:19:02.656463] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-17T19:19:02.705933] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:19:02.965370] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T19:19:03.160027] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-17T19:19:03.162637] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T19:19:03.958043] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-17T19:19:04.719274] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:19:04.758032] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-17T19:19:05.558016] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-17T19:19:05.681907] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:19:06.251875] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T19:19:06.357999] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-17T19:19:07.158039] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-17T19:19:07.605324] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T19:19:07.958058] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-17T19:19:08.033075] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:19:08.758012] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-17T19:19:08.831070] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T19:19:09.557996] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-17T19:19:09.727918] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:19:10.212992] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T19:19:10.320055] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:19:10.357996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-17T19:19:11.158092] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-17T19:19:11.859228] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:19:11.958062] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-17T19:19:12.758083] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-17T19:19:12.911472] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:19:13.558039] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-17T19:19:13.857734] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T19:19:14.155487] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:19:14.329196] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:19:14.358031] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-17T19:19:15.150867] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T19:19:15.158019] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-17T19:19:15.958033] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-17T19:19:16.758016] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-17T19:19:16.787257] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T19:19:17.564981] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-17T19:19:17.587900] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:19:18.358002] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-17T19:19:18.855973] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T19:19:18.905493] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T19:19:19.158039] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-17T19:19:19.958016] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-17T19:19:20.037444] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:19:20.758014] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-17T19:19:20.783937] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T19:19:21.074842] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:19:21.558024] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-17T19:19:22.158697] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T19:19:22.358007] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-17T19:19:22.756029] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T19:19:22.764422] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-17T19:19:22.764628] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-17T19:19:23.167828] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-17T19:19:23.164008] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-17T19:19:23.168095] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-17T19:19:23.169768] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-17T19:19:23.169936] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-17T19:19:23.171437] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54498 (keeping 200 days of data) [2025-10-17T19:19:23.549519] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-17T19:19:23.549697] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-17T19:19:23.549809] [INFO ] [MAIN ] Update Progress: 992/2368 symbols completed. HAL took 38.1s. Estimated remaining: 3h 13m 16s. Rate: 7.1 symbols/min [2025-10-17T19:19:23.747851] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:23.803470] [DEBUG] [LOCAL ] HBI: Loaded 53362 existing records from primary storage. [2025-10-17T19:19:23.803899] [INFO ] [MAIN ] HBI: Loaded 53362 existing records. [2025-10-17T19:19:23.965873] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-17T19:19:24.012436] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:24.013902] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-17T19:19:24.013998] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-17T19:19:24.020970] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-17T19:19:24.021156] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-17T19:19:24.052274] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T19:19:24.227261] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:19:24.332232] [INFO ] [REMOTE ] HAYW: Full fetch complete (70913 records). [2025-10-17T19:19:24.349526] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-17T19:19:24.560489] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:24.765546] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-17T19:19:24.872522] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-17T19:19:24.872599] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-17T19:19:24.873520] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-17T19:19:24.873583] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-17T19:19:24.874965] [DEBUG] [LOCAL ] HAYW: Trimmed 70913 records to 49622 (keeping 200 days of data) [2025-10-17T19:19:25.164967] [DEBUG] [LOCAL ] HAYW: Primary data saved (49622 records). [2025-10-17T19:19:25.165103] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-17T19:19:25.165208] [INFO ] [MAIN ] Update Progress: 993/2368 symbols completed. HAYW took 26.9s. Estimated remaining: 3h 12m 58s. Rate: 7.1 symbols/min [2025-10-17T19:19:25.332266] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:25.366632] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T19:19:25.386598] [DEBUG] [LOCAL ] HBM: Loaded 53348 existing records from primary storage. [2025-10-17T19:19:25.386934] [INFO ] [MAIN ] HBM: Loaded 53348 existing records. [2025-10-17T19:19:25.568124] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:25.560892] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-17T19:19:25.569622] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-17T19:19:25.569785] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-17T19:19:25.570067] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-17T19:19:25.570129] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-17T19:19:25.957230] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T19:19:25.987814] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:26.225807] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T19:19:26.358028] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-17T19:19:27.158138] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-17T19:19:27.957998] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-17T19:19:28.000400] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:19:28.758073] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-17T19:19:28.812678] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T19:19:28.914440] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:19:29.558021] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-17T19:19:30.358015] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-17T19:19:30.785837] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T19:19:30.792555] [INFO ] [REMOTE ] HASI: Full fetch complete (68420 records). [2025-10-17T19:19:30.792841] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-17T19:19:30.950124] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:19:31.170435] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-17T19:19:31.195996] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-17T19:19:31.196101] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-17T19:19:31.197360] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-17T19:19:31.197680] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-17T19:19:31.199463] [DEBUG] [LOCAL ] HASI: Trimmed 68420 records to 48399 (keeping 200 days of data) [2025-10-17T19:19:31.356376] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T19:19:31.558857] [DEBUG] [LOCAL ] HASI: Primary data saved (48399 records). [2025-10-17T19:19:31.558994] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-17T19:19:31.559628] [INFO ] [MAIN ] Update Progress: 994/2368 symbols completed. HASI took 40.5s. Estimated remaining: 3h 12m 47s. Rate: 7.1 symbols/min [2025-10-17T19:19:31.746297] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:31.792279] [DEBUG] [LOCAL ] HCA: Loaded 47337 existing records from primary storage. [2025-10-17T19:19:31.792618] [INFO ] [MAIN ] HCA: Loaded 47337 existing records. [2025-10-17T19:19:31.961180] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-17T19:19:31.964849] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:31.966136] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-17T19:19:31.966199] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-17T19:19:31.966406] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-17T19:19:31.966462] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-17T19:19:32.311177] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:32.616736] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T19:19:32.617937] [INFO ] [REMOTE ] HBB: Full fetch complete (9309 records). [2025-10-17T19:19:32.618008] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-17T19:19:32.760478] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-17T19:19:32.995785] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T19:19:33.036734] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-17T19:19:33.036811] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-17T19:19:33.037043] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-17T19:19:33.037083] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-17T19:19:33.037560] [DEBUG] [LOCAL ] HBB: Trimmed 9309 records to 6540 (keeping 200 days of data) [2025-10-17T19:19:33.075817] [DEBUG] [LOCAL ] HBB: Primary data saved (6540 records). [2025-10-17T19:19:33.075903] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-17T19:19:33.075974] [INFO ] [MAIN ] Update Progress: 995/2368 symbols completed. HBB took 32.4s. Estimated remaining: 3h 12m 29s. Rate: 7.1 symbols/min [2025-10-17T19:19:33.240944] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:33.282184] [DEBUG] [LOCAL ] HCC: Loaded 45525 existing records from primary storage. [2025-10-17T19:19:33.282500] [INFO ] [MAIN ] HCC: Loaded 45525 existing records. [2025-10-17T19:19:33.466325] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:33.466552] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-17T19:19:33.466600] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-17T19:19:33.466811] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-17T19:19:33.466866] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-17T19:19:33.567632] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-17T19:19:33.853025] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:34.358104] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-17T19:19:34.587439] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T19:19:35.158044] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-17T19:19:35.255799] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T19:19:35.873941] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:19:35.958000] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-17T19:19:36.508255] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:19:36.758070] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-17T19:19:37.471825] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T19:19:37.558035] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-17T19:19:38.358039] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-17T19:19:38.502254] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T19:19:39.157993] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-17T19:19:39.401076] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:19:39.958983] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-17T19:19:39.958863] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:19:40.758005] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-17T19:19:41.001539] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:19:41.499183] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:19:41.558006] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-17T19:19:42.358004] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-17T19:19:42.677385] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T19:19:43.102696] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:19:43.158023] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-17T19:19:43.958081] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-17T19:19:44.164962] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T19:19:44.758099] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-17T19:19:44.849063] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:19:45.558064] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-17T19:19:45.683024] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:19:46.358083] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-17T19:19:46.726236] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:19:47.158049] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-17T19:19:47.399035] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:19:47.918203] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:19:47.957995] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-17T19:19:48.758082] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-17T19:19:48.931480] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:19:49.558044] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-17T19:19:49.733431] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:19:50.358030] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-17T19:19:50.817082] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T19:19:51.158030] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-17T19:19:51.607619] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T19:19:51.858687] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T19:19:51.957999] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-17T19:19:52.758019] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-17T19:19:53.052678] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T19:19:53.558044] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-17T19:19:53.679453] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:19:54.358007] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-17T19:19:54.794497] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:19:55.157998] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-17T19:19:55.356594] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T19:19:55.958033] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-17T19:19:56.245788] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T19:19:56.758000] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-17T19:19:56.797793] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:19:57.558016] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-17T19:19:57.681815] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T19:19:58.178312] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:19:58.358027] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-17T19:19:58.812987] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:19:59.158078] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-17T19:19:59.948625] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T19:19:59.958054] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-17T19:20:00.758004] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-17T19:20:01.084502] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T19:20:01.558073] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-17T19:20:01.985700] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T19:20:01.993903] [INFO ] [REMOTE ] HBI: Full fetch complete (77020 records). [2025-10-17T19:20:01.994088] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-17T19:20:02.365719] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-17T19:20:02.411922] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-17T19:20:02.412108] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-17T19:20:02.413343] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-17T19:20:02.413417] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-17T19:20:02.415337] [DEBUG] [LOCAL ] HBI: Trimmed 77020 records to 53738 (keeping 200 days of data) [2025-10-17T19:20:02.726556] [DEBUG] [LOCAL ] HBI: Primary data saved (53738 records). [2025-10-17T19:20:02.726731] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-17T19:20:02.726822] [INFO ] [MAIN ] Update Progress: 996/2368 symbols completed. HBI took 39.2s. Estimated remaining: 3h 12m 49s. Rate: 7.1 symbols/min [2025-10-17T19:20:02.900487] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:02.922935] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T19:20:02.930761] [INFO ] [REMOTE ] HCA: Full fetch complete (68908 records). [2025-10-17T19:20:02.930975] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-17T19:20:03.108684] [DEBUG] [LOCAL ] HCI: Loaded 14289 existing records from primary storage. [2025-10-17T19:20:03.110797] [INFO ] [MAIN ] HCI: Loaded 14289 existing records. [2025-10-17T19:20:03.577993] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-17T19:20:03.584310] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:03.584816] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-17T19:20:03.585026] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-17T19:20:03.584932] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-17T19:20:03.586301] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-17T19:20:03.585337] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-17T19:20:03.586499] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-17T19:20:03.586748] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-17T19:20:03.689825] [DEBUG] [LOCAL ] HCA: Trimmed 68908 records to 47654 (keeping 200 days of data) [2025-10-17T19:20:04.210006] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-17T19:20:04.207516] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:04.222699] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-17T19:20:04.222971] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-17T19:20:04.269326] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T19:20:04.342222] [DEBUG] [LOCAL ] HCA: Primary data saved (47654 records). [2025-10-17T19:20:04.342353] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-17T19:20:04.342957] [INFO ] [MAIN ] Update Progress: 997/2368 symbols completed. HCA took 32.8s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-10-17T19:20:04.758118] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-17T19:20:05.247003] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T19:20:05.558048] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-17T19:20:06.216769] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T19:20:06.224311] [INFO ] [REMOTE ] HBM: Full fetch complete (76711 records). [2025-10-17T19:20:06.224438] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-17T19:20:06.467262] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T19:20:06.497715] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-17T19:20:06.631926] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-17T19:20:06.632077] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-17T19:20:06.633067] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-17T19:20:06.633130] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-17T19:20:06.634600] [DEBUG] [LOCAL ] HBM: Trimmed 76711 records to 53738 (keeping 200 days of data) [2025-10-17T19:20:06.733534] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T19:20:06.743714] [INFO ] [REMOTE ] HCC: Full fetch complete (64861 records). [2025-10-17T19:20:06.751165] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-17T19:20:07.389454] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-17T19:20:07.389724] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-17T19:20:07.390729] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-17T19:20:07.389593] [DEBUG] [LOCAL ] HBM: Primary data saved (53738 records). [2025-10-17T19:20:07.390812] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-17T19:20:07.391138] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-17T19:20:07.391255] [INFO ] [MAIN ] Update Progress: 998/2368 symbols completed. HBM took 42.2s. Estimated remaining: 3h 12m 16s. Rate: 7.1 symbols/min [2025-10-17T19:20:07.392314] [DEBUG] [LOCAL ] HCC: Trimmed 64861 records to 45791 (keeping 200 days of data) [2025-10-17T19:20:07.491186] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T19:20:07.511441] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-17T19:20:07.679251] [DEBUG] [LOCAL ] HCC: Primary data saved (45791 records). [2025-10-17T19:20:07.679403] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-17T19:20:07.679488] [INFO ] [MAIN ] Update Progress: 999/2368 symbols completed. HCC took 34.6s. Estimated remaining: 3h 11m 56s. Rate: 7.1 symbols/min [2025-10-17T19:20:08.517732] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:20:08.521021] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-17T19:20:09.524332] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:20:09.528004] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-17T19:20:10.360007] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T19:20:10.363731] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-17T19:20:11.431393] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T19:20:11.435700] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-17T19:20:12.512211] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:20:12.516128] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-17T19:20:13.362342] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T19:20:13.365794] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-17T19:20:14.231933] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T19:20:14.235373] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-17T19:20:14.994294] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T19:20:14.996771] [INFO ] [REMOTE ] HCI: Full fetch complete (19636 records). [2025-10-17T19:20:14.996846] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-17T19:20:15.386144] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-17T19:20:15.386226] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-17T19:20:15.386697] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-17T19:20:15.386762] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-17T19:20:15.387402] [DEBUG] [LOCAL ] HCI: Trimmed 19636 records to 14354 (keeping 200 days of data) [2025-10-17T19:20:15.476210] [DEBUG] [LOCAL ] HCI: Primary data saved (14354 records). [2025-10-17T19:20:15.476337] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-17T19:20:15.476418] [INFO ] [MAIN ] Update Progress: 1000/2368 symbols completed. HCI took 12.7s. Estimated remaining: 3h 11m 47s. Rate: 7.1 symbols/min [2025-10-17T19:20:16.171152] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.170214] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.172719] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.191939] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.193199] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-17T19:20:16.193307] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-17T19:20:16.193471] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-17T19:20:16.193537] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-17T19:20:16.193598] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-17T19:20:16.193682] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-17T19:20:16.521542] [DEBUG] [LOCAL ] HE: Loaded 49287 existing records from primary storage. [2025-10-17T19:20:16.538054] [INFO ] [MAIN ] HE: Loaded 49287 existing records. [2025-10-17T19:20:16.618042] [DEBUG] [LOCAL ] HD: Loaded 53874 existing records from primary storage. [2025-10-17T19:20:16.624504] [INFO ] [MAIN ] HD: Loaded 53874 existing records. [2025-10-17T19:20:16.730228] [DEBUG] [LOCAL ] HDB: Loaded 52321 existing records from primary storage. [2025-10-17T19:20:16.857056] [INFO ] [MAIN ] HDB: Loaded 52321 existing records. [2025-10-17T19:20:16.881701] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:16.903129] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-17T19:20:17.102354] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:17.120408] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-17T19:20:17.138584] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:17.149792] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-17T19:20:17.149427] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-17T19:20:17.160411] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-17T19:20:17.160519] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-17T19:20:17.170884] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-17T19:20:17.176155] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-17T19:20:17.210903] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-17T19:20:17.284947] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:17.341498] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-17T19:20:17.360787] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-17T19:20:17.399560] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-17T19:20:17.399688] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-17T19:20:17.514249] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T19:20:17.538637] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-17T19:20:18.055715] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-17T19:20:18.080406] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-17T19:20:18.249991] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:18.274538] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-17T19:20:18.324481] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:18.361093] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-17T19:20:18.368051] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:18.368617] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-17T19:20:18.499514] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-17T19:20:18.500306] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-17T19:20:18.821421] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-17T19:20:19.158023] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-17T19:20:19.386187] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-17T19:20:19.957986] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-17T19:20:20.107476] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:20:20.152578] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T19:20:20.211561] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-17T19:20:20.457238] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T19:20:20.758014] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-17T19:20:21.558031] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-17T19:20:22.358000] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-17T19:20:22.594877] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-17T19:20:22.631307] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:20:23.157990] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-17T19:20:23.391258] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-17T19:20:23.419994] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T19:20:23.958037] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-17T19:20:24.758030] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-17T19:20:25.540911] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:20:25.557984] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-17T19:20:26.358013] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-17T19:20:26.446373] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T19:20:27.076063] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:20:27.158067] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-17T19:20:27.399337] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-17T19:20:27.958021] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-17T19:20:28.141982] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T19:20:28.198175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-17T19:20:28.758048] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-17T19:20:29.072962] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-17T19:20:29.073844] [INFO ] [REMOTE ] HCXY: Full fetch complete (514 records). [2025-10-17T19:20:29.073921] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-17T19:20:29.074333] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T19:20:29.074423] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:20:29.074494] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:20:29.074573] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-17T19:20:29.074753] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-17T19:20:29.074808] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-17T19:20:29.074853] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-17T19:20:29.074915] [INFO ] [MAIN ] Update Progress: 1001/2368 symbols completed. HCXY took 13.6s. Estimated remaining: 3h 11m 46s. Rate: 7.1 symbols/min [2025-10-17T19:20:29.247965] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:29.283296] [DEBUG] [LOCAL ] HEI: Loaded 31397 existing records from primary storage. [2025-10-17T19:20:29.283573] [INFO ] [MAIN ] HEI: Loaded 31397 existing records. [2025-10-17T19:20:29.456637] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:29.456882] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-17T19:20:29.456930] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-17T19:20:29.457322] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-17T19:20:29.457386] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-17T19:20:29.563091] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-17T19:20:29.819159] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:30.358007] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-17T19:20:30.463932] [DEBUG] [REMOTE ] HEI: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-17T19:20:30.464182] [WARN ] [REMOTE ] HEI: No data returned for month 2024-12 [2025-10-17T19:20:30.464270] [FATAL] [REMOTE ] HEI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:20:30.464323] [FATAL] [MAIN ] HEI: Failed to fetch primary data. [2025-10-17T19:20:30.464360] [WARN ] [MAIN ] HEI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:20:30.464430] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-17T19:20:30.464494] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-17T19:20:30.464532] [INFO ] [LOCAL ] HEI: Starting deletion of derivative data. [2025-10-17T19:20:30.464705] [DEBUG] [LOCAL ] HEI: Deleted derivative data file. [2025-10-17T19:20:30.465176] [INFO ] [MAIN ] Update Progress: 1002/2368 symbols completed. HEI took 1.4s. Estimated remaining: 3h 11m 28s. Rate: 7.1 symbols/min [2025-10-17T19:20:30.632276] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:30.642548] [DEBUG] [LOCAL ] HEQ: Loaded 6834 existing records from primary storage. [2025-10-17T19:20:30.642804] [INFO ] [MAIN ] HEQ: Loaded 6834 existing records. [2025-10-17T19:20:30.824956] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:30.825131] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-17T19:20:30.825203] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-17T19:20:30.825378] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-17T19:20:30.825435] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-17T19:20:31.171692] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-17T19:20:31.177901] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:31.404591] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T19:20:31.958041] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-17T19:20:32.701021] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T19:20:32.757982] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-17T19:20:33.558069] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-17T19:20:34.063328] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T19:20:34.153515] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T19:20:34.358007] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-17T19:20:34.704095] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T19:20:35.029167] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T19:20:35.158092] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-17T19:20:35.958070] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-17T19:20:36.758029] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-17T19:20:37.294008] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T19:20:37.558005] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-17T19:20:37.648850] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:20:38.358005] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-17T19:20:38.482532] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T19:20:38.513035] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T19:20:39.158115] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-17T19:20:39.958060] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-17T19:20:40.510302] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T19:20:40.758002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-17T19:20:40.930190] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:20:41.558090] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-17T19:20:41.678119] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:20:42.358024] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-17T19:20:42.869585] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T19:20:43.158020] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-17T19:20:43.264254] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:20:43.761330] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:20:43.958000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-17T19:20:44.078519] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:20:44.696508] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T19:20:44.758000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-17T19:20:45.405465] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T19:20:45.558013] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-17T19:20:46.358073] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-17T19:20:46.932390] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T19:20:47.158017] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-17T19:20:47.255505] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:20:47.909259] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:20:47.957989] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-17T19:20:48.572800] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T19:20:48.758061] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-17T19:20:49.558020] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-17T19:20:49.565735] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:20:50.358038] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-17T19:20:51.137220] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T19:20:51.139498] [INFO ] [REMOTE ] HEQ: Full fetch complete (9611 records). [2025-10-17T19:20:51.139630] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-17T19:20:51.163169] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-17T19:20:51.551268] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-17T19:20:51.551915] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-17T19:20:51.552246] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-17T19:20:51.556253] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-17T19:20:51.556126] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T19:20:51.567981] [DEBUG] [LOCAL ] HEQ: Trimmed 9611 records to 6898 (keeping 200 days of data) [2025-10-17T19:20:51.609736] [DEBUG] [LOCAL ] HEQ: Primary data saved (6898 records). [2025-10-17T19:20:51.609861] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-17T19:20:51.609951] [INFO ] [MAIN ] Update Progress: 1003/2368 symbols completed. HEQ took 21.1s. Estimated remaining: 3h 11m 37s. Rate: 7.1 symbols/min [2025-10-17T19:20:51.785972] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:51.831179] [DEBUG] [LOCAL ] HESM: Loaded 48904 existing records from primary storage. [2025-10-17T19:20:51.831486] [INFO ] [MAIN ] HESM: Loaded 48904 existing records. [2025-10-17T19:20:51.963287] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-17T19:20:52.013253] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:52.013518] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-17T19:20:52.013575] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-17T19:20:52.014364] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-17T19:20:52.014424] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-17T19:20:52.364924] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:52.758039] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-17T19:20:52.890999] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:20:53.558029] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-17T19:20:53.753093] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T19:20:53.815119] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T19:20:54.358041] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-17T19:20:55.158019] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-17T19:20:55.228494] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:20:55.958042] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-17T19:20:56.170402] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:20:56.178252] [INFO ] [REMOTE ] HE: Full fetch complete (72169 records). [2025-10-17T19:20:56.178435] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-17T19:20:56.569746] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-17T19:20:56.569868] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-17T19:20:56.571081] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-17T19:20:56.571148] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-17T19:20:56.572678] [DEBUG] [LOCAL ] HE: Trimmed 72169 records to 49612 (keeping 200 days of data) [2025-10-17T19:20:56.776841] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-17T19:20:56.862293] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:20:56.907085] [DEBUG] [LOCAL ] HE: Primary data saved (49612 records). [2025-10-17T19:20:56.907252] [INFO ] [MAIN ] HE: Full history saved. [2025-10-17T19:20:56.907371] [INFO ] [MAIN ] Update Progress: 1004/2368 symbols completed. HE took 41.4s. Estimated remaining: 3h 11m 24s. Rate: 7.1 symbols/min [2025-10-17T19:20:57.082973] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:57.083167] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-17T19:20:57.083210] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-17T19:20:57.083323] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-17T19:20:57.083366] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-17T19:20:57.083410] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-17T19:20:57.083443] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-17T19:20:57.440994] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:57.558019] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-17T19:20:57.624435] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:20:57.631930] [INFO ] [REMOTE ] HDB: Full fetch complete (75628 records). [2025-10-17T19:20:57.632130] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-17T19:20:58.026838] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-17T19:20:58.026930] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-17T19:20:58.027945] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-17T19:20:58.028012] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-17T19:20:58.029505] [DEBUG] [LOCAL ] HDB: Trimmed 75628 records to 52710 (keeping 200 days of data) [2025-10-17T19:20:58.345728] [DEBUG] [LOCAL ] HDB: Primary data saved (52710 records). [2025-10-17T19:20:58.345878] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-17T19:20:58.345961] [INFO ] [MAIN ] Update Progress: 1005/2368 symbols completed. HDB took 42.8s. Estimated remaining: 3h 11m 6s. Rate: 7.1 symbols/min [2025-10-17T19:20:58.378028] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-17T19:20:58.522487] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:58.522661] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-17T19:20:58.522720] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-17T19:20:58.522831] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-17T19:20:58.522874] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-17T19:20:58.522918] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-17T19:20:58.522952] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-17T19:20:58.806184] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T19:20:58.886447] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:58.921597] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T19:20:58.957677] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T19:20:59.158071] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-17T19:20:59.435207] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-17T19:20:59.958019] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-17T19:21:00.330618] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T19:21:00.758095] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-17T19:21:01.558113] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-17T19:21:01.876015] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-17T19:21:02.358061] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-17T19:21:02.600041] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-17T19:21:02.764961] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T19:21:03.158040] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-17T19:21:03.418429] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-17T19:21:03.958040] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-17T19:21:04.758093] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-17T19:21:05.001927] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-17T19:21:05.558023] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-17T19:21:05.887829] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T19:21:06.163883] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-17T19:21:06.358049] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-17T19:21:07.158039] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-17T19:21:07.963102] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-17T19:21:07.978053] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:21:08.219313] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-17T19:21:08.758097] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-17T19:21:09.004383] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-17T19:21:09.296889] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T19:21:09.558028] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-17T19:21:10.358075] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-17T19:21:10.592304] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-17T19:21:11.158008] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-17T19:21:11.286779] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:21:11.663927] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T19:21:11.671307] [INFO ] [REMOTE ] HD: Full fetch complete (77562 records). [2025-10-17T19:21:11.671441] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-17T19:21:11.963346] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-17T19:21:12.069407] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-17T19:21:12.069500] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-17T19:21:12.070482] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-17T19:21:12.070547] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-17T19:21:12.073146] [DEBUG] [LOCAL ] HD: Trimmed 77562 records to 54264 (keeping 200 days of data) [2025-10-17T19:21:12.266321] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-17T19:21:12.413458] [DEBUG] [LOCAL ] HD: Primary data saved (54264 records). [2025-10-17T19:21:12.413596] [INFO ] [MAIN ] HD: Full history saved. [2025-10-17T19:21:12.413699] [INFO ] [MAIN ] Update Progress: 1006/2368 symbols completed. HD took 56.9s. Estimated remaining: 3h 11m 5s. Rate: 7.1 symbols/min [2025-10-17T19:21:12.584405] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:12.603137] [DEBUG] [LOCAL ] HFRO: Loaded 16982 existing records from primary storage. [2025-10-17T19:21:12.603399] [INFO ] [MAIN ] HFRO: Loaded 16982 existing records. [2025-10-17T19:21:12.758017] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-17T19:21:12.778315] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:12.779337] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-17T19:21:12.779384] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-17T19:21:12.779680] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-17T19:21:12.779749] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-17T19:21:13.125165] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:13.558079] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-17T19:21:13.981847] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-17T19:21:14.358049] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-17T19:21:14.540718] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:21:15.158133] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-17T19:21:15.239025] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T19:21:15.958050] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-17T19:21:16.758068] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-17T19:21:16.915429] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T19:21:17.072554] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T19:21:17.153685] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-17T19:21:17.154426] [INFO ] [REMOTE ] HF: Full fetch complete (436 records). [2025-10-17T19:21:17.154517] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-17T19:21:17.334843] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-17T19:21:17.335031] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:21:17.335100] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:21:17.335171] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-17T19:21:17.335236] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-17T19:21:17.335272] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-17T19:21:17.335311] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-17T19:21:17.335367] [INFO ] [MAIN ] Update Progress: 1007/2368 symbols completed. HF took 20.4s. Estimated remaining: 3h 10m 52s. Rate: 7.1 symbols/min [2025-10-17T19:21:17.522152] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:17.539312] [DEBUG] [LOCAL ] HGER: Loaded 15086 existing records from primary storage. [2025-10-17T19:21:17.539572] [INFO ] [MAIN ] HGER: Loaded 15086 existing records. [2025-10-17T19:21:17.563108] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-17T19:21:17.739066] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:17.739291] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-17T19:21:17.739340] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-17T19:21:17.739532] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-17T19:21:17.739597] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-17T19:21:18.123158] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:18.358030] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-17T19:21:19.158076] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-17T19:21:19.294971] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:21:19.431552] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-17T19:21:19.640174] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:21:19.958113] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-17T19:21:20.542493] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T19:21:20.758026] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-17T19:21:21.086915] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-17T19:21:21.558026] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-17T19:21:22.358007] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-17T19:21:22.604850] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:21:23.158026] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-17T19:21:23.888896] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T19:21:23.958026] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-17T19:21:24.151291] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T19:21:24.266616] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-17T19:21:24.758033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-17T19:21:25.458697] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T19:21:25.558026] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-17T19:21:26.358062] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-17T19:21:26.956477] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:21:27.158027] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-17T19:21:27.395519] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T19:21:27.402989] [INFO ] [REMOTE ] HESM: Full fetch complete (69700 records). [2025-10-17T19:21:27.403173] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-17T19:21:27.843512] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-17T19:21:27.843678] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-17T19:21:27.844813] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-17T19:21:27.844921] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-17T19:21:27.846896] [DEBUG] [LOCAL ] HESM: Trimmed 69700 records to 49235 (keeping 200 days of data) [2025-10-17T19:21:27.958734] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-17T19:21:28.180316] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T19:21:28.202118] [DEBUG] [LOCAL ] HESM: Primary data saved (49235 records). [2025-10-17T19:21:28.202275] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-17T19:21:28.202918] [INFO ] [MAIN ] Update Progress: 1008/2368 symbols completed. HESM took 36.6s. Estimated remaining: 3h 10m 47s. Rate: 7.1 symbols/min [2025-10-17T19:21:28.385754] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:28.397292] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T19:21:28.403722] [DEBUG] [LOCAL ] HGLB: Loaded 9718 existing records from primary storage. [2025-10-17T19:21:28.404007] [INFO ] [MAIN ] HGLB: Loaded 9718 existing records. [2025-10-17T19:21:28.607706] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:28.607952] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-17T19:21:28.608014] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-17T19:21:28.608214] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-17T19:21:28.608267] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-17T19:21:28.767243] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-17T19:21:28.995095] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:29.562139] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-17T19:21:29.565712] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T19:21:30.358024] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-17T19:21:30.414328] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:21:30.796972] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:21:31.158022] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-17T19:21:31.575335] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-17T19:21:31.958018] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-17T19:21:32.670160] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T19:21:32.758033] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-17T19:21:33.558041] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-17T19:21:33.569499] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T19:21:34.356632] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T19:21:34.359554] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-17T19:21:35.145546] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T19:21:35.157984] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-17T19:21:35.947393] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T19:21:35.958006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-17T19:21:36.675532] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T19:21:36.758083] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-17T19:21:37.503298] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T19:21:37.557990] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-17T19:21:38.293967] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T19:21:38.358079] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-17T19:21:39.158008] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-17T19:21:39.216192] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T19:21:39.629825] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T19:21:39.630631] [INFO ] [REMOTE ] HFND: Full fetch complete (1758 records). [2025-10-17T19:21:39.630735] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-17T19:21:39.839766] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T19:21:39.839914] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:21:39.839982] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:21:39.840073] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-17T19:21:39.840156] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-17T19:21:39.840212] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-17T19:21:39.840286] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-17T19:21:39.840356] [INFO ] [MAIN ] Update Progress: 1009/2368 symbols completed. HFND took 41.5s. Estimated remaining: 3h 10m 43s. Rate: 7.1 symbols/min [2025-10-17T19:21:39.963194] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-17T19:21:40.009352] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:40.025171] [DEBUG] [LOCAL ] HGTY: Loaded 13424 existing records from primary storage. [2025-10-17T19:21:40.025401] [INFO ] [MAIN ] HGTY: Loaded 13424 existing records. [2025-10-17T19:21:40.196916] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:40.197091] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-17T19:21:40.197137] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-17T19:21:40.197292] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-17T19:21:40.197372] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-17T19:21:40.535878] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:40.758039] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-17T19:21:40.933763] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T19:21:41.538010] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T19:21:41.557977] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-17T19:21:42.358008] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-17T19:21:42.416339] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T19:21:42.418438] [INFO ] [REMOTE ] HGLB: Full fetch complete (14662 records). [2025-10-17T19:21:42.418506] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-17T19:21:42.781084] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-17T19:21:42.781172] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-17T19:21:42.781487] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-17T19:21:42.781527] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-17T19:21:42.782122] [DEBUG] [LOCAL ] HGLB: Trimmed 14662 records to 9785 (keeping 200 days of data) [2025-10-17T19:21:42.840664] [DEBUG] [LOCAL ] HGLB: Primary data saved (9785 records). [2025-10-17T19:21:42.840806] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-17T19:21:42.840889] [INFO ] [MAIN ] Update Progress: 1010/2368 symbols completed. HGLB took 14.6s. Estimated remaining: 3h 10m 27s. Rate: 7.1 symbols/min [2025-10-17T19:21:43.014100] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:43.059035] [DEBUG] [LOCAL ] HGV: Loaded 46673 existing records from primary storage. [2025-10-17T19:21:43.059364] [INFO ] [MAIN ] HGV: Loaded 46673 existing records. [2025-10-17T19:21:43.159689] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-17T19:21:43.241686] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:43.241965] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-17T19:21:43.242097] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-17T19:21:43.250360] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-17T19:21:43.251034] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T19:21:43.250779] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-17T19:21:43.622241] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:43.958041] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-17T19:21:44.172017] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T19:21:44.737713] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T19:21:44.758056] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-17T19:21:45.558000] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-17T19:21:45.636181] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T19:21:46.358026] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-17T19:21:47.040703] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T19:21:47.120692] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:21:47.157984] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-17T19:21:47.929988] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T19:21:47.958045] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-17T19:21:48.758076] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-17T19:21:48.966176] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:21:49.165821] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T19:21:49.558027] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-17T19:21:50.358067] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-17T19:21:50.483588] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T19:21:51.158072] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-17T19:21:51.324716] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T19:21:51.922783] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:21:51.958011] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-17T19:21:52.729226] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T19:21:52.758062] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-17T19:21:53.480345] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T19:21:53.558035] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-17T19:21:54.311885] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:21:54.358074] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-17T19:21:55.158058] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-17T19:21:55.858633] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T19:21:55.957984] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-17T19:21:56.160863] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T19:21:56.758093] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-17T19:21:57.451862] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:21:57.558036] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-17T19:21:57.829211] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T19:21:58.083128] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T19:21:58.358006] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-17T19:21:59.158007] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-17T19:21:59.356903] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T19:21:59.958031] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-17T19:22:00.173211] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:22:00.175674] [INFO ] [REMOTE ] HFRO: Full fetch complete (27584 records). [2025-10-17T19:22:00.175763] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-17T19:22:00.550579] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-17T19:22:00.550681] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-17T19:22:00.551322] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-17T19:22:00.551386] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-17T19:22:00.552156] [DEBUG] [LOCAL ] HFRO: Trimmed 27584 records to 17015 (keeping 200 days of data) [2025-10-17T19:22:00.657198] [DEBUG] [LOCAL ] HFRO: Primary data saved (17015 records). [2025-10-17T19:22:00.657382] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-17T19:22:00.657499] [INFO ] [MAIN ] Update Progress: 1011/2368 symbols completed. HFRO took 48.2s. Estimated remaining: 3h 10m 31s. Rate: 7.1 symbols/min [2025-10-17T19:22:00.763234] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-17T19:22:00.839895] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:00.873730] [DEBUG] [LOCAL ] HHH: Loaded 33409 existing records from primary storage. [2025-10-17T19:22:00.874038] [INFO ] [MAIN ] HHH: Loaded 33409 existing records. [2025-10-17T19:22:01.060277] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:01.060466] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-17T19:22:01.060514] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-17T19:22:01.060728] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-17T19:22:01.060788] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-17T19:22:01.440063] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:01.452959] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:22:01.558033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-17T19:22:02.358052] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-17T19:22:02.792957] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T19:22:02.795841] [INFO ] [REMOTE ] HGTY: Full fetch complete (17577 records). [2025-10-17T19:22:02.795916] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-17T19:22:03.000300] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:22:03.081963] [INFO ] [REMOTE ] HGER: Full fetch complete (18452 records). [2025-10-17T19:22:03.093288] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-17T19:22:03.163088] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-17T19:22:03.333525] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-17T19:22:03.357765] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-17T19:22:03.366919] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-17T19:22:03.368892] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-17T19:22:03.408824] [DEBUG] [LOCAL ] HGTY: Trimmed 17577 records to 13543 (keeping 200 days of data) [2025-10-17T19:22:03.660576] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T19:22:03.672520] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-17T19:22:03.679674] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-17T19:22:03.680417] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-17T19:22:03.680857] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-17T19:22:03.687954] [DEBUG] [LOCAL ] HGER: Trimmed 18452 records to 15286 (keeping 200 days of data) [2025-10-17T19:22:03.737829] [DEBUG] [LOCAL ] HGTY: Primary data saved (13543 records). [2025-10-17T19:22:03.757942] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-17T19:22:03.769218] [INFO ] [MAIN ] Update Progress: 1012/2368 symbols completed. HGTY took 23.9s. Estimated remaining: 3h 10m 16s. Rate: 7.1 symbols/min [2025-10-17T19:22:03.794508] [DEBUG] [LOCAL ] HGER: Primary data saved (15286 records). [2025-10-17T19:22:03.825711] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-17T19:22:03.846001] [INFO ] [MAIN ] Update Progress: 1013/2368 symbols completed. HGER took 46.5s. Estimated remaining: 3h 9m 56s. Rate: 7.1 symbols/min [2025-10-17T19:22:03.961304] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-17T19:22:04.090075] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:04.140174] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:04.173320] [DEBUG] [LOCAL ] HI: Loaded 36147 existing records from primary storage. [2025-10-17T19:22:04.173682] [INFO ] [MAIN ] HI: Loaded 36147 existing records. [2025-10-17T19:22:04.366516] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:04.382441] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-17T19:22:04.382549] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-17T19:22:04.383571] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-17T19:22:04.383531] [DEBUG] [LOCAL ] HIG: Loaded 51580 existing records from primary storage. [2025-10-17T19:22:04.383698] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-17T19:22:04.415363] [INFO ] [MAIN ] HIG: Loaded 51580 existing records. [2025-10-17T19:22:04.823521] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:04.841192] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-17T19:22:04.862458] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-17T19:22:04.873603] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-17T19:22:04.884115] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-17T19:22:04.979700] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:04.985415] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-17T19:22:05.160127] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T19:22:05.353718] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:05.488686] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T19:22:05.558034] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-17T19:22:06.358007] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-17T19:22:06.396567] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:22:06.896916] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T19:22:07.158018] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-17T19:22:07.958009] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-17T19:22:08.103015] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:22:08.432935] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T19:22:08.758038] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-17T19:22:08.819971] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T19:22:09.558006] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-17T19:22:10.359420] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-17T19:22:10.363288] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T19:22:11.158053] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-17T19:22:11.226082] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:22:11.712988] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T19:22:11.958022] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-17T19:22:12.639006] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:22:12.758271] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-17T19:22:12.953210] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T19:22:13.558024] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-17T19:22:14.358058] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-17T19:22:14.512456] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:22:14.834466] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T19:22:15.158020] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-17T19:22:15.835403] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:22:15.958012] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-17T19:22:16.747114] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:22:16.757974] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-17T19:22:17.522884] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:22:17.558026] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-17T19:22:18.358004] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-17T19:22:18.554127] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T19:22:18.878296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T19:22:19.158030] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-17T19:22:19.529438] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:22:19.958067] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-17T19:22:20.758068] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-17T19:22:20.843247] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:22:21.558076] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-17T19:22:21.845592] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T19:22:22.182256] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T19:22:22.188354] [INFO ] [REMOTE ] HGV: Full fetch complete (65953 records). [2025-10-17T19:22:22.188543] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-17T19:22:22.363528] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-17T19:22:22.586818] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-17T19:22:22.586927] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-17T19:22:22.587917] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-17T19:22:22.587982] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-17T19:22:22.589382] [DEBUG] [LOCAL ] HGV: Trimmed 65953 records to 46933 (keeping 200 days of data) [2025-10-17T19:22:22.866292] [DEBUG] [LOCAL ] HGV: Primary data saved (46933 records). [2025-10-17T19:22:22.866435] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-17T19:22:22.866977] [INFO ] [MAIN ] Update Progress: 1014/2368 symbols completed. HGV took 40.0s. Estimated remaining: 3h 10m 2s. Rate: 7.1 symbols/min [2025-10-17T19:22:23.041484] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:23.065076] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:22:23.103673] [DEBUG] [LOCAL ] HII: Loaded 34070 existing records from primary storage. [2025-10-17T19:22:23.104019] [INFO ] [MAIN ] HII: Loaded 34070 existing records. [2025-10-17T19:22:23.168181] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-17T19:22:23.320702] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:23.320986] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-17T19:22:23.321035] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-17T19:22:23.321594] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-17T19:22:23.321682] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-17T19:22:23.680889] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:23.913455] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:22:23.957991] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-17T19:22:24.636088] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T19:22:24.758015] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-17T19:22:25.511484] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:22:25.557991] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-17T19:22:26.103980] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:22:26.358041] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-17T19:22:26.724083] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T19:22:27.158047] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-17T19:22:27.813280] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:22:27.958102] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-17T19:22:28.128331] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T19:22:28.758100] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-17T19:22:29.417598] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:22:29.558043] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-17T19:22:30.093891] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:22:30.358049] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-17T19:22:31.152496] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:22:31.160602] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-17T19:22:31.958028] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-17T19:22:32.054889] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:22:32.190879] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T19:22:32.195180] [INFO ] [REMOTE ] HHH: Full fetch complete (46024 records). [2025-10-17T19:22:32.195264] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-17T19:22:32.565255] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-17T19:22:32.565329] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-17T19:22:32.566021] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-17T19:22:32.566083] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-17T19:22:32.567053] [DEBUG] [LOCAL ] HHH: Trimmed 46024 records to 33589 (keeping 200 days of data) [2025-10-17T19:22:32.763270] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-17T19:22:32.763362] [DEBUG] [LOCAL ] HHH: Primary data saved (33589 records). [2025-10-17T19:22:32.763539] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-17T19:22:32.763677] [INFO ] [MAIN ] Update Progress: 1015/2368 symbols completed. HHH took 32.1s. Estimated remaining: 3h 9m 56s. Rate: 7.1 symbols/min [2025-10-17T19:22:32.930888] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:32.979947] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-17T19:22:32.980271] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-10-17T19:22:33.157068] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:33.157277] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-17T19:22:33.157352] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-17T19:22:33.157598] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-17T19:22:33.157687] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-17T19:22:33.508413] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:33.557988] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-17T19:22:33.731166] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T19:22:34.018450] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T19:22:34.358062] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-17T19:22:35.158028] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-17T19:22:35.470298] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:22:35.958034] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-17T19:22:36.758006] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-17T19:22:36.861177] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-17T19:22:36.957366] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T19:22:37.546011] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:22:37.557972] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-17T19:22:37.802621] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T19:22:38.358012] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-17T19:22:39.158038] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-17T19:22:39.429575] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T19:22:39.930225] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T19:22:39.935837] [INFO ] [REMOTE ] HI: Full fetch complete (50807 records). [2025-10-17T19:22:39.935945] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-17T19:22:39.967796] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-17T19:22:40.328410] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-17T19:22:40.328478] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-17T19:22:40.329262] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-17T19:22:40.329324] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-17T19:22:40.330490] [DEBUG] [LOCAL ] HI: Trimmed 50807 records to 36524 (keeping 200 days of data) [2025-10-17T19:22:40.553806] [DEBUG] [LOCAL ] HI: Primary data saved (36524 records). [2025-10-17T19:22:40.553933] [INFO ] [MAIN ] HI: Full history saved. [2025-10-17T19:22:40.554010] [INFO ] [MAIN ] Update Progress: 1016/2368 symbols completed. HI took 36.8s. Estimated remaining: 3h 9m 46s. Rate: 7.1 symbols/min [2025-10-17T19:22:40.718755] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:22:40.751373] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:40.757981] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-17T19:22:40.777708] [DEBUG] [LOCAL ] HIO: Loaded 24541 existing records from primary storage. [2025-10-17T19:22:40.777944] [INFO ] [MAIN ] HIO: Loaded 24541 existing records. [2025-10-17T19:22:40.959406] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:40.959591] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-17T19:22:40.959636] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-17T19:22:40.959842] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-17T19:22:40.959883] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-17T19:22:41.310439] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:41.557978] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-17T19:22:42.244751] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:22:42.327887] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T19:22:42.360005] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-17T19:22:42.362743] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-17T19:22:43.158017] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-17T19:22:43.805724] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:22:43.957991] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-17T19:22:44.041384] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T19:22:44.048301] [INFO ] [REMOTE ] HIG: Full fetch complete (73536 records). [2025-10-17T19:22:44.048418] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-17T19:22:44.459517] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-17T19:22:44.459597] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-17T19:22:44.460554] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-17T19:22:44.460617] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-17T19:22:44.462005] [DEBUG] [LOCAL ] HIG: Trimmed 73536 records to 51943 (keeping 200 days of data) [2025-10-17T19:22:44.763694] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-17T19:22:44.785725] [DEBUG] [LOCAL ] HIG: Primary data saved (51943 records). [2025-10-17T19:22:44.785813] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-17T19:22:44.786707] [INFO ] [MAIN ] Update Progress: 1017/2368 symbols completed. HIG took 40.9s. Estimated remaining: 3h 9m 32s. Rate: 7.1 symbols/min [2025-10-17T19:22:44.954901] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:44.976561] [DEBUG] [LOCAL ] HIPO: Loaded 21976 existing records from primary storage. [2025-10-17T19:22:44.976841] [INFO ] [MAIN ] HIPO: Loaded 21976 existing records. [2025-10-17T19:22:45.148688] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:45.148891] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-17T19:22:45.148937] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-17T19:22:45.149121] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-17T19:22:45.149176] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-17T19:22:45.491985] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:45.557980] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-17T19:22:46.124501] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:22:46.358004] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-17T19:22:46.466517] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-17T19:22:46.648279] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T19:22:47.158012] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-17T19:22:47.571447] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T19:22:47.958036] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-17T19:22:48.758086] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-17T19:22:49.404590] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T19:22:49.558026] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-17T19:22:49.696155] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-17T19:22:49.976339] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T19:22:50.358060] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-17T19:22:50.702541] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:22:50.707201] [INFO ] [REMOTE ] HII: Full fetch complete (52482 records). [2025-10-17T19:22:50.707350] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-17T19:22:51.093200] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-17T19:22:51.093280] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-17T19:22:51.094099] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-17T19:22:51.094169] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-17T19:22:51.096014] [DEBUG] [LOCAL ] HII: Trimmed 52482 records to 34269 (keeping 200 days of data) [2025-10-17T19:22:51.161970] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-17T19:22:51.316335] [DEBUG] [LOCAL ] HII: Primary data saved (34269 records). [2025-10-17T19:22:51.316467] [INFO ] [MAIN ] HII: Full history saved. [2025-10-17T19:22:51.317100] [INFO ] [MAIN ] Update Progress: 1018/2368 symbols completed. HII took 28.4s. Estimated remaining: 3h 9m 21s. Rate: 7.1 symbols/min [2025-10-17T19:22:51.450587] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:22:51.502618] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:51.543455] [DEBUG] [LOCAL ] HIW: Loaded 44926 existing records from primary storage. [2025-10-17T19:22:51.543774] [INFO ] [MAIN ] HIW: Loaded 44926 existing records. [2025-10-17T19:22:51.719106] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:51.719317] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-17T19:22:51.719365] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-17T19:22:51.719580] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-17T19:22:51.719679] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-17T19:22:51.970252] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-17T19:22:52.089991] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:52.758046] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-17T19:22:53.558038] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-17T19:23:05.984893] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (14.82 seconds). [2025-10-17T19:23:05.991847] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-17T19:23:07.752568] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (14.19 seconds). [2025-10-17T19:23:07.761598] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-17T19:23:09.025017] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (17.05 seconds). [2025-10-17T19:23:09.030024] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-17T19:23:09.212119] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (16.45 seconds). [2025-10-17T19:23:09.223845] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-17T19:23:09.250863] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-10-17T19:23:09.256931] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-17T19:23:10.271061] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-17T19:23:10.280369] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-17T19:23:10.527102] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:23:10.545270] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-17T19:23:10.544510] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:23:10.551549] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-17T19:23:11.550169] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:23:11.555315] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-17T19:23:11.634742] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T19:23:11.640632] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-17T19:23:11.757694] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-17T19:23:11.769905] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-17T19:23:11.809174] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:23:11.818976] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-17T19:23:12.670072] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T19:23:12.675129] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-17T19:23:12.732129] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:23:12.738014] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-17T19:23:13.336363] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:23:13.346384] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-17T19:23:13.476763] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:23:13.482623] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-17T19:23:13.892124] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:23:13.898798] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-17T19:23:14.347567] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-17T19:23:14.358454] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-17T19:23:14.729521] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T19:23:14.735816] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-17T19:23:14.991794] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:23:14.999089] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-17T19:23:15.333901] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:23:15.343713] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-17T19:23:16.045231] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:23:16.052322] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-17T19:23:16.072107] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T19:23:16.077222] [INFO ] [REMOTE ] HIO: Full fetch complete (37949 records). [2025-10-17T19:23:16.077369] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-17T19:23:16.454351] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-17T19:23:16.454451] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-17T19:23:16.455162] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-17T19:23:16.455223] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-17T19:23:16.456052] [DEBUG] [LOCAL ] HIO: Trimmed 37949 records to 24778 (keeping 200 days of data) [2025-10-17T19:23:16.595830] [DEBUG] [LOCAL ] HIO: Primary data saved (24778 records). [2025-10-17T19:23:16.596003] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-17T19:23:16.596088] [INFO ] [MAIN ] Update Progress: 1019/2368 symbols completed. HIO took 36.0s. Estimated remaining: 3h 9m 35s. Rate: 7.1 symbols/min [2025-10-17T19:23:16.767082] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:16.787827] [DEBUG] [LOCAL ] HIX: Loaded 20590 existing records from primary storage. [2025-10-17T19:23:16.788070] [INFO ] [MAIN ] HIX: Loaded 20590 existing records. [2025-10-17T19:23:16.972158] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:16.972504] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-17T19:23:16.972571] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-17T19:23:16.973273] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-17T19:23:16.973442] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-17T19:23:17.165792] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:23:17.284025] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T19:23:17.285047] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-17T19:23:17.306707] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-17T19:23:17.360981] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-17T19:23:17.402254] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-17T19:23:17.468565] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:17.468965] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-17T19:23:18.324509] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:23:18.327181] [INFO ] [REMOTE ] HIPO: Full fetch complete (31162 records). [2025-10-17T19:23:18.327251] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-17T19:23:18.700704] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-17T19:23:18.701018] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-17T19:23:18.707635] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-17T19:23:18.717690] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-17T19:23:18.719209] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:23:18.725956] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-17T19:23:18.727251] [DEBUG] [LOCAL ] HIPO: Trimmed 31162 records to 22131 (keeping 200 days of data) [2025-10-17T19:23:18.857481] [DEBUG] [LOCAL ] HIPO: Primary data saved (22131 records). [2025-10-17T19:23:18.857622] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-17T19:23:18.857743] [INFO ] [MAIN ] Update Progress: 1020/2368 symbols completed. HIPO took 34.1s. Estimated remaining: 3h 9m 19s. Rate: 7.1 symbols/min [2025-10-17T19:23:19.062588] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:19.064147] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:23:19.073883] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-17T19:23:19.091338] [DEBUG] [LOCAL ] HKD: Loaded 18776 existing records from primary storage. [2025-10-17T19:23:19.091989] [INFO ] [MAIN ] HKD: Loaded 18776 existing records. [2025-10-17T19:23:19.270397] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:19.270716] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-17T19:23:19.270776] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-17T19:23:19.271006] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-17T19:23:19.271063] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-17T19:23:19.634730] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:19.635164] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-17T19:23:19.873166] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T19:23:19.878631] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-17T19:23:20.119635] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-17T19:23:20.132200] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-17T19:23:20.604116] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:23:20.619630] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-17T19:23:20.743724] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:23:20.752996] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-17T19:23:20.929852] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:23:20.934483] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-17T19:23:21.940669] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:23:21.945080] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-17T19:23:22.159423] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T19:23:22.199670] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T19:23:22.358058] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-17T19:23:22.780111] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-17T19:23:23.022203] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T19:23:23.158032] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-17T19:23:23.958099] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-17T19:23:24.011699] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T19:23:24.758073] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-17T19:23:25.145214] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T19:23:25.558030] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-17T19:23:25.686790] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-17T19:23:25.694067] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-17T19:23:25.694194] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-17T19:23:26.078535] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-17T19:23:26.078613] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-17T19:23:26.079597] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-17T19:23:26.079684] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-17T19:23:26.081152] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54597 (keeping 200 days of data) [2025-10-17T19:23:26.358326] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-17T19:23:26.454713] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T19:23:26.462778] [INFO ] [REMOTE ] HIW: Full fetch complete (64841 records). [2025-10-17T19:23:26.465243] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-17T19:23:26.465384] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-17T19:23:26.465541] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-17T19:23:26.465884] [INFO ] [MAIN ] Update Progress: 1021/2368 symbols completed. HIMS took 53.7s. Estimated remaining: 3h 9m 9s. Rate: 7.1 symbols/min [2025-10-17T19:23:26.847943] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T19:23:26.857102] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:27.072828] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-17T19:23:27.073032] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-17T19:23:27.074013] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-17T19:23:27.074160] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-17T19:23:27.089434] [DEBUG] [LOCAL ] HIW: Trimmed 64841 records to 45201 (keeping 200 days of data) [2025-10-17T19:23:27.181372] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-17T19:23:27.204570] [DEBUG] [LOCAL ] HL: Loaded 54065 existing records from primary storage. [2025-10-17T19:23:27.208442] [INFO ] [MAIN ] HL: Loaded 54065 existing records. [2025-10-17T19:23:27.484783] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:27.485103] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-17T19:23:27.510524] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-17T19:23:27.521244] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-17T19:23:27.521585] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-17T19:23:27.570754] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:23:27.914048] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:27.958442] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-17T19:23:27.964469] [DEBUG] [LOCAL ] HIW: Primary data saved (45201 records). [2025-10-17T19:23:27.964723] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-17T19:23:27.965409] [INFO ] [MAIN ] Update Progress: 1022/2368 symbols completed. HIW took 36.6s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-17T19:23:28.137286] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:28.193148] [DEBUG] [LOCAL ] HLF: Loaded 48878 existing records from primary storage. [2025-10-17T19:23:28.193476] [INFO ] [MAIN ] HLF: Loaded 48878 existing records. [2025-10-17T19:23:28.315838] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T19:23:28.388919] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:28.389138] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-17T19:23:28.389187] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-17T19:23:28.389451] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-17T19:23:28.389507] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-17T19:23:28.738970] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:28.757980] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-17T19:23:29.558023] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-17T19:23:29.838499] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T19:23:30.317100] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:23:30.336831] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T19:23:30.358000] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-17T19:23:31.158013] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-17T19:23:31.775479] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:23:31.958037] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-17T19:23:32.758036] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-17T19:23:32.903635] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T19:23:33.075387] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T19:23:33.558042] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-17T19:23:33.845697] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:23:34.358125] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-17T19:23:35.167524] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-17T19:23:35.175549] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:23:35.325234] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:23:35.958032] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-17T19:23:36.758078] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-17T19:23:37.054998] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T19:23:37.232727] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T19:23:37.558009] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-17T19:23:37.871193] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T19:23:38.358083] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-17T19:23:39.158036] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-17T19:23:39.380351] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T19:23:39.473515] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T19:23:39.958103] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-17T19:23:40.098685] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T19:23:40.102060] [INFO ] [REMOTE ] HKD: Full fetch complete (28201 records). [2025-10-17T19:23:40.102176] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-17T19:23:40.481252] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-17T19:23:40.481326] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-17T19:23:40.481899] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-17T19:23:40.481971] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-17T19:23:40.482637] [DEBUG] [LOCAL ] HKD: Trimmed 28201 records to 18952 (keeping 200 days of data) [2025-10-17T19:23:40.587249] [DEBUG] [LOCAL ] HKD: Primary data saved (18952 records). [2025-10-17T19:23:40.587413] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-17T19:23:40.587511] [INFO ] [MAIN ] Update Progress: 1023/2368 symbols completed. HKD took 21.7s. Estimated remaining: 3h 8m 49s. Rate: 7.1 symbols/min [2025-10-17T19:23:40.768883] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-17T19:23:40.770065] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:40.772867] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:23:40.819706] [DEBUG] [LOCAL ] HLI: Loaded 31106 existing records from primary storage. [2025-10-17T19:23:40.820014] [INFO ] [MAIN ] HLI: Loaded 31106 existing records. [2025-10-17T19:23:40.996176] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:40.996407] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-17T19:23:40.996484] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-17T19:23:40.996771] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-17T19:23:40.996841] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-17T19:23:41.343496] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:41.558020] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-17T19:23:42.325737] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:23:42.357977] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-17T19:23:42.528825] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T19:23:43.158117] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-17T19:23:43.958078] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-17T19:23:44.033373] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:23:44.585960] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:23:44.758073] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-17T19:23:45.042438] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T19:23:45.045518] [INFO ] [REMOTE ] HIX: Full fetch complete (29863 records). [2025-10-17T19:23:45.045598] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-17T19:23:45.408217] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-17T19:23:45.408298] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-17T19:23:45.408919] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-17T19:23:45.408980] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-17T19:23:45.409748] [DEBUG] [LOCAL ] HIX: Trimmed 29863 records to 20696 (keeping 200 days of data) [2025-10-17T19:23:45.526189] [DEBUG] [LOCAL ] HIX: Primary data saved (20696 records). [2025-10-17T19:23:45.526321] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-17T19:23:45.526399] [INFO ] [MAIN ] Update Progress: 1024/2368 symbols completed. HIX took 28.9s. Estimated remaining: 3h 8m 36s. Rate: 7.1 symbols/min [2025-10-17T19:23:45.563213] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-17T19:23:45.702230] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:45.731461] [DEBUG] [LOCAL ] HLIO: Loaded 28465 existing records from primary storage. [2025-10-17T19:23:45.731749] [INFO ] [MAIN ] HLIO: Loaded 28465 existing records. [2025-10-17T19:23:45.906470] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:45.906733] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-17T19:23:45.906787] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-17T19:23:45.906980] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-17T19:23:45.907035] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-17T19:23:46.256938] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:46.358016] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-17T19:23:46.668840] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:23:46.880357] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T19:23:46.972942] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T19:23:47.158065] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-17T19:23:47.957997] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-17T19:23:48.189579] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T19:23:48.758108] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-17T19:23:49.250585] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T19:23:49.558003] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-17T19:23:49.698623] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:23:50.358081] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-17T19:23:51.158059] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-17T19:23:51.420731] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T19:23:51.613727] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T19:23:51.958030] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-17T19:23:52.636227] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:23:52.758032] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-17T19:23:53.308257] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:23:53.558063] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-17T19:23:54.358015] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-17T19:23:54.471406] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:23:54.755435] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:23:55.158085] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-17T19:23:55.958013] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-17T19:23:56.308733] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T19:23:56.553297] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:23:56.758047] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-17T19:23:57.203367] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T19:23:57.558095] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-17T19:23:58.358101] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-17T19:23:58.771412] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T19:23:58.830664] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T19:23:59.158086] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-17T19:23:59.633238] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T19:23:59.958083] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-17T19:24:00.156345] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T19:24:00.758048] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-17T19:24:01.558000] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-17T19:24:01.757204] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:24:02.358061] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-17T19:24:02.586630] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T19:24:03.158067] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-17T19:24:03.581068] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T19:24:03.663072] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:24:03.958022] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-17T19:24:04.758069] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-17T19:24:04.970906] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:24:04.977739] [INFO ] [REMOTE ] HLF: Full fetch complete (70963 records). [2025-10-17T19:24:04.977904] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-17T19:24:05.366809] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-17T19:24:05.366910] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-17T19:24:05.367973] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-17T19:24:05.368039] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-17T19:24:05.369468] [DEBUG] [LOCAL ] HLF: Trimmed 70963 records to 49226 (keeping 200 days of data) [2025-10-17T19:24:05.565824] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-17T19:24:05.651337] [DEBUG] [LOCAL ] HLF: Primary data saved (49226 records). [2025-10-17T19:24:05.651474] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-17T19:24:05.652195] [INFO ] [MAIN ] Update Progress: 1025/2368 symbols completed. HLF took 37.7s. Estimated remaining: 3h 8m 43s. Rate: 7.1 symbols/min [2025-10-17T19:24:05.825174] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:05.860418] [DEBUG] [LOCAL ] HLLY: Loaded 33658 existing records from primary storage. [2025-10-17T19:24:05.860732] [INFO ] [MAIN ] HLLY: Loaded 33658 existing records. [2025-10-17T19:24:06.049800] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:06.050436] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-17T19:24:06.050545] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-17T19:24:06.077781] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-17T19:24:06.092959] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-17T19:24:06.141263] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-17T19:24:06.283754] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:24:06.366888] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-17T19:24:06.515809] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:06.937685] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:24:07.158081] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-17T19:24:07.958020] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-17T19:24:08.499993] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T19:24:08.578849] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-17T19:24:08.758052] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-17T19:24:09.296847] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:24:09.557993] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-17T19:24:10.000351] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:24:10.358039] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-17T19:24:10.903363] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T19:24:10.908055] [INFO ] [REMOTE ] HLI: Full fetch complete (45284 records). [2025-10-17T19:24:10.908203] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-17T19:24:11.159352] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-17T19:24:11.288452] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-17T19:24:11.288533] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-17T19:24:11.289296] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-17T19:24:11.289358] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-17T19:24:11.290348] [DEBUG] [LOCAL ] HLI: Trimmed 45284 records to 31316 (keeping 200 days of data) [2025-10-17T19:24:11.407786] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:24:11.515188] [DEBUG] [LOCAL ] HLI: Primary data saved (31316 records). [2025-10-17T19:24:11.515364] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-17T19:24:11.515454] [INFO ] [MAIN ] Update Progress: 1026/2368 symbols completed. HLI took 30.9s. Estimated remaining: 3h 8m 31s. Rate: 7.1 symbols/min [2025-10-17T19:24:11.684787] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:11.738914] [DEBUG] [LOCAL ] HLN: Loaded 53512 existing records from primary storage. [2025-10-17T19:24:11.739258] [INFO ] [MAIN ] HLN: Loaded 53512 existing records. [2025-10-17T19:24:11.914869] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:11.915106] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-17T19:24:11.915153] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-17T19:24:11.915410] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-17T19:24:11.915465] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-17T19:24:11.963265] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-17T19:24:12.297877] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:12.424520] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T19:24:12.758224] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-17T19:24:13.558104] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-17T19:24:14.067271] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:24:14.156740] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T19:24:14.165242] [INFO ] [REMOTE ] HL: Full fetch complete (77824 records). [2025-10-17T19:24:14.165461] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-17T19:24:14.372849] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-17T19:24:14.580502] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-17T19:24:14.580602] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-17T19:24:14.581673] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-17T19:24:14.581742] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-17T19:24:14.583279] [DEBUG] [LOCAL ] HL: Trimmed 77824 records to 54455 (keeping 200 days of data) [2025-10-17T19:24:14.910734] [DEBUG] [LOCAL ] HL: Primary data saved (54455 records). [2025-10-17T19:24:14.910884] [INFO ] [MAIN ] HL: Full history saved. [2025-10-17T19:24:14.910984] [INFO ] [MAIN ] Update Progress: 1027/2368 symbols completed. HL took 48.4s. Estimated remaining: 3h 8m 16s. Rate: 7.1 symbols/min [2025-10-17T19:24:15.079954] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:15.130994] [DEBUG] [LOCAL ] HLT: Loaded 50910 existing records from primary storage. [2025-10-17T19:24:15.131316] [INFO ] [MAIN ] HLT: Loaded 50910 existing records. [2025-10-17T19:24:15.163118] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-17T19:24:15.322829] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:15.323291] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-17T19:24:15.323490] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-17T19:24:15.324150] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-17T19:24:15.324214] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-17T19:24:15.455251] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T19:24:15.724456] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:15.940748] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:24:15.957982] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-17T19:24:16.269780] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:24:16.758030] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-17T19:24:17.276351] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T19:24:17.558034] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-17T19:24:18.357205] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T19:24:18.366895] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-17T19:24:19.158015] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-17T19:24:19.381181] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T19:24:19.465624] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T19:24:19.958039] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-17T19:24:20.371928] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T19:24:20.377913] [INFO ] [REMOTE ] HLIO: Full fetch complete (37014 records). [2025-10-17T19:24:20.378137] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-17T19:24:20.755421] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-17T19:24:20.755494] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-17T19:24:20.756180] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-17T19:24:20.756242] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-17T19:24:20.757060] [DEBUG] [LOCAL ] HLIO: Trimmed 37014 records to 28680 (keeping 200 days of data) [2025-10-17T19:24:20.758207] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-17T19:24:20.934164] [DEBUG] [LOCAL ] HLIO: Primary data saved (28680 records). [2025-10-17T19:24:20.934298] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-17T19:24:20.934389] [INFO ] [MAIN ] Update Progress: 1028/2368 symbols completed. HLIO took 35.4s. Estimated remaining: 3h 8m 4s. Rate: 7.1 symbols/min [2025-10-17T19:24:21.103369] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:21.146486] [DEBUG] [LOCAL ] HLX: Loaded 47821 existing records from primary storage. [2025-10-17T19:24:21.146856] [INFO ] [MAIN ] HLX: Loaded 47821 existing records. [2025-10-17T19:24:21.323306] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:21.323520] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-17T19:24:21.323567] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-17T19:24:21.323801] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-17T19:24:21.323858] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-17T19:24:21.563210] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-17T19:24:21.682714] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:21.712391] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:24:22.109337] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:24:22.358108] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-17T19:24:23.158045] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-17T19:24:23.404956] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T19:24:23.958090] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-17T19:24:24.758024] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-17T19:24:24.837255] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:24:25.558061] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-17T19:24:25.822759] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:24:26.371868] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-17T19:24:26.374287] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:24:26.644612] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:24:27.158070] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-17T19:24:27.505116] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (5.15 seconds). [2025-10-17T19:24:27.849780] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:24:27.958001] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-17T19:24:28.694905] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:24:28.758023] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-17T19:24:29.558048] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-17T19:24:29.866811] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T19:24:30.358066] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-17T19:24:30.644947] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:24:30.909241] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:24:31.158025] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-17T19:24:31.921496] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:24:31.958073] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-17T19:24:32.758074] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-17T19:24:33.170757] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T19:24:33.558037] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-17T19:24:33.677328] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:24:34.076125] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T19:24:34.080924] [INFO ] [REMOTE ] HLLY: Full fetch complete (45979 records). [2025-10-17T19:24:34.081045] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-17T19:24:34.363151] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-17T19:24:34.477841] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-17T19:24:34.477922] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-17T19:24:34.478750] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-17T19:24:34.478812] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-17T19:24:34.480117] [DEBUG] [LOCAL ] HLLY: Trimmed 45979 records to 33825 (keeping 200 days of data) [2025-10-17T19:24:34.675510] [DEBUG] [LOCAL ] HLLY: Primary data saved (33825 records). [2025-10-17T19:24:34.675667] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-17T19:24:34.676172] [INFO ] [MAIN ] Update Progress: 1029/2368 symbols completed. HLLY took 29.0s. Estimated remaining: 3h 8m 3s. Rate: 7.1 symbols/min [2025-10-17T19:24:34.844148] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:34.888234] [DEBUG] [LOCAL ] HMC: Loaded 46822 existing records from primary storage. [2025-10-17T19:24:34.888559] [INFO ] [MAIN ] HMC: Loaded 46822 existing records. [2025-10-17T19:24:35.067807] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:35.068005] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-17T19:24:35.068051] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-17T19:24:35.068354] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-17T19:24:35.068435] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-17T19:24:35.167960] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-17T19:24:35.429208] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:35.458455] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T19:24:35.958013] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-17T19:24:36.125638] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T19:24:36.689124] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T19:24:36.758074] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-17T19:24:37.558013] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-17T19:24:37.686842] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:24:37.938992] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T19:24:38.358067] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-17T19:24:39.158073] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-17T19:24:39.325165] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:24:39.958011] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-17T19:24:40.368217] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T19:24:40.687121] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:24:40.758006] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-17T19:24:41.413251] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:24:41.558017] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-17T19:24:42.358013] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-17T19:24:42.559881] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:24:43.157993] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-17T19:24:43.347228] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:24:43.861596] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T19:24:43.958023] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-17T19:24:44.758000] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-17T19:24:45.010611] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:24:45.018181] [INFO ] [REMOTE ] HLN: Full fetch complete (77028 records). [2025-10-17T19:24:45.018340] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-17T19:24:45.419932] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-17T19:24:45.420158] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-17T19:24:45.421233] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-17T19:24:45.421310] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-17T19:24:45.422957] [DEBUG] [LOCAL ] HLN: Trimmed 77028 records to 53902 (keeping 200 days of data) [2025-10-17T19:24:45.560069] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:24:45.560625] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-17T19:24:45.811527] [DEBUG] [LOCAL ] HLN: Primary data saved (53902 records). [2025-10-17T19:24:45.811707] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-17T19:24:45.812448] [INFO ] [MAIN ] Update Progress: 1030/2368 symbols completed. HLN took 34.3s. Estimated remaining: 3h 7m 58s. Rate: 7.1 symbols/min [2025-10-17T19:24:45.983270] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:46.006885] [DEBUG] [LOCAL ] HMN: Loaded 23613 existing records from primary storage. [2025-10-17T19:24:46.007165] [INFO ] [MAIN ] HMN: Loaded 23613 existing records. [2025-10-17T19:24:46.196468] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:46.212044] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-17T19:24:46.212718] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-17T19:24:46.213849] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T19:24:46.223275] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-17T19:24:46.223785] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-17T19:24:46.365759] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-17T19:24:46.581464] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:47.158053] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-17T19:24:47.300211] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T19:24:47.958032] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-17T19:24:48.173639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T19:24:48.275802] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:24:48.758050] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-17T19:24:49.558093] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-17T19:24:49.630700] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:24:50.281404] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T19:24:50.358071] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-17T19:24:51.158110] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-17T19:24:51.373673] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T19:24:51.583574] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T19:24:51.597871] [INFO ] [REMOTE ] HLT: Full fetch complete (73597 records). [2025-10-17T19:24:51.598051] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-17T19:24:51.963694] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-17T19:24:51.987789] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-17T19:24:51.987869] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-17T19:24:51.988840] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-17T19:24:51.988905] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-17T19:24:51.990301] [DEBUG] [LOCAL ] HLT: Trimmed 73597 records to 51246 (keeping 200 days of data) [2025-10-17T19:24:52.109803] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T19:24:52.119086] [INFO ] [REMOTE ] HLX: Full fetch complete (69055 records). [2025-10-17T19:24:52.125045] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-17T19:24:52.643309] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-17T19:24:52.643979] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-17T19:24:52.645213] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-17T19:24:52.645588] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-17T19:24:52.650279] [DEBUG] [LOCAL ] HLX: Trimmed 69055 records to 48172 (keeping 200 days of data) [2025-10-17T19:24:52.769272] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-17T19:24:52.996816] [DEBUG] [LOCAL ] HLX: Primary data saved (48172 records). [2025-10-17T19:24:53.000983] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-17T19:24:53.001413] [INFO ] [MAIN ] Update Progress: 1031/2368 symbols completed. HLX took 32.1s. Estimated remaining: 3h 7m 48s. Rate: 7.1 symbols/min [2025-10-17T19:24:53.107508] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T19:24:53.197958] [DEBUG] [LOCAL ] HLT: Primary data saved (51246 records). [2025-10-17T19:24:53.199451] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:53.199986] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-17T19:24:53.200785] [INFO ] [MAIN ] Update Progress: 1032/2368 symbols completed. HLT took 38.3s. Estimated remaining: 3h 7m 29s. Rate: 7.1 symbols/min [2025-10-17T19:24:53.411695] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:53.411931] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-17T19:24:53.411996] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-17T19:24:53.412114] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-17T19:24:53.412155] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-17T19:24:53.412196] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-17T19:24:53.412228] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-17T19:24:53.558811] [DEBUG] [LOCAL ] HMY: Loaded 53556 existing records from primary storage. [2025-10-17T19:24:53.558937] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-17T19:24:53.609274] [INFO ] [MAIN ] HMY: Loaded 53556 existing records. [2025-10-17T19:24:53.984236] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:53.991550] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:53.991991] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-17T19:24:53.992346] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-17T19:24:53.992582] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-17T19:24:53.992681] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-17T19:24:54.365723] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:54.359473] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-17T19:24:54.459136] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:24:54.706919] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:24:54.707221] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-17T19:24:54.707332] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:24:54.707390] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-17T19:24:54.707451] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:24:54.707524] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-17T19:24:54.707590] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-17T19:24:54.707627] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-17T19:24:54.707712] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-17T19:24:54.707781] [INFO ] [MAIN ] Update Progress: 1033/2368 symbols completed. HNGE took 1.5s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-17T19:24:54.828021] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T19:24:54.896131] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:54.926158] [DEBUG] [LOCAL ] HNI: Loaded 29900 existing records from primary storage. [2025-10-17T19:24:54.926424] [INFO ] [MAIN ] HNI: Loaded 29900 existing records. [2025-10-17T19:24:55.100131] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:55.100338] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-17T19:24:55.100384] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-17T19:24:55.100579] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-17T19:24:55.100635] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-17T19:24:55.163160] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-17T19:24:55.444877] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:55.958017] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-17T19:24:56.204154] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:24:56.758039] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-17T19:24:57.525611] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:24:57.557995] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-17T19:24:57.874557] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T19:24:58.358045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-17T19:24:59.158026] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-17T19:24:59.378060] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T19:24:59.627467] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:24:59.958033] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-17T19:25:00.013506] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:25:00.758041] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-17T19:25:01.465445] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T19:25:01.558041] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-17T19:25:02.358060] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-17T19:25:03.158066] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-17T19:25:03.447544] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-17T19:25:03.685394] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T19:25:03.958006] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-17T19:25:04.044512] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-17T19:25:04.284808] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:25:04.758082] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-17T19:25:05.558036] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-17T19:25:05.656259] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:25:06.095973] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:25:06.358057] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-17T19:25:06.494000] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T19:25:07.158009] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-17T19:25:07.405285] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:25:07.958121] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-17T19:25:08.758100] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-17T19:25:08.938002] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:25:08.945043] [INFO ] [REMOTE ] HMC: Full fetch complete (68851 records). [2025-10-17T19:25:08.945195] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-17T19:25:09.326517] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-17T19:25:09.326605] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-17T19:25:09.327631] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-17T19:25:09.327717] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-17T19:25:09.329135] [DEBUG] [LOCAL ] HMC: Trimmed 68851 records to 47137 (keeping 200 days of data) [2025-10-17T19:25:09.558020] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-17T19:25:09.606625] [DEBUG] [LOCAL ] HMC: Primary data saved (47137 records). [2025-10-17T19:25:09.606776] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-17T19:25:09.607279] [INFO ] [MAIN ] Update Progress: 1034/2368 symbols completed. HMC took 34.9s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-17T19:25:09.777067] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:09.826229] [DEBUG] [LOCAL ] HOG: Loaded 51193 existing records from primary storage. [2025-10-17T19:25:09.826677] [INFO ] [MAIN ] HOG: Loaded 51193 existing records. [2025-10-17T19:25:10.031467] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T19:25:10.030038] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:10.037362] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-17T19:25:10.037621] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-17T19:25:10.038496] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-17T19:25:10.038563] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-17T19:25:10.179263] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-17T19:25:10.363125] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-17T19:25:10.475631] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:10.777011] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:25:11.158059] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-17T19:25:11.957991] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-17T19:25:12.368011] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:25:12.473825] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T19:25:12.758025] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-17T19:25:13.102729] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:25:13.105663] [INFO ] [REMOTE ] HMN: Full fetch complete (31606 records). [2025-10-17T19:25:13.105745] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-17T19:25:13.461848] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-17T19:25:13.461923] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-17T19:25:13.462544] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-17T19:25:13.462582] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-17T19:25:13.463337] [DEBUG] [LOCAL ] HMN: Trimmed 31606 records to 23749 (keeping 200 days of data) [2025-10-17T19:25:13.558587] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-17T19:25:13.608203] [DEBUG] [LOCAL ] HMN: Primary data saved (23749 records). [2025-10-17T19:25:13.608326] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-17T19:25:13.608402] [INFO ] [MAIN ] Update Progress: 1035/2368 symbols completed. HMN took 27.8s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-17T19:25:13.777616] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:13.822933] [DEBUG] [LOCAL ] HOMB: Loaded 44016 existing records from primary storage. [2025-10-17T19:25:13.823256] [INFO ] [MAIN ] HOMB: Loaded 44016 existing records. [2025-10-17T19:25:14.012049] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:14.012349] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-17T19:25:14.012447] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-17T19:25:14.018049] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-17T19:25:14.024952] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-17T19:25:14.065816] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T19:25:14.363107] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-17T19:25:14.422794] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:15.157997] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-17T19:25:15.581977] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T19:25:15.958009] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-17T19:25:16.038354] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:25:16.683736] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:25:16.758038] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-17T19:25:17.558025] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-17T19:25:18.272248] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-17T19:25:18.318067] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:25:18.358032] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-17T19:25:19.158027] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-17T19:25:19.230237] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:25:19.382737] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:25:19.958036] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-17T19:25:20.758072] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-17T19:25:21.274628] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-17T19:25:21.568843] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-17T19:25:21.571833] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:25:22.358133] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-17T19:25:22.486443] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T19:25:23.158025] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-17T19:25:23.403994] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T19:25:23.670153] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T19:25:23.958039] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-17T19:25:24.758118] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-17T19:25:24.972721] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:25:25.558068] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-17T19:25:25.995263] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T19:25:26.358062] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-17T19:25:26.504221] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:25:26.703261] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T19:25:27.158067] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-17T19:25:27.958045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-17T19:25:28.401802] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:25:28.553749] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T19:25:28.758066] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-17T19:25:29.390155] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:25:29.558033] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-17T19:25:30.358084] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-17T19:25:30.889043] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T19:25:30.915495] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:25:30.920485] [INFO ] [REMOTE ] HNI: Full fetch complete (42067 records). [2025-10-17T19:25:30.920633] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-17T19:25:31.168923] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-17T19:25:31.305335] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-17T19:25:31.305409] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-17T19:25:31.306123] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-17T19:25:31.306184] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-17T19:25:31.307226] [DEBUG] [LOCAL ] HNI: Trimmed 42067 records to 30085 (keeping 200 days of data) [2025-10-17T19:25:31.492069] [DEBUG] [LOCAL ] HNI: Primary data saved (30085 records). [2025-10-17T19:25:31.492191] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-17T19:25:31.492265] [INFO ] [MAIN ] Update Progress: 1036/2368 symbols completed. HNI took 36.8s. Estimated remaining: 3h 7m 1s. Rate: 7.1 symbols/min [2025-10-17T19:25:31.659729] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:31.699903] [DEBUG] [LOCAL ] HOUS: Loaded 45728 existing records from primary storage. [2025-10-17T19:25:31.700246] [INFO ] [MAIN ] HOUS: Loaded 45728 existing records. [2025-10-17T19:25:31.884853] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:31.885109] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-17T19:25:31.885224] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-17T19:25:31.885493] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-17T19:25:31.885588] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-17T19:25:31.959155] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-17T19:25:32.085036] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:25:32.292932] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:32.758132] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-17T19:25:33.388617] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T19:25:33.396265] [INFO ] [REMOTE ] HMY: Full fetch complete (77058 records). [2025-10-17T19:25:33.396432] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-17T19:25:33.579980] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-17T19:25:33.811411] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-17T19:25:33.811589] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-17T19:25:33.812722] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-17T19:25:33.812805] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-17T19:25:33.814526] [DEBUG] [LOCAL ] HMY: Trimmed 77058 records to 53946 (keeping 200 days of data) [2025-10-17T19:25:33.935667] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-17T19:25:34.186477] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:25:34.215775] [DEBUG] [LOCAL ] HMY: Primary data saved (53946 records). [2025-10-17T19:25:34.215904] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-17T19:25:34.215985] [INFO ] [MAIN ] Update Progress: 1037/2368 symbols completed. HMY took 41.2s. Estimated remaining: 3h 6m 45s. Rate: 7.1 symbols/min [2025-10-17T19:25:34.357994] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-17T19:25:35.102767] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:25:35.158064] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-17T19:25:35.958037] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-17T19:25:36.024549] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T19:25:36.524663] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:25:36.758035] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-17T19:25:37.067784] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T19:25:37.558084] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-17T19:25:38.226042] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:25:38.358085] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-17T19:25:38.963237] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:25:39.158077] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-17T19:25:39.958052] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-17T19:25:40.173372] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T19:25:40.726332] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:25:40.757987] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-17T19:25:41.498499] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:25:41.558007] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-17T19:25:42.357998] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-17T19:25:42.471126] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:25:42.477891] [INFO ] [REMOTE ] HOMB: Full fetch complete (64365 records). [2025-10-17T19:25:42.478037] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-17T19:25:42.886253] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-17T19:25:42.886365] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-17T19:25:42.887546] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-17T19:25:42.887629] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-17T19:25:42.898007] [DEBUG] [LOCAL ] HOMB: Trimmed 64365 records to 44387 (keeping 200 days of data) [2025-10-17T19:25:42.915424] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T19:25:43.158267] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-17T19:25:43.212043] [DEBUG] [LOCAL ] HOMB: Primary data saved (44387 records). [2025-10-17T19:25:43.212182] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-17T19:25:43.212829] [INFO ] [MAIN ] Update Progress: 1038/2368 symbols completed. HOMB took 29.6s. Estimated remaining: 3h 6m 38s. Rate: 7.1 symbols/min [2025-10-17T19:25:44.138890] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T19:25:44.153547] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-17T19:25:44.278875] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:25:44.758086] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-17T19:25:46.061437] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:25:46.078415] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-17T19:25:46.319003] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T19:25:46.357981] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-17T19:25:47.748370] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:25:47.755693] [INFO ] [REMOTE ] HOG: Full fetch complete (74284 records). [2025-10-17T19:25:47.755851] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-17T19:25:47.964739] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:25:48.064027] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-17T19:25:48.192687] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-17T19:25:48.192805] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-17T19:25:48.193897] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-17T19:25:48.193961] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-17T19:25:48.195376] [DEBUG] [LOCAL ] HOG: Trimmed 74284 records to 51493 (keeping 200 days of data) [2025-10-17T19:25:48.514625] [DEBUG] [LOCAL ] HOG: Primary data saved (51493 records). [2025-10-17T19:25:48.514777] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-17T19:25:48.514881] [INFO ] [MAIN ] Update Progress: 1039/2368 symbols completed. HOG took 38.9s. Estimated remaining: 3h 6m 25s. Rate: 7.1 symbols/min [2025-10-17T19:25:50.081926] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T19:25:50.091950] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-17T19:25:51.775478] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T19:25:51.785951] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-17T19:25:53.599389] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:25:53.607173] [INFO ] [REMOTE ] HOUS: Full fetch complete (64537 records). [2025-10-17T19:25:53.607288] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-17T19:25:53.995463] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-17T19:25:53.995578] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-17T19:25:53.996534] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-17T19:25:53.996598] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-17T19:25:53.998090] [DEBUG] [LOCAL ] HOUS: Trimmed 64537 records to 46109 (keeping 200 days of data) [2025-10-17T19:25:54.263792] [DEBUG] [LOCAL ] HOUS: Primary data saved (46109 records). [2025-10-17T19:25:54.263940] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-17T19:25:54.264042] [INFO ] [MAIN ] Update Progress: 1040/2368 symbols completed. HOUS took 22.8s. Estimated remaining: 3h 6m 14s. Rate: 7.1 symbols/min [2025-10-17T19:25:54.892376] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.016214] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.023215] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.022118] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.038717] [DEBUG] [LOCAL ] HOV: Loaded 14093 existing records from primary storage. [2025-10-17T19:25:55.039253] [INFO ] [MAIN ] HOV: Loaded 14093 existing records. [2025-10-17T19:25:55.090932] [DEBUG] [LOCAL ] HPF: Loaded 7539 existing records from primary storage. [2025-10-17T19:25:55.131371] [INFO ] [MAIN ] HPF: Loaded 7539 existing records. [2025-10-17T19:25:55.396768] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:55.397513] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-17T19:25:55.409254] [DEBUG] [LOCAL ] HP: Loaded 51892 existing records from primary storage. [2025-10-17T19:25:55.438050] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-17T19:25:55.470760] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-17T19:25:55.464904] [INFO ] [MAIN ] HP: Loaded 51892 existing records. [2025-10-17T19:25:55.494499] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:55.505286] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-17T19:25:55.472037] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-17T19:25:55.515229] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-17T19:25:55.525712] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-10-17T19:25:55.525818] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-17T19:25:55.652809] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-17T19:25:55.706184] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-17T19:25:56.061572] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:56.145844] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:56.151313] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-17T19:25:56.170822] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-17T19:25:56.235415] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-17T19:25:56.235295] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-17T19:25:56.263274] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-17T19:25:56.291772] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-17T19:25:56.272381] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-17T19:25:56.367582] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-17T19:25:56.722876] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:56.723504] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-17T19:25:57.157801] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:57.215621] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-17T19:25:57.369143] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:57.374488] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-17T19:25:57.374241] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:57.374789] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-17T19:25:57.752606] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T19:25:57.756145] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-17T19:25:58.102963] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T19:25:58.105443] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-17T19:25:58.582050] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:25:58.585734] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-17T19:25:58.821494] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:25:58.822829] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T19:25:58.833593] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-17T19:25:58.837916] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-17T19:25:59.440289] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T19:25:59.443440] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-17T19:25:59.488050] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T19:25:59.504728] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-17T19:25:59.507577] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-17T19:25:59.518530] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-17T19:26:00.028048] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T19:26:00.030088] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-17T19:26:00.241575] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T19:26:00.244534] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-17T19:26:00.466611] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:26:00.758044] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-17T19:26:00.892085] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T19:26:01.373254] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T19:26:01.558059] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-17T19:26:01.926124] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-17T19:26:02.340192] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T19:26:02.358020] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-17T19:26:02.859139] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-17T19:26:03.158013] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-17T19:26:03.189930] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T19:26:03.924994] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T19:26:03.958034] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-17T19:26:04.758024] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-17T19:26:05.003735] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T19:26:05.558077] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-17T19:26:06.308804] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:26:06.358037] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-17T19:26:06.649808] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T19:26:07.079325] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T19:26:07.158024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-17T19:26:07.958025] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-17T19:26:08.205326] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T19:26:08.758009] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-17T19:26:09.509976] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T19:26:09.558014] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-17T19:26:09.963882] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T19:26:10.351630] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:26:10.353204] [INFO ] [REMOTE ] HPF: Full fetch complete (10586 records). [2025-10-17T19:26:10.353285] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-17T19:26:10.364676] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-17T19:26:10.747777] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-17T19:26:10.747869] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-17T19:26:10.748183] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-17T19:26:10.748246] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-17T19:26:10.748772] [DEBUG] [LOCAL ] HPF: Trimmed 10586 records to 7566 (keeping 200 days of data) [2025-10-17T19:26:10.796133] [DEBUG] [LOCAL ] HPF: Primary data saved (7566 records). [2025-10-17T19:26:10.796276] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-17T19:26:10.796385] [INFO ] [MAIN ] Update Progress: 1041/2368 symbols completed. HPF took 16.5s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-17T19:26:10.971416] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:10.984131] [DEBUG] [LOCAL ] HPI: Loaded 10730 existing records from primary storage. [2025-10-17T19:26:10.984334] [INFO ] [MAIN ] HPI: Loaded 10730 existing records. [2025-10-17T19:26:11.169629] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-17T19:26:11.177566] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:11.177953] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-17T19:26:11.178065] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-17T19:26:11.178286] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-17T19:26:11.178328] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-17T19:26:11.563874] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:11.958065] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-17T19:26:12.126357] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:26:12.205582] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T19:26:12.758079] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-17T19:26:13.558048] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-17T19:26:13.681293] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T19:26:13.876292] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T19:26:14.358027] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-17T19:26:14.985752] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T19:26:15.158036] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-17T19:26:15.266523] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T19:26:15.269715] [INFO ] [REMOTE ] HOV: Full fetch complete (19066 records). [2025-10-17T19:26:15.269868] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-17T19:26:15.696183] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-17T19:26:15.696284] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-17T19:26:15.696903] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-17T19:26:15.696981] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-17T19:26:15.698016] [DEBUG] [LOCAL ] HOV: Trimmed 19066 records to 14171 (keeping 200 days of data) [2025-10-17T19:26:15.802934] [DEBUG] [LOCAL ] HOV: Primary data saved (14171 records). [2025-10-17T19:26:15.803114] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-17T19:26:15.803235] [INFO ] [MAIN ] Update Progress: 1042/2368 symbols completed. HOV took 21.5s. Estimated remaining: 3h 6m 3s. Rate: 7.1 symbols/min [2025-10-17T19:26:15.965821] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-17T19:26:16.011079] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:16.084529] [DEBUG] [LOCAL ] HPP: Loaded 51562 existing records from primary storage. [2025-10-17T19:26:16.085226] [INFO ] [MAIN ] HPP: Loaded 51562 existing records. [2025-10-17T19:26:16.335847] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:16.336106] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-17T19:26:16.336166] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-17T19:26:16.336438] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-17T19:26:16.336504] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-17T19:26:16.759270] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-17T19:26:16.784424] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:17.120001] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T19:26:17.555255] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T19:26:17.558132] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-17T19:26:18.005155] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T19:26:18.348342] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T19:26:18.358031] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-17T19:26:18.965114] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T19:26:19.158063] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-17T19:26:19.944909] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T19:26:19.957979] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-17T19:26:20.758306] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-17T19:26:20.768560] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T19:26:21.558034] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-17T19:26:22.368119] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-17T19:26:22.390974] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T19:26:22.425248] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T19:26:23.158084] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-17T19:26:23.958019] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-17T19:26:24.009925] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:26:24.758011] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-17T19:26:25.105418] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T19:26:25.559239] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-17T19:26:25.561773] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T19:26:25.603484] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T19:26:26.358059] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-17T19:26:27.158016] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-17T19:26:27.334895] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:26:27.944067] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:26:27.957985] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-17T19:26:28.758070] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-17T19:26:28.889186] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:26:29.163328] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T19:26:29.558043] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-17T19:26:30.358095] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-17T19:26:30.580093] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T19:26:31.142330] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T19:26:31.158032] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-17T19:26:31.221812] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:26:31.958089] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-17T19:26:31.968560] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T19:26:32.758085] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-17T19:26:33.558075] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-17T19:26:34.098266] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T19:26:34.358015] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-17T19:26:34.586899] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T19:26:34.619921] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T19:26:35.158094] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-17T19:26:35.959510] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-17T19:26:35.966855] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:26:36.047232] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T19:26:36.049177] [INFO ] [REMOTE ] HPI: Full fetch complete (13931 records). [2025-10-17T19:26:36.049329] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-17T19:26:36.403916] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-17T19:26:36.403986] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-17T19:26:36.404288] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-17T19:26:36.404325] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-17T19:26:36.404821] [DEBUG] [LOCAL ] HPI: Trimmed 13931 records to 10785 (keeping 200 days of data) [2025-10-17T19:26:36.470473] [DEBUG] [LOCAL ] HPI: Primary data saved (10785 records). [2025-10-17T19:26:36.470608] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-17T19:26:36.470719] [INFO ] [MAIN ] Update Progress: 1043/2368 symbols completed. HPI took 25.7s. Estimated remaining: 3h 6m 10s. Rate: 7.1 symbols/min [2025-10-17T19:26:36.637256] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:36.685522] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-10-17T19:26:36.685901] [INFO ] [MAIN ] HPQ: Loaded 54059 existing records. [2025-10-17T19:26:36.763178] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-17T19:26:36.864568] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:36.864827] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-17T19:26:36.864892] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-17T19:26:36.865118] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-17T19:26:36.865177] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-17T19:26:37.207809] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:37.557985] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-17T19:26:38.135773] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T19:26:38.143118] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-17T19:26:38.143229] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-17T19:26:38.363172] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-17T19:26:38.538369] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T19:26:38.590873] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-17T19:26:38.591064] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-17T19:26:38.592078] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-17T19:26:38.592164] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-17T19:26:38.593879] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 54477 (keeping 200 days of data) [2025-10-17T19:26:38.951844] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-17T19:26:38.952137] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-17T19:26:38.952242] [INFO ] [MAIN ] Update Progress: 1044/2368 symbols completed. HPE took 44.7s. Estimated remaining: 3h 5m 54s. Rate: 7.1 symbols/min [2025-10-17T19:26:39.127330] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:39.158601] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T19:26:39.158880] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-17T19:26:39.179383] [DEBUG] [LOCAL ] HPS: Loaded 10382 existing records from primary storage. [2025-10-17T19:26:39.179606] [INFO ] [MAIN ] HPS: Loaded 10382 existing records. [2025-10-17T19:26:39.355836] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:39.356049] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-17T19:26:39.356097] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-17T19:26:39.356249] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-17T19:26:39.356288] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-17T19:26:39.708532] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:39.958026] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-17T19:26:40.120449] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T19:26:40.130927] [INFO ] [REMOTE ] HP: Full fetch complete (74076 records). [2025-10-17T19:26:40.131113] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-17T19:26:40.581603] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-17T19:26:40.581800] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-17T19:26:40.583263] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-17T19:26:40.583366] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-17T19:26:40.585393] [DEBUG] [LOCAL ] HP: Trimmed 74076 records to 52245 (keeping 200 days of data) [2025-10-17T19:26:40.788389] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-17T19:26:40.873874] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T19:26:40.973862] [DEBUG] [LOCAL ] HP: Primary data saved (52245 records). [2025-10-17T19:26:40.974048] [INFO ] [MAIN ] HP: Full history saved. [2025-10-17T19:26:40.974139] [INFO ] [MAIN ] Update Progress: 1045/2368 symbols completed. HP took 46.7s. Estimated remaining: 3h 5m 37s. Rate: 7.1 symbols/min [2025-10-17T19:26:41.140298] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:41.167544] [DEBUG] [LOCAL ] HQH: Loaded 26023 existing records from primary storage. [2025-10-17T19:26:41.167836] [INFO ] [MAIN ] HQH: Loaded 26023 existing records. [2025-10-17T19:26:41.345993] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:41.346251] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-17T19:26:41.346300] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-17T19:26:41.346480] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-17T19:26:41.346519] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-17T19:26:41.569085] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-17T19:26:41.671103] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T19:26:41.730498] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:41.827481] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:26:42.358075] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-17T19:26:43.158041] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-17T19:26:43.417182] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:26:43.958192] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-17T19:26:44.204917] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T19:26:44.262233] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T19:26:44.727408] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:26:44.758059] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-17T19:26:45.558040] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-17T19:26:46.358004] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-17T19:26:46.612196] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T19:26:46.661340] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T19:26:47.158025] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-17T19:26:47.237939] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T19:26:47.958019] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-17T19:26:48.237861] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T19:26:48.758095] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-17T19:26:49.558013] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-17T19:26:49.695291] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T19:26:49.802299] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:26:50.323545] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T19:26:50.358018] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-17T19:26:51.094172] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T19:26:51.158029] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-17T19:26:51.895338] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T19:26:51.958115] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-17T19:26:52.757998] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-17T19:26:53.156100] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:26:53.558098] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-17T19:26:54.358100] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-17T19:26:54.384254] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T19:26:54.764352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T19:26:55.158101] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-17T19:26:55.530832] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T19:26:55.958035] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-17T19:26:56.758019] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-17T19:26:56.895300] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T19:26:57.557997] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-17T19:26:57.887866] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:26:57.912730] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T19:26:58.358003] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-17T19:26:58.464751] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T19:26:59.158140] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-17T19:26:59.958012] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-17T19:27:00.141787] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:27:00.758020] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-17T19:27:01.261141] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T19:27:01.491863] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T19:27:01.500539] [INFO ] [REMOTE ] HPP: Full fetch complete (73416 records). [2025-10-17T19:27:01.501166] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-17T19:27:01.568845] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-17T19:27:01.929760] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-17T19:27:01.929858] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-17T19:27:01.930848] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-17T19:27:01.930921] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-17T19:27:01.932424] [DEBUG] [LOCAL ] HPP: Trimmed 73416 records to 51937 (keeping 200 days of data) [2025-10-17T19:27:02.242031] [DEBUG] [LOCAL ] HPP: Primary data saved (51937 records). [2025-10-17T19:27:02.242217] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-17T19:27:02.242330] [INFO ] [MAIN ] Update Progress: 1046/2368 symbols completed. HPP took 46.4s. Estimated remaining: 3h 5m 45s. Rate: 7.1 symbols/min [2025-10-17T19:27:02.363171] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-17T19:27:02.418718] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:02.436499] [DEBUG] [LOCAL ] HQL: Loaded 17085 existing records from primary storage. [2025-10-17T19:27:02.436790] [INFO ] [MAIN ] HQL: Loaded 17085 existing records. [2025-10-17T19:27:02.526317] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T19:27:02.628093] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:02.628275] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-17T19:27:02.628342] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-17T19:27:02.628537] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-17T19:27:02.628593] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-17T19:27:02.979089] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:03.010756] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-17T19:27:03.157994] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-17T19:27:03.523446] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T19:27:03.958022] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-17T19:27:04.758003] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-17T19:27:05.140867] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T19:27:05.216301] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T19:27:05.534756] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T19:27:05.557989] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-17T19:27:06.358008] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-17T19:27:06.832747] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T19:27:06.837026] [INFO ] [REMOTE ] HQH: Full fetch complete (37212 records). [2025-10-17T19:27:06.837105] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-17T19:27:07.163106] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-17T19:27:07.204163] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-17T19:27:07.204245] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-17T19:27:07.205008] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-17T19:27:07.205071] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-17T19:27:07.205979] [DEBUG] [LOCAL ] HQH: Trimmed 37212 records to 26187 (keeping 200 days of data) [2025-10-17T19:27:07.358130] [DEBUG] [LOCAL ] HQH: Primary data saved (26187 records). [2025-10-17T19:27:07.358255] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-17T19:27:07.358336] [INFO ] [MAIN ] Update Progress: 1047/2368 symbols completed. HQH took 26.4s. Estimated remaining: 3h 5m 33s. Rate: 7.1 symbols/min [2025-10-17T19:27:07.524587] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:07.574778] [DEBUG] [LOCAL ] HR: Loaded 52488 existing records from primary storage. [2025-10-17T19:27:07.575086] [INFO ] [MAIN ] HR: Loaded 52488 existing records. [2025-10-17T19:27:07.746510] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:07.746739] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-17T19:27:07.746791] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-17T19:27:07.746967] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-17T19:27:07.747004] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-17T19:27:07.982388] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-17T19:27:08.101630] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:08.175603] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T19:27:08.177815] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:27:08.190712] [INFO ] [REMOTE ] HPS: Full fetch complete (15140 records). [2025-10-17T19:27:08.191117] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-17T19:27:08.601633] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-17T19:27:08.601783] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-17T19:27:08.602341] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-17T19:27:08.602418] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-17T19:27:08.603439] [DEBUG] [LOCAL ] HPS: Trimmed 15140 records to 10447 (keeping 200 days of data) [2025-10-17T19:27:08.701741] [DEBUG] [LOCAL ] HPS: Primary data saved (10447 records). [2025-10-17T19:27:08.701947] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-17T19:27:08.702078] [INFO ] [MAIN ] Update Progress: 1048/2368 symbols completed. HPS took 29.7s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-17T19:27:08.763540] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-17T19:27:08.988076] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:09.044625] [DEBUG] [LOCAL ] HRB: Loaded 48745 existing records from primary storage. [2025-10-17T19:27:09.057434] [INFO ] [MAIN ] HRB: Loaded 48745 existing records. [2025-10-17T19:27:09.093009] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:27:09.268988] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:09.269270] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-17T19:27:09.269341] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-17T19:27:09.269595] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-17T19:27:09.269710] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-17T19:27:09.563765] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-17T19:27:09.647918] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:10.358019] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-17T19:27:10.494788] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T19:27:10.503038] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-17T19:27:10.503272] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-17T19:27:10.961318] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-17T19:27:10.961718] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-17T19:27:10.967878] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T19:27:10.963830] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-17T19:27:10.979213] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-17T19:27:10.981192] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 54449 (keeping 200 days of data) [2025-10-17T19:27:11.170553] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-17T19:27:11.358059] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T19:27:11.386170] [DEBUG] [LOCAL ] HPQ: Primary data saved (54449 records). [2025-10-17T19:27:11.386385] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-17T19:27:11.386494] [INFO ] [MAIN ] Update Progress: 1049/2368 symbols completed. HPQ took 34.9s. Estimated remaining: 3h 4m 60s. Rate: 7.1 symbols/min [2025-10-17T19:27:11.570265] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:11.609713] [DEBUG] [LOCAL ] HRI: Loaded 32632 existing records from primary storage. [2025-10-17T19:27:11.610166] [INFO ] [MAIN ] HRI: Loaded 32632 existing records. [2025-10-17T19:27:11.823282] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:11.823709] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-17T19:27:11.823772] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-17T19:27:11.823989] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-17T19:27:11.824029] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-17T19:27:11.968709] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-17T19:27:12.196982] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:12.691274] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:27:12.757994] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-17T19:27:13.558043] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-17T19:27:13.610224] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:27:14.365926] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-17T19:27:14.370907] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T19:27:14.704919] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T19:27:15.158034] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-17T19:27:15.958035] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-17T19:27:15.996513] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T19:27:16.524358] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T19:27:16.758071] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-17T19:27:17.558070] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-17T19:27:17.627764] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:27:17.688614] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:27:18.358005] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-17T19:27:18.959146] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T19:27:19.158014] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-17T19:27:19.375131] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T19:27:19.958066] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-17T19:27:20.770318] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-17T19:27:20.795074] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:27:21.163396] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T19:27:21.558033] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-17T19:27:21.775822] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T19:27:22.358095] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-17T19:27:23.158115] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-17T19:27:23.293379] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T19:27:23.958034] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-17T19:27:24.032935] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T19:27:24.731177] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:27:24.758066] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-17T19:27:25.558096] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-17T19:27:25.648780] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:27:26.222823] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:27:26.358049] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-17T19:27:27.158098] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-17T19:27:27.273371] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T19:27:27.786112] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:27:27.958050] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-17T19:27:28.263968] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:27:28.758073] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-17T19:27:29.310627] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T19:27:29.386601] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:27:29.558021] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-17T19:27:30.358027] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-17T19:27:31.158064] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-17T19:27:31.200386] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:27:31.947295] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T19:27:31.957984] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-17T19:27:32.581128] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:27:32.758121] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-17T19:27:33.558018] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-17T19:27:33.697875] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T19:27:34.358011] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-17T19:27:34.542201] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:27:34.898857] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T19:27:35.158008] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-17T19:27:35.475487] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:27:35.958061] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-17T19:27:36.452124] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:27:36.758047] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-17T19:27:37.558039] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-17T19:27:37.630178] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T19:27:37.675076] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T19:27:38.358043] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-17T19:27:38.859496] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T19:27:38.864020] [INFO ] [REMOTE ] HRI: Full fetch complete (46578 records). [2025-10-17T19:27:38.864178] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-17T19:27:39.163123] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-17T19:27:39.262925] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-17T19:27:39.263002] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-17T19:27:39.263777] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-17T19:27:39.263840] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-17T19:27:39.264943] [DEBUG] [LOCAL ] HRI: Trimmed 46578 records to 32839 (keeping 200 days of data) [2025-10-17T19:27:39.472304] [DEBUG] [LOCAL ] HRI: Primary data saved (32839 records). [2025-10-17T19:27:39.472425] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-17T19:27:39.473129] [INFO ] [MAIN ] Update Progress: 1050/2368 symbols completed. HRI took 28.1s. Estimated remaining: 3h 5m 16s. Rate: 7.1 symbols/min [2025-10-17T19:27:39.639071] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:39.691360] [DEBUG] [LOCAL ] HRL: Loaded 53516 existing records from primary storage. [2025-10-17T19:27:39.691711] [INFO ] [MAIN ] HRL: Loaded 53516 existing records. [2025-10-17T19:27:39.877123] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:39.877877] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-17T19:27:39.877963] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-17T19:27:39.878951] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-17T19:27:39.879026] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-17T19:27:39.966755] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-17T19:27:40.270489] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:40.282430] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T19:27:40.321219] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T19:27:40.758043] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-17T19:27:41.558013] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-17T19:27:41.724501] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T19:27:42.358017] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-17T19:27:42.459639] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:27:43.049045] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T19:27:43.158079] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-17T19:27:43.958081] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-17T19:27:44.066507] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:27:44.073065] [INFO ] [REMOTE ] HRB: Full fetch complete (70084 records). [2025-10-17T19:27:44.073177] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-17T19:27:44.464043] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-17T19:27:44.464124] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-17T19:27:44.465073] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-17T19:27:44.465161] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-17T19:27:44.466503] [DEBUG] [LOCAL ] HRB: Trimmed 70084 records to 49064 (keeping 200 days of data) [2025-10-17T19:27:44.760870] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-17T19:27:44.767463] [DEBUG] [LOCAL ] HRB: Primary data saved (49064 records). [2025-10-17T19:27:44.767679] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-17T19:27:44.767794] [INFO ] [MAIN ] Update Progress: 1051/2368 symbols completed. HRB took 36.1s. Estimated remaining: 3h 5m 3s. Rate: 7.1 symbols/min [2025-10-17T19:27:44.949520] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:44.971471] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:27:44.979965] [INFO ] [REMOTE ] HR: Full fetch complete (75065 records). [2025-10-17T19:27:44.980244] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-17T19:27:45.181255] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T19:27:45.290563] [INFO ] [REMOTE ] HQL: Full fetch complete (25289 records). [2025-10-17T19:27:45.312086] [DEBUG] [LOCAL ] HRTG: Loaded 34673 existing records from primary storage. [2025-10-17T19:27:45.317373] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-17T19:27:45.340197] [INFO ] [MAIN ] HRTG: Loaded 34673 existing records. [2025-10-17T19:27:45.663575] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-17T19:27:45.677865] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-17T19:27:45.679901] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-17T19:27:45.721613] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-17T19:27:45.804736] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:45.836408] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-17T19:27:45.890244] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-17T19:27:45.939403] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-17T19:27:45.939756] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-17T19:27:45.947389] [DEBUG] [LOCAL ] HR: Trimmed 75065 records to 52870 (keeping 200 days of data) [2025-10-17T19:27:46.233894] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-17T19:27:46.235465] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-17T19:27:46.246812] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-17T19:27:46.252482] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-17T19:27:46.310835] [DEBUG] [LOCAL ] HQL: Trimmed 25289 records to 17218 (keeping 200 days of data) [2025-10-17T19:27:46.806706] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:46.800543] [DEBUG] [LOCAL ] HQL: Primary data saved (17218 records). [2025-10-17T19:27:46.824794] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-17T19:27:46.825085] [INFO ] [MAIN ] Update Progress: 1052/2368 symbols completed. HQL took 44.6s. Estimated remaining: 3h 4m 47s. Rate: 7.1 symbols/min [2025-10-17T19:27:46.838685] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-17T19:27:46.854790] [DEBUG] [LOCAL ] HR: Primary data saved (52870 records). [2025-10-17T19:27:46.855119] [INFO ] [MAIN ] HR: Full history saved. [2025-10-17T19:27:46.855909] [INFO ] [MAIN ] Update Progress: 1053/2368 symbols completed. HR took 39.5s. Estimated remaining: 3h 4m 28s. Rate: 7.1 symbols/min [2025-10-17T19:27:47.184987] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:47.205912] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:47.242690] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-17T19:27:47.253859] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-17T19:27:47.260196] [DEBUG] [LOCAL ] HSHP: Loaded 14969 existing records from primary storage. [2025-10-17T19:27:47.260387] [INFO ] [MAIN ] HSHP: Loaded 14969 existing records. [2025-10-17T19:27:47.468969] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:47.470672] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-17T19:27:47.470735] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-17T19:27:47.471802] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-17T19:27:47.471889] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-17T19:27:47.471731] [DEBUG] [LOCAL ] HSBC: Loaded 51390 existing records from primary storage. [2025-10-17T19:27:47.534581] [INFO ] [MAIN ] HSBC: Loaded 51390 existing records. [2025-10-17T19:27:47.910103] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:47.959414] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-17T19:27:47.970613] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-17T19:27:47.971066] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-17T19:27:47.986749] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-17T19:27:48.103410] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:48.154961] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-17T19:27:48.179988] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T19:27:48.195818] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-17T19:27:48.438225] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:48.758010] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-17T19:27:48.996151] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T19:27:49.157478] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T19:27:49.258233] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:27:49.558048] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-17T19:27:50.358077] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-17T19:27:50.484738] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T19:27:50.536368] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T19:27:51.158062] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-17T19:27:51.260771] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:27:51.958006] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-17T19:27:52.221684] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T19:27:52.758075] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-17T19:27:53.221732] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:27:53.558007] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-17T19:27:53.705973] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T19:27:54.358054] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-17T19:27:54.966796] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:27:55.158037] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-17T19:27:55.653958] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T19:27:55.958089] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-17T19:27:56.758106] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-17T19:27:57.090812] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T19:27:57.558010] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-17T19:27:57.692554] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T19:27:58.117460] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:27:58.358067] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-17T19:27:59.158010] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-17T19:27:59.307865] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:27:59.358504] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:27:59.958071] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-17T19:28:00.249859] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T19:28:00.758035] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-17T19:28:00.997870] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T19:28:01.558172] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-17T19:28:02.358072] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-17T19:28:03.158079] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-17T19:28:03.360980] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:28:03.515286] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-17T19:28:03.563109] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T19:28:03.958041] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-17T19:28:04.758045] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-17T19:28:05.033264] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T19:28:05.337901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:28:05.558014] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-17T19:28:05.700952] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T19:28:06.358035] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-17T19:28:06.899395] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T19:28:07.153698] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:28:07.157971] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-17T19:28:07.958015] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-17T19:28:08.163853] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T19:28:08.758052] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-17T19:28:09.558000] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-17T19:28:09.743420] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:28:09.745681] [INFO ] [REMOTE ] HSHP: Full fetch complete (23278 records). [2025-10-17T19:28:09.745853] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-17T19:28:10.180334] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-17T19:28:10.183253] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-17T19:28:10.183791] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-17T19:28:10.184018] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-17T19:28:10.185874] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T19:28:10.197104] [DEBUG] [LOCAL ] HSHP: Trimmed 23278 records to 15028 (keeping 200 days of data) [2025-10-17T19:28:10.288743] [DEBUG] [LOCAL ] HSHP: Primary data saved (15028 records). [2025-10-17T19:28:10.288939] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-17T19:28:10.289082] [INFO ] [MAIN ] Update Progress: 1054/2368 symbols completed. HSHP took 23.4s. Estimated remaining: 3h 4m 38s. Rate: 7.1 symbols/min [2025-10-17T19:28:10.363131] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-17T19:28:10.461036] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:10.511100] [DEBUG] [LOCAL ] HSY: Loaded 50818 existing records from primary storage. [2025-10-17T19:28:10.511399] [INFO ] [MAIN ] HSY: Loaded 50818 existing records. [2025-10-17T19:28:10.685754] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:10.686018] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-17T19:28:10.686071] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-17T19:28:10.686335] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-17T19:28:10.686374] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-17T19:28:11.057508] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:11.063543] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T19:28:11.069049] [INFO ] [REMOTE ] HRTG: Full fetch complete (44213 records). [2025-10-17T19:28:11.069132] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-17T19:28:11.166271] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-17T19:28:11.439826] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-17T19:28:11.439902] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-17T19:28:11.440676] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-17T19:28:11.440738] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-17T19:28:11.441664] [DEBUG] [LOCAL ] HRTG: Trimmed 44213 records to 34930 (keeping 200 days of data) [2025-10-17T19:28:11.641800] [DEBUG] [LOCAL ] HRTG: Primary data saved (34930 records). [2025-10-17T19:28:11.641938] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-17T19:28:11.642020] [INFO ] [MAIN ] Update Progress: 1055/2368 symbols completed. HRTG took 26.9s. Estimated remaining: 3h 4m 21s. Rate: 7.1 symbols/min [2025-10-17T19:28:11.808591] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:11.808770] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-17T19:28:11.808813] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-17T19:28:11.808923] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-17T19:28:11.808980] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-17T19:28:11.809051] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-17T19:28:11.809097] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-17T19:28:11.965723] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-17T19:28:12.176943] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:12.275130] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T19:28:12.758003] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-17T19:28:12.865412] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:28:13.558018] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-17T19:28:13.940021] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T19:28:14.173865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:28:14.358041] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-17T19:28:15.158021] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-17T19:28:15.270090] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:28:15.958024] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-17T19:28:16.197178] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T19:28:16.727274] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:28:16.757995] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-17T19:28:17.558031] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-17T19:28:17.759382] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:28:17.759729] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-17T19:28:17.759829] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:28:17.759875] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-17T19:28:17.759933] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:28:17.760001] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-17T19:28:17.760080] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-17T19:28:17.760134] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-17T19:28:17.760178] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-17T19:28:17.760223] [INFO ] [MAIN ] Update Progress: 1056/2368 symbols completed. HTB took 6.1s. Estimated remaining: 3h 4m 10s. Rate: 7.1 symbols/min [2025-10-17T19:28:17.937860] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:17.974431] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T19:28:17.997130] [DEBUG] [LOCAL ] HTD: Loaded 14244 existing records from primary storage. [2025-10-17T19:28:17.997416] [INFO ] [MAIN ] HTD: Loaded 14244 existing records. [2025-10-17T19:28:18.172722] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:18.172922] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-17T19:28:18.172969] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-17T19:28:18.173225] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-17T19:28:18.173281] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-17T19:28:18.363142] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-17T19:28:18.544471] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:18.601429] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T19:28:19.158146] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-17T19:28:19.958112] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-17T19:28:20.253718] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T19:28:20.758099] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-17T19:28:21.074494] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:28:21.558055] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-17T19:28:21.795864] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T19:28:22.047248] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T19:28:22.358056] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-17T19:28:22.765112] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T19:28:23.140365] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:28:23.158010] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-17T19:28:23.913373] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T19:28:23.958061] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-17T19:28:24.758002] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-17T19:28:24.884186] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T19:28:25.558049] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-17T19:28:26.358049] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-17T19:28:26.730259] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T19:28:26.740564] [INFO ] [REMOTE ] HSBC: Full fetch complete (74144 records). [2025-10-17T19:28:26.740776] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-17T19:28:27.149169] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-17T19:28:27.149270] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-17T19:28:27.150368] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-17T19:28:27.150437] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-17T19:28:27.151980] [DEBUG] [LOCAL ] HSBC: Trimmed 74144 records to 51777 (keeping 200 days of data) [2025-10-17T19:28:27.203830] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-17T19:28:27.468569] [DEBUG] [LOCAL ] HSBC: Primary data saved (51777 records). [2025-10-17T19:28:27.468738] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-17T19:28:27.468827] [INFO ] [MAIN ] Update Progress: 1057/2368 symbols completed. HSBC took 40.6s. Estimated remaining: 3h 4m 3s. Rate: 7.1 symbols/min [2025-10-17T19:28:27.639356] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:27.639690] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-17T19:28:27.639876] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-17T19:28:27.640019] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-17T19:28:27.640247] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-17T19:28:27.640407] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-17T19:28:27.640622] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-17T19:28:27.769920] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T19:28:27.822795] [INFO ] [REMOTE ] HRL: Full fetch complete (76987 records). [2025-10-17T19:28:27.832692] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-17T19:28:28.161297] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:28.182614] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-17T19:28:28.427295] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:28:28.479318] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-17T19:28:28.480212] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-17T19:28:28.481666] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-17T19:28:28.481734] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-17T19:28:28.483671] [DEBUG] [LOCAL ] HRL: Trimmed 76987 records to 53904 (keeping 200 days of data) [2025-10-17T19:28:28.514316] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T19:28:28.615055] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T19:28:28.758126] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-17T19:28:28.876512] [DEBUG] [LOCAL ] HRL: Primary data saved (53904 records). [2025-10-17T19:28:28.876736] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-17T19:28:28.876854] [INFO ] [MAIN ] Update Progress: 1058/2368 symbols completed. HRL took 49.4s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-17T19:28:29.052556] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:29.091271] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T19:28:29.114183] [DEBUG] [LOCAL ] HTGC: Loaded 48100 existing records from primary storage. [2025-10-17T19:28:29.114601] [INFO ] [MAIN ] HTGC: Loaded 48100 existing records. [2025-10-17T19:28:29.292350] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:29.292608] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-17T19:28:29.292701] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-17T19:28:29.292929] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-17T19:28:29.292995] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-17T19:28:29.563167] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-17T19:28:29.648509] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:30.358011] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-17T19:28:31.158024] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-17T19:28:31.222980] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:28:31.273885] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T19:28:31.433971] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-17T19:28:31.958032] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-17T19:28:32.758054] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-17T19:28:33.410402] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:28:33.426867] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T19:28:33.557999] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-17T19:28:34.358093] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-17T19:28:35.053985] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T19:28:35.158057] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-17T19:28:35.259608] [DEBUG] [REMOTE ] HTGC: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-17T19:28:35.259995] [WARN ] [REMOTE ] HTGC: No data returned for month 2025-02 [2025-10-17T19:28:35.260085] [FATAL] [REMOTE ] HTGC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:28:35.260163] [FATAL] [MAIN ] HTGC: Failed to fetch primary data. [2025-10-17T19:28:35.260200] [WARN ] [MAIN ] HTGC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:28:35.260275] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-17T19:28:35.260387] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-17T19:28:35.260428] [INFO ] [LOCAL ] HTGC: Starting deletion of derivative data. [2025-10-17T19:28:35.260594] [DEBUG] [LOCAL ] HTGC: Deleted derivative data file. [2025-10-17T19:28:35.260704] [INFO ] [MAIN ] Update Progress: 1059/2368 symbols completed. HTGC took 6.4s. Estimated remaining: 3h 3m 35s. Rate: 7.1 symbols/min [2025-10-17T19:28:35.435446] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:35.466476] [DEBUG] [LOCAL ] HTH: Loaded 32799 existing records from primary storage. [2025-10-17T19:28:35.466806] [INFO ] [MAIN ] HTH: Loaded 32799 existing records. [2025-10-17T19:28:35.662072] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:35.662396] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-17T19:28:35.662555] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-17T19:28:35.662792] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-17T19:28:35.662848] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-17T19:28:35.962125] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-17T19:28:36.014883] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:36.041886] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:28:36.758108] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-17T19:28:36.943104] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T19:28:37.121869] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T19:28:37.558037] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-17T19:28:38.358025] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-17T19:28:39.124857] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:28:39.158044] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-17T19:28:39.427625] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T19:28:39.958047] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-17T19:28:40.143235] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T19:28:40.386437] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T19:28:40.758060] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-17T19:28:41.558068] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-17T19:28:41.840631] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T19:28:42.358040] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-17T19:28:42.672690] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-17T19:28:43.107529] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:28:43.158031] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-17T19:28:43.958033] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-17T19:28:44.758055] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-17T19:28:44.834536] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T19:28:45.044159] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:28:45.063261] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-17T19:28:45.558046] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-17T19:28:46.358128] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-17T19:28:47.158066] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-17T19:28:47.262824] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T19:28:47.269770] [INFO ] [REMOTE ] HSY: Full fetch complete (73659 records). [2025-10-17T19:28:47.269929] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-17T19:28:47.418017] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T19:28:47.439709] [INFO ] [REMOTE ] HTD: Full fetch complete (19548 records). [2025-10-17T19:28:47.461332] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-17T19:28:47.975990] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-17T19:28:47.996725] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-17T19:28:48.014712] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-17T19:28:48.027249] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-17T19:28:48.027854] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-17T19:28:48.106214] [DEBUG] [LOCAL ] HSY: Trimmed 73659 records to 51192 (keeping 200 days of data) [2025-10-17T19:28:48.119474] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-17T19:28:48.119902] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-17T19:28:48.120181] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-17T19:28:48.120290] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-17T19:28:48.120980] [DEBUG] [LOCAL ] HTD: Trimmed 19548 records to 14424 (keeping 200 days of data) [2025-10-17T19:28:48.306209] [DEBUG] [LOCAL ] HTD: Primary data saved (14424 records). [2025-10-17T19:28:48.307433] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-17T19:28:48.307564] [INFO ] [MAIN ] Update Progress: 1060/2368 symbols completed. HTD took 30.5s. Estimated remaining: 3h 3m 32s. Rate: 7.1 symbols/min [2025-10-17T19:28:48.476777] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-17T19:28:48.521258] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:48.680551] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:28:48.690172] [DEBUG] [LOCAL ] HUBB: Loaded 36713 existing records from primary storage. [2025-10-17T19:28:48.692253] [INFO ] [MAIN ] HUBB: Loaded 36713 existing records. [2025-10-17T19:28:48.763192] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-17T19:28:48.887528] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:48.888473] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-17T19:28:48.890239] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-17T19:28:48.891295] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-17T19:28:48.891364] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-17T19:28:49.276635] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:49.352245] [DEBUG] [LOCAL ] HSY: Primary data saved (51192 records). [2025-10-17T19:28:49.352408] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-17T19:28:49.352995] [INFO ] [MAIN ] Update Progress: 1061/2368 symbols completed. HSY took 39.1s. Estimated remaining: 3h 3m 15s. Rate: 7.1 symbols/min [2025-10-17T19:28:49.521378] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:49.565616] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-17T19:28:49.568774] [DEBUG] [LOCAL ] HUBS: Loaded 40357 existing records from primary storage. [2025-10-17T19:28:49.569186] [INFO ] [MAIN ] HUBS: Loaded 40357 existing records. [2025-10-17T19:28:49.751111] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:49.751336] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-17T19:28:49.751384] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-17T19:28:49.751636] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-17T19:28:49.751735] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-17T19:28:50.127747] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:50.135247] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T19:28:50.358035] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-17T19:28:50.881355] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T19:28:51.158050] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-17T19:28:51.627789] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:28:51.958010] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-17T19:28:52.103175] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T19:28:52.758081] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-17T19:28:53.400029] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:28:53.558070] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-17T19:28:54.104003] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:28:54.358100] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-17T19:28:54.927485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T19:28:55.158041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-17T19:28:55.717085] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T19:28:55.958032] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-17T19:28:56.297251] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:28:56.758042] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-17T19:28:57.005394] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T19:28:57.558023] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-17T19:28:58.363870] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-17T19:28:58.370539] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:28:58.767108] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:28:59.158058] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-17T19:28:59.958049] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-17T19:29:00.004544] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:29:00.690359] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T19:29:00.731447] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:29:00.758047] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-17T19:29:01.502516] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T19:29:01.558016] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-17T19:29:01.966421] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T19:29:01.967125] [INFO ] [REMOTE ] HTFC: Full fetch complete (838 records). [2025-10-17T19:29:01.967194] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-17T19:29:02.141208] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-17T19:29:02.141393] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:29:02.141461] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:29:02.141533] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-17T19:29:02.141598] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-17T19:29:02.141635] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-17T19:29:02.141720] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-17T19:29:02.141785] [INFO ] [MAIN ] Update Progress: 1062/2368 symbols completed. HTFC took 34.7s. Estimated remaining: 3h 3m 12s. Rate: 7.1 symbols/min [2025-10-17T19:29:02.306104] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:02.350833] [DEBUG] [LOCAL ] HUM: Loaded 49651 existing records from primary storage. [2025-10-17T19:29:02.351154] [INFO ] [MAIN ] HUM: Loaded 49651 existing records. [2025-10-17T19:29:02.363237] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-17T19:29:02.534493] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:02.534844] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-17T19:29:02.534905] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-17T19:29:02.535223] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-17T19:29:02.535284] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-17T19:29:02.884560] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:03.158034] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-17T19:29:03.958005] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-17T19:29:04.009433] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T19:29:04.414286] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:29:04.758041] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-17T19:29:05.563387] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-17T19:29:05.569486] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T19:29:06.215613] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T19:29:06.358002] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-17T19:29:07.093013] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:29:07.158030] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-17T19:29:07.792983] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:29:07.957997] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-17T19:29:08.591529] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:29:08.758007] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-17T19:29:09.456971] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T19:29:09.558022] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-17T19:29:10.125921] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:29:10.358016] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-17T19:29:10.888866] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:29:11.158025] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-17T19:29:11.708987] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:29:11.958036] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-17T19:29:12.614454] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T19:29:12.758072] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-17T19:29:13.402981] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:29:13.407916] [INFO ] [REMOTE ] HUBB: Full fetch complete (54290 records). [2025-10-17T19:29:13.408029] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-17T19:29:13.581159] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-17T19:29:13.787943] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-17T19:29:13.788049] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-17T19:29:13.788880] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-17T19:29:13.788941] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-17T19:29:13.790016] [DEBUG] [LOCAL ] HUBB: Trimmed 54290 records to 36909 (keeping 200 days of data) [2025-10-17T19:29:14.024202] [DEBUG] [LOCAL ] HUBB: Primary data saved (36909 records). [2025-10-17T19:29:14.024404] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-17T19:29:14.024502] [INFO ] [MAIN ] Update Progress: 1063/2368 symbols completed. HUBB took 25.7s. Estimated remaining: 3h 3m 8s. Rate: 7.1 symbols/min [2025-10-17T19:29:14.194473] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:14.244473] [DEBUG] [LOCAL ] HUN: Loaded 53604 existing records from primary storage. [2025-10-17T19:29:14.244798] [INFO ] [MAIN ] HUN: Loaded 53604 existing records. [2025-10-17T19:29:14.374349] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-17T19:29:14.456100] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:14.456660] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-17T19:29:14.456766] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-17T19:29:14.457280] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-17T19:29:14.457359] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-17T19:29:14.658177] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T19:29:14.858277] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:29:14.862686] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:14.867121] [INFO ] [REMOTE ] HTH: Full fetch complete (46864 records). [2025-10-17T19:29:14.867199] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-17T19:29:15.161397] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-17T19:29:15.250334] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-17T19:29:15.250410] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-17T19:29:15.251158] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-17T19:29:15.251220] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-17T19:29:15.252177] [DEBUG] [LOCAL ] HTH: Trimmed 46864 records to 33038 (keeping 200 days of data) [2025-10-17T19:29:15.445078] [DEBUG] [LOCAL ] HTH: Primary data saved (33038 records). [2025-10-17T19:29:15.445207] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-17T19:29:15.445284] [INFO ] [MAIN ] Update Progress: 1064/2368 symbols completed. HTH took 40.2s. Estimated remaining: 3h 2m 51s. Rate: 7.1 symbols/min [2025-10-17T19:29:15.616709] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:15.660567] [DEBUG] [LOCAL ] HUYA: Loaded 44168 existing records from primary storage. [2025-10-17T19:29:15.660914] [INFO ] [MAIN ] HUYA: Loaded 44168 existing records. [2025-10-17T19:29:15.845202] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:15.845508] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-17T19:29:15.845582] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-17T19:29:15.845826] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-17T19:29:15.845882] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-17T19:29:15.963108] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-17T19:29:16.204150] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:16.229455] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:29:16.758004] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-17T19:29:17.123448] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T19:29:17.351297] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T19:29:17.558011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-17T19:29:18.358066] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-17T19:29:18.384540] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:29:19.158010] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-17T19:29:19.312023] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T19:29:19.928866] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:29:19.957982] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-17T19:29:20.481063] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T19:29:20.487766] [INFO ] [REMOTE ] HUBS: Full fetch complete (56809 records). [2025-10-17T19:29:20.487937] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-17T19:29:20.763154] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-17T19:29:20.875524] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-17T19:29:20.875601] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-17T19:29:20.876440] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-17T19:29:20.876502] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-17T19:29:20.877702] [DEBUG] [LOCAL ] HUBS: Trimmed 56809 records to 40651 (keeping 200 days of data) [2025-10-17T19:29:21.123603] [DEBUG] [LOCAL ] HUBS: Primary data saved (40651 records). [2025-10-17T19:29:21.123749] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-17T19:29:21.124575] [INFO ] [MAIN ] Update Progress: 1065/2368 symbols completed. HUBS took 31.8s. Estimated remaining: 3h 2m 39s. Rate: 7.1 symbols/min [2025-10-17T19:29:21.293634] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:21.310621] [DEBUG] [LOCAL ] HVT: Loaded 15241 existing records from primary storage. [2025-10-17T19:29:21.310966] [INFO ] [MAIN ] HVT: Loaded 15241 existing records. [2025-10-17T19:29:21.489519] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:21.489764] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-17T19:29:21.489830] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-17T19:29:21.490080] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-17T19:29:21.490138] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-17T19:29:21.560280] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-17T19:29:21.807170] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T19:29:21.893263] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:22.357996] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-17T19:29:22.712707] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T19:29:22.805319] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T19:29:23.158006] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-17T19:29:23.343576] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T19:29:23.958047] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-17T19:29:24.721899] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:29:24.757986] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-17T19:29:25.558030] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-17T19:29:25.967584] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T19:29:26.358082] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-17T19:29:26.431827] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:29:27.131063] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T19:29:27.158032] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-17T19:29:27.308678] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T19:29:27.958044] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-17T19:29:28.758002] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-17T19:29:28.856840] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:29:28.931459] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T19:29:29.558031] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-17T19:29:30.358055] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-17T19:29:30.460011] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:29:31.158092] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-17T19:29:31.247358] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:29:31.958054] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-17T19:29:32.166808] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T19:29:32.758038] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-17T19:29:32.974539] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:29:32.997219] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:29:33.558013] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-17T19:29:34.187999] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:29:34.358001] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-17T19:29:34.775942] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:29:35.158084] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-17T19:29:35.958033] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-17T19:29:36.124513] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T19:29:36.763127] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-17T19:29:36.778217] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:29:37.557987] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-17T19:29:37.659948] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:29:37.757811] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T19:29:38.358037] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-17T19:29:38.948731] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T19:29:39.158083] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-17T19:29:39.958012] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-17T19:29:40.125901] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:29:40.229973] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T19:29:40.758049] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-17T19:29:41.529466] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:29:41.557987] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-17T19:29:42.358003] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-17T19:29:42.470198] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:29:43.158026] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-17T19:29:43.282954] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:29:43.283324] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T19:29:43.958038] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-17T19:29:44.758008] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-17T19:29:44.824825] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:29:44.831864] [INFO ] [REMOTE ] HUM: Full fetch complete (71107 records). [2025-10-17T19:29:44.832018] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-17T19:29:45.224439] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-17T19:29:45.224557] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-17T19:29:45.225874] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-17T19:29:45.225985] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-17T19:29:45.227451] [DEBUG] [LOCAL ] HUM: Trimmed 71107 records to 50015 (keeping 200 days of data) [2025-10-17T19:29:45.563102] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-17T19:29:45.563005] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:29:45.582728] [DEBUG] [LOCAL ] HUM: Primary data saved (50015 records). [2025-10-17T19:29:45.582856] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-17T19:29:45.582934] [INFO ] [MAIN ] Update Progress: 1066/2368 symbols completed. HUM took 43.4s. Estimated remaining: 3h 2m 50s. Rate: 7.1 symbols/min [2025-10-17T19:29:45.748672] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:45.798760] [DEBUG] [LOCAL ] HWM: Loaded 53180 existing records from primary storage. [2025-10-17T19:29:45.799079] [INFO ] [MAIN ] HWM: Loaded 53180 existing records. [2025-10-17T19:29:45.973485] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:45.973734] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-17T19:29:45.973790] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-17T19:29:45.973977] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-17T19:29:45.974015] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-17T19:29:46.325150] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:46.357978] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-17T19:29:46.468566] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T19:29:46.547554] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T19:29:47.158087] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-17T19:29:47.958000] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-17T19:29:48.120267] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:29:48.757998] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-17T19:29:48.948328] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:29:48.955620] [INFO ] [REMOTE ] HUN: Full fetch complete (76972 records). [2025-10-17T19:29:48.955784] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-17T19:29:49.349829] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-17T19:29:49.349961] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-17T19:29:49.351096] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-17T19:29:49.351239] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-17T19:29:49.352804] [DEBUG] [LOCAL ] HUN: Trimmed 76972 records to 53992 (keeping 200 days of data) [2025-10-17T19:29:49.564470] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-17T19:29:49.606136] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T19:29:49.714890] [DEBUG] [LOCAL ] HUN: Primary data saved (53992 records). [2025-10-17T19:29:49.715038] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-17T19:29:49.715138] [INFO ] [MAIN ] Update Progress: 1067/2368 symbols completed. HUN took 35.7s. Estimated remaining: 3h 2m 36s. Rate: 7.1 symbols/min [2025-10-17T19:29:49.882316] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:49.925309] [DEBUG] [LOCAL ] HXL: Loaded 46186 existing records from primary storage. [2025-10-17T19:29:49.925596] [INFO ] [MAIN ] HXL: Loaded 46186 existing records. [2025-10-17T19:29:50.099401] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:50.099627] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-17T19:29:50.099705] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-17T19:29:50.100325] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-17T19:29:50.100382] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-17T19:29:50.364327] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-17T19:29:50.464137] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:50.472793] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T19:29:50.819247] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T19:29:51.158043] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-17T19:29:51.958003] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-17T19:29:52.086934] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:29:52.093271] [INFO ] [REMOTE ] HUYA: Full fetch complete (64053 records). [2025-10-17T19:29:52.093371] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-17T19:29:52.476198] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-17T19:29:52.476315] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-17T19:29:52.477380] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-17T19:29:52.477518] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-17T19:29:52.478960] [DEBUG] [LOCAL ] HUYA: Trimmed 64053 records to 44415 (keeping 200 days of data) [2025-10-17T19:29:52.704145] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T19:29:52.759747] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-17T19:29:52.767842] [DEBUG] [LOCAL ] HUYA: Primary data saved (44415 records). [2025-10-17T19:29:52.767930] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-17T19:29:52.768006] [INFO ] [MAIN ] Update Progress: 1068/2368 symbols completed. HUYA took 37.3s. Estimated remaining: 3h 2m 21s. Rate: 7.1 symbols/min [2025-10-17T19:29:52.934817] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:52.946165] [DEBUG] [LOCAL ] HY: Loaded 10116 existing records from primary storage. [2025-10-17T19:29:52.946346] [INFO ] [MAIN ] HY: Loaded 10116 existing records. [2025-10-17T19:29:53.119862] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:53.120052] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-17T19:29:53.120098] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-17T19:29:53.120267] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-17T19:29:53.120322] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-17T19:29:53.476359] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:53.498725] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T19:29:53.557978] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-17T19:29:53.757791] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T19:29:53.760131] [INFO ] [REMOTE ] HVT: Full fetch complete (23122 records). [2025-10-17T19:29:53.760202] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-17T19:29:54.114411] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-17T19:29:54.114484] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-17T19:29:54.114909] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-17T19:29:54.114971] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-17T19:29:54.115528] [DEBUG] [LOCAL ] HVT: Trimmed 23122 records to 15340 (keeping 200 days of data) [2025-10-17T19:29:54.205891] [DEBUG] [LOCAL ] HVT: Primary data saved (15340 records). [2025-10-17T19:29:54.206061] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-17T19:29:54.206144] [INFO ] [MAIN ] Update Progress: 1069/2368 symbols completed. HVT took 33.1s. Estimated remaining: 3h 2m 5s. Rate: 7.1 symbols/min [2025-10-17T19:29:54.373360] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-17T19:29:54.375883] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:54.377123] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-17T19:29:54.377231] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-17T19:29:54.377557] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-17T19:29:54.377701] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-17T19:29:54.377817] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-17T19:29:54.377852] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-17T19:29:54.722396] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:55.077489] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:29:55.157984] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-17T19:29:55.958037] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-17T19:29:56.285358] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-17T19:29:56.389250] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T19:29:56.651142] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:29:56.758000] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-17T19:29:57.558034] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-17T19:29:57.878419] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T19:29:58.358023] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-17T19:29:58.746093] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:29:59.158040] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-17T19:29:59.966623] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-17T19:29:59.969143] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:30:00.758063] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-17T19:30:00.817755] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:30:01.080780] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:30:01.558038] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-17T19:30:02.358089] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-17T19:30:02.381061] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:30:03.158081] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-17T19:30:03.773216] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:30:03.958009] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-17T19:30:04.692636] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-10-17T19:30:04.758022] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-17T19:30:04.878753] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:30:04.886473] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:30:05.558026] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-17T19:30:06.358016] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-17T19:30:06.433803] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T19:30:06.701603] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T19:30:06.705895] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:30:07.158042] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-17T19:30:07.958046] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-17T19:30:08.062623] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T19:30:08.206625] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-17T19:30:08.758046] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-17T19:30:09.558051] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-17T19:30:09.886872] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T19:30:10.358009] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-17T19:30:10.672544] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T19:30:11.158075] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-17T19:30:11.582349] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T19:30:11.958161] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-17T19:30:12.021933] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T19:30:12.194128] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-17T19:30:12.758086] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-17T19:30:13.558043] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-17T19:30:14.358012] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-17T19:30:14.414006] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:30:14.582367] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-17T19:30:14.650914] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T19:30:15.158020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-17T19:30:15.958027] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-17T19:30:16.669860] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T19:30:16.758060] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-17T19:30:17.530480] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T19:30:17.531314] [INFO ] [REMOTE ] HYAC: Full fetch complete (922 records). [2025-10-17T19:30:17.531383] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-17T19:30:17.531762] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T19:30:17.531858] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:30:17.531940] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:30:17.532032] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-17T19:30:17.532119] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-17T19:30:17.532156] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-17T19:30:17.532195] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-17T19:30:17.532246] [INFO ] [MAIN ] Update Progress: 1070/2368 symbols completed. HYAC took 23.3s. Estimated remaining: 3h 2m 14s. Rate: 7.1 symbols/min [2025-10-17T19:30:17.563136] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-17T19:30:17.712121] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:17.712289] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-17T19:30:17.712326] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-17T19:30:17.712469] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-17T19:30:17.712544] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-17T19:30:17.712604] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-17T19:30:17.712639] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-17T19:30:18.073113] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:18.360500] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-17T19:30:18.366401] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T19:30:18.875158] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T19:30:19.158077] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-17T19:30:19.958067] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-17T19:30:20.304437] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T19:30:20.311501] [INFO ] [REMOTE ] HWM: Full fetch complete (76668 records). [2025-10-17T19:30:20.311630] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-17T19:30:20.745634] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-17T19:30:20.745849] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-17T19:30:20.747149] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-17T19:30:20.747586] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-17T19:30:20.763046] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-17T19:30:20.775903] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T19:30:20.787041] [DEBUG] [LOCAL ] HWM: Trimmed 76668 records to 53536 (keeping 200 days of data) [2025-10-17T19:30:20.886767] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T19:30:21.141859] [DEBUG] [LOCAL ] HWM: Primary data saved (53536 records). [2025-10-17T19:30:21.142009] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-17T19:30:21.142094] [INFO ] [MAIN ] Update Progress: 1071/2368 symbols completed. HWM took 35.6s. Estimated remaining: 3h 2m 0s. Rate: 7.1 symbols/min [2025-10-17T19:30:21.211916] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-17T19:30:21.323719] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:21.337966] [DEBUG] [LOCAL ] HYI: Loaded 9891 existing records from primary storage. [2025-10-17T19:30:21.338203] [INFO ] [MAIN ] HYI: Loaded 9891 existing records. [2025-10-17T19:30:21.512239] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:21.512481] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-17T19:30:21.512529] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-17T19:30:21.512758] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-17T19:30:21.512816] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-17T19:30:21.563941] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-17T19:30:21.862637] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:21.963845] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-17T19:30:22.358117] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-17T19:30:23.158040] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-17T19:30:23.391599] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-17T19:30:23.958030] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-17T19:30:24.063549] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:30:24.500776] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T19:30:24.758048] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-17T19:30:25.558039] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-17T19:30:26.289691] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:30:26.358034] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-17T19:30:26.499768] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:30:27.158073] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-17T19:30:27.921748] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T19:30:27.943693] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:30:27.945451] [INFO ] [REMOTE ] HY: Full fetch complete (14993 records). [2025-10-17T19:30:27.945521] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-17T19:30:27.965726] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-17T19:30:28.312725] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-17T19:30:28.312812] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-17T19:30:28.313133] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-17T19:30:28.313172] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-17T19:30:28.313736] [DEBUG] [LOCAL ] HY: Trimmed 14993 records to 10191 (keeping 200 days of data) [2025-10-17T19:30:28.373880] [DEBUG] [LOCAL ] HY: Primary data saved (10191 records). [2025-10-17T19:30:28.373997] [INFO ] [MAIN ] HY: Full history saved. [2025-10-17T19:30:28.374076] [INFO ] [MAIN ] Update Progress: 1072/2368 symbols completed. HY took 35.6s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-17T19:30:28.538606] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:28.570844] [DEBUG] [LOCAL ] HYT: Loaded 33837 existing records from primary storage. [2025-10-17T19:30:28.571107] [INFO ] [MAIN ] HYT: Loaded 33837 existing records. [2025-10-17T19:30:28.743905] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:28.744098] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-17T19:30:28.744145] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-17T19:30:28.744352] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-17T19:30:28.744418] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-17T19:30:28.764416] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-17T19:30:29.099478] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:29.355615] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T19:30:29.558019] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-17T19:30:29.737497] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T19:30:29.744498] [INFO ] [REMOTE ] HXL: Full fetch complete (66543 records). [2025-10-17T19:30:29.744661] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-17T19:30:30.129208] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-17T19:30:30.129305] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-17T19:30:30.130269] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-17T19:30:30.130350] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-17T19:30:30.134222] [DEBUG] [LOCAL ] HXL: Trimmed 66543 records to 46542 (keeping 200 days of data) [2025-10-17T19:30:30.351863] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T19:30:30.358840] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-17T19:30:30.429276] [DEBUG] [LOCAL ] HXL: Primary data saved (46542 records). [2025-10-17T19:30:30.429409] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-17T19:30:30.429504] [INFO ] [MAIN ] Update Progress: 1073/2368 symbols completed. HXL took 40.7s. Estimated remaining: 3h 1m 34s. Rate: 7.1 symbols/min [2025-10-17T19:30:30.600691] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:30.603578] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-17T19:30:30.609685] [DEBUG] [LOCAL ] HYTR: Loaded 3165 existing records from primary storage. [2025-10-17T19:30:30.609868] [INFO ] [MAIN ] HYTR: Loaded 3165 existing records. [2025-10-17T19:30:30.781459] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:30.781739] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-17T19:30:30.781813] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-17T19:30:30.781993] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-17T19:30:30.782059] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-17T19:30:31.132958] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:31.157986] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-17T19:30:31.906933] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T19:30:31.957989] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-17T19:30:32.758012] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-17T19:30:32.872676] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T19:30:33.065743] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-17T19:30:33.558029] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-17T19:30:34.009910] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T19:30:34.358025] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-17T19:30:34.694857] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T19:30:35.158058] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-17T19:30:35.719303] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T19:30:35.958056] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-17T19:30:36.271629] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-17T19:30:36.758080] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-17T19:30:37.301783] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T19:30:37.558049] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-17T19:30:38.358046] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-17T19:30:38.715971] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T19:30:39.109204] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T19:30:39.158063] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-17T19:30:39.454060] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-17T19:30:39.958075] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-17T19:30:40.292701] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T19:30:40.758056] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-17T19:30:41.074174] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T19:30:41.558046] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-17T19:30:42.282418] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T19:30:42.358007] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-17T19:30:42.615970] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-17T19:30:43.158062] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-17T19:30:43.765432] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:30:43.958025] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-17T19:30:44.395041] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T19:30:44.395737] [INFO ] [REMOTE ] HYBX: Full fetch complete (703 records). [2025-10-17T19:30:44.395807] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-17T19:30:44.574734] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-17T19:30:44.574964] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:30:44.575053] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:30:44.575150] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-17T19:30:44.575252] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-17T19:30:44.575292] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-17T19:30:44.575333] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-17T19:30:44.575390] [INFO ] [MAIN ] Update Progress: 1074/2368 symbols completed. HYBX took 27.0s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-17T19:30:44.749231] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:44.758079] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-17T19:30:44.779906] [DEBUG] [LOCAL ] HZO: Loaded 29275 existing records from primary storage. [2025-10-17T19:30:44.780191] [INFO ] [MAIN ] HZO: Loaded 29275 existing records. [2025-10-17T19:30:44.953815] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:44.954028] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-17T19:30:44.954078] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-17T19:30:44.954292] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-17T19:30:44.954352] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-17T19:30:45.313565] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:45.318576] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-17T19:30:45.558036] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-17T19:30:46.361760] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-17T19:30:46.363887] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T19:30:46.917276] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:30:47.158043] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-17T19:30:47.904731] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T19:30:47.958051] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-17T19:30:48.758049] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-17T19:30:49.455306] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T19:30:49.487691] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T19:30:49.558029] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-17T19:30:50.358028] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-17T19:30:50.549467] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:30:50.551976] [INFO ] [REMOTE ] HYI: Full fetch complete (13983 records). [2025-10-17T19:30:50.552064] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-17T19:30:50.929506] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:30:50.941597] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-17T19:30:50.941685] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-17T19:30:50.942006] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-17T19:30:50.942047] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-17T19:30:50.942505] [DEBUG] [LOCAL ] HYI: Trimmed 13983 records to 9962 (keeping 200 days of data) [2025-10-17T19:30:51.001997] [DEBUG] [LOCAL ] HYI: Primary data saved (9962 records). [2025-10-17T19:30:51.002140] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-17T19:30:51.002253] [INFO ] [MAIN ] Update Progress: 1075/2368 symbols completed. HYI took 29.9s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-17T19:30:51.163680] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-17T19:30:51.183334] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:51.192385] [DEBUG] [LOCAL ] IAE: Loaded 6326 existing records from primary storage. [2025-10-17T19:30:51.192581] [INFO ] [MAIN ] IAE: Loaded 6326 existing records. [2025-10-17T19:30:51.370879] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:51.371086] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-17T19:30:51.371135] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-17T19:30:51.371296] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-17T19:30:51.371353] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-17T19:30:51.717629] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:51.957993] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-17T19:30:52.268874] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:30:52.631005] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T19:30:52.757987] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-17T19:30:53.490220] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T19:30:53.558019] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-17T19:30:54.139193] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T19:30:54.358036] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-17T19:30:55.158100] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-17T19:30:55.709387] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T19:30:55.797671] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T19:30:55.958054] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-17T19:30:56.470980] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-17T19:30:56.758047] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-17T19:30:57.531052] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T19:30:57.558026] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-17T19:30:58.358000] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-17T19:30:58.686865] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:30:58.953963] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T19:30:58.955140] [INFO ] [REMOTE ] HYTR: Full fetch complete (4689 records). [2025-10-17T19:30:58.955215] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-17T19:30:59.164429] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-17T19:30:59.321389] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-17T19:30:59.321465] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-17T19:30:59.321639] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-17T19:30:59.321721] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-17T19:30:59.322082] [DEBUG] [LOCAL ] HYTR: Trimmed 4689 records to 3189 (keeping 200 days of data) [2025-10-17T19:30:59.343880] [DEBUG] [LOCAL ] HYTR: Primary data saved (3189 records). [2025-10-17T19:30:59.343959] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-17T19:30:59.344054] [INFO ] [MAIN ] Update Progress: 1076/2368 symbols completed. HYTR took 28.9s. Estimated remaining: 3h 1m 13s. Rate: 7.1 symbols/min [2025-10-17T19:30:59.513229] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:59.566969] [DEBUG] [LOCAL ] IAG: Loaded 53878 existing records from primary storage. [2025-10-17T19:30:59.567326] [INFO ] [MAIN ] IAG: Loaded 53878 existing records. [2025-10-17T19:30:59.741106] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:59.741314] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-17T19:30:59.741367] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-17T19:30:59.741571] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-17T19:30:59.741627] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-17T19:30:59.966407] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-17T19:31:00.089172] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:00.758009] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-17T19:31:01.130484] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T19:31:01.150871] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T19:31:01.558017] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-17T19:31:02.358030] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-17T19:31:02.627988] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T19:31:03.158085] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-17T19:31:03.238331] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:31:03.854523] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:31:03.958028] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-17T19:31:04.758049] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-17T19:31:04.921070] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:31:05.366501] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:31:05.378400] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:31:05.558036] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-17T19:31:06.330294] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T19:31:06.358013] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-17T19:31:07.158038] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-17T19:31:07.796870] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T19:31:07.958126] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-17T19:31:08.330994] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T19:31:08.758093] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-17T19:31:09.207894] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T19:31:09.491010] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T19:31:09.558027] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-17T19:31:10.343108] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:31:10.344891] [INFO ] [REMOTE ] IAE: Full fetch complete (9010 records). [2025-10-17T19:31:10.344976] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-17T19:31:10.365284] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-17T19:31:10.696707] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-17T19:31:10.696812] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-17T19:31:10.697109] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-17T19:31:10.697167] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-17T19:31:10.697687] [DEBUG] [LOCAL ] IAE: Trimmed 9010 records to 6362 (keeping 200 days of data) [2025-10-17T19:31:10.735161] [DEBUG] [LOCAL ] IAE: Primary data saved (6362 records). [2025-10-17T19:31:10.735313] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-17T19:31:10.735419] [INFO ] [MAIN ] Update Progress: 1077/2368 symbols completed. IAE took 19.7s. Estimated remaining: 3h 1m 8s. Rate: 7.1 symbols/min [2025-10-17T19:31:11.158051] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-17T19:31:11.830217] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:31:11.958038] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-17T19:31:12.758150] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-17T19:31:12.985467] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:31:13.252590] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:31:13.558038] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-17T19:31:14.180485] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T19:31:14.358064] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-17T19:31:14.709952] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T19:31:15.158082] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-17T19:31:15.872483] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:31:15.958053] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-17T19:31:16.008049] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T19:31:16.758052] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-17T19:31:17.558003] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-17T19:31:18.071354] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T19:31:18.119001] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T19:31:18.358036] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-17T19:31:18.702369] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:31:19.158079] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-17T19:31:19.687827] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:31:19.692768] [INFO ] [REMOTE ] HYT: Full fetch complete (48060 records). [2025-10-17T19:31:19.692860] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-17T19:31:19.970081] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-17T19:31:20.090541] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-17T19:31:20.090615] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-17T19:31:20.091392] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-17T19:31:20.091448] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-17T19:31:20.092405] [DEBUG] [LOCAL ] HYT: Trimmed 48060 records to 34156 (keeping 200 days of data) [2025-10-17T19:31:20.291793] [DEBUG] [LOCAL ] HYT: Primary data saved (34156 records). [2025-10-17T19:31:20.291918] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-17T19:31:20.291994] [INFO ] [MAIN ] Update Progress: 1078/2368 symbols completed. HYT took 51.9s. Estimated remaining: 3h 1m 1s. Rate: 7.1 symbols/min [2025-10-17T19:31:20.419360] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:31:20.758230] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-17T19:31:21.882781] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T19:31:21.894007] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-17T19:31:22.058702] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:31:22.358086] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-17T19:31:23.565558] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T19:31:23.572475] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-17T19:31:23.678637] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:31:23.958013] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-17T19:31:24.854604] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:31:24.859406] [INFO ] [REMOTE ] HZO: Full fetch complete (41379 records). [2025-10-17T19:31:24.859520] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-17T19:31:25.229114] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-17T19:31:25.229312] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-17T19:31:25.230136] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-17T19:31:25.230201] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-17T19:31:25.231329] [DEBUG] [LOCAL ] HZO: Trimmed 41379 records to 29442 (keeping 200 days of data) [2025-10-17T19:31:25.404369] [DEBUG] [LOCAL ] HZO: Primary data saved (29442 records). [2025-10-17T19:31:25.404494] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-17T19:31:25.404571] [INFO ] [MAIN ] Update Progress: 1079/2368 symbols completed. HZO took 40.8s. Estimated remaining: 3h 0m 49s. Rate: 7.1 symbols/min [2025-10-17T19:31:25.871922] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:31:25.883266] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-17T19:31:27.724692] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T19:31:27.736161] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-17T19:31:29.769328] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T19:31:29.780911] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-17T19:31:31.801198] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T19:31:31.808923] [INFO ] [REMOTE ] IAG: Full fetch complete (77493 records). [2025-10-17T19:31:31.809188] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-17T19:31:32.208191] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-17T19:31:32.208285] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-17T19:31:32.209356] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-17T19:31:32.209429] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-17T19:31:32.210968] [DEBUG] [LOCAL ] IAG: Trimmed 77493 records to 54268 (keeping 200 days of data) [2025-10-17T19:31:32.530118] [DEBUG] [LOCAL ] IAG: Primary data saved (54268 records). [2025-10-17T19:31:32.530287] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-17T19:31:32.530387] [INFO ] [MAIN ] Update Progress: 1080/2368 symbols completed. IAG took 33.2s. Estimated remaining: 3h 0m 39s. Rate: 7.1 symbols/min [2025-10-17T19:31:33.219094] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.282767] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.321092] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.325244] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.390050] [DEBUG] [LOCAL ] IBP: Loaded 29018 existing records from primary storage. [2025-10-17T19:31:33.404683] [DEBUG] [LOCAL ] IBTA: Loaded 36892 existing records from primary storage. [2025-10-17T19:31:33.405596] [INFO ] [MAIN ] IBTA: Loaded 36892 existing records. [2025-10-17T19:31:33.405193] [INFO ] [MAIN ] IBP: Loaded 29018 existing records. [2025-10-17T19:31:33.645763] [DEBUG] [LOCAL ] IBN: Loaded 53205 existing records from primary storage. [2025-10-17T19:31:33.668014] [DEBUG] [LOCAL ] IBM: Loaded 54023 existing records from primary storage. [2025-10-17T19:31:33.678752] [INFO ] [MAIN ] IBN: Loaded 53205 existing records. [2025-10-17T19:31:33.714563] [INFO ] [MAIN ] IBM: Loaded 54023 existing records. [2025-10-17T19:31:33.944738] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.055968] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.080977] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-17T19:31:34.187916] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.215871] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-17T19:31:34.287705] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.287929] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-17T19:31:34.308716] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.314236] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-17T19:31:34.371583] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.378940] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-17T19:31:34.404594] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-17T19:31:34.408965] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.430408] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-17T19:31:34.430269] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-17T19:31:34.430679] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-17T19:31:34.440279] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.509207] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-17T19:31:34.602324] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-17T19:31:34.634420] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-17T19:31:35.763324] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.796760] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.833382] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-17T19:31:35.873522] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-17T19:31:35.938926] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.967076] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.967980] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-17T19:31:35.968622] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-17T19:31:37.198673] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T19:31:37.200120] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T19:31:37.208010] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-17T19:31:37.214191] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-17T19:31:37.746348] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:31:37.756871] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-17T19:31:38.346588] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:31:38.352335] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-17T19:31:38.395717] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-17T19:31:38.407076] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-17T19:31:38.425307] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T19:31:38.430776] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-17T19:31:39.451435] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T19:31:39.458157] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-17T19:31:39.492773] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:31:39.504591] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-17T19:31:39.543701] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T19:31:39.549636] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-17T19:31:40.262937] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T19:31:40.273800] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-17T19:31:40.961144] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T19:31:40.967766] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-17T19:31:41.063115] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T19:31:41.072984] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-17T19:31:41.123277] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:31:41.133280] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-17T19:31:42.346300] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T19:31:42.353354] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-17T19:31:42.384804] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T19:31:42.394879] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-17T19:31:42.591257] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:31:42.602868] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-17T19:31:42.639946] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:31:43.158028] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-17T19:31:43.384016] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T19:31:43.958011] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-17T19:31:44.363466] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T19:31:44.511992] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:31:44.589846] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:31:44.758002] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-17T19:31:45.158809] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T19:31:45.563139] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-17T19:31:45.573097] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T19:31:46.358082] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-17T19:31:47.158050] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-17T19:31:47.425044] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:31:47.958108] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-17T19:31:48.128453] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T19:31:48.683424] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T19:31:48.758067] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-17T19:31:49.251708] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:31:49.558067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-17T19:31:50.358082] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-17T19:31:50.554037] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:31:51.101943] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T19:31:51.158037] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-17T19:31:51.780552] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T19:31:51.958080] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-17T19:31:52.757998] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-17T19:31:53.034760] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T19:31:53.558043] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-17T19:31:53.976471] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T19:31:54.184699] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-17T19:31:54.358028] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-17T19:31:55.165329] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-17T19:31:55.189008] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T19:31:55.599357] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T19:31:55.958032] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-17T19:31:56.758002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-17T19:31:57.265045] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T19:31:57.383054] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:31:57.388047] [INFO ] [REMOTE ] IBTA: Full fetch complete (51237 records). [2025-10-17T19:31:57.388145] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-17T19:31:57.563318] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-17T19:31:57.794738] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-17T19:31:57.794839] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-17T19:31:57.795761] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-17T19:31:57.795837] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-17T19:31:57.807532] [DEBUG] [LOCAL ] IBTA: Trimmed 51237 records to 37129 (keeping 200 days of data) [2025-10-17T19:31:57.807398] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T19:31:57.812108] [INFO ] [REMOTE ] IBP: Full fetch complete (41026 records). [2025-10-17T19:31:57.812251] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-17T19:31:58.329754] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-17T19:31:58.329918] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-17T19:31:58.331673] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-17T19:31:58.370379] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-17T19:31:58.379332] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-17T19:31:58.408432] [DEBUG] [LOCAL ] IBP: Trimmed 41026 records to 29142 (keeping 200 days of data) [2025-10-17T19:31:58.526606] [DEBUG] [LOCAL ] IBTA: Primary data saved (37129 records). [2025-10-17T19:31:58.527698] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-17T19:31:58.528100] [INFO ] [MAIN ] Update Progress: 1081/2368 symbols completed. IBTA took 26.0s. Estimated remaining: 3h 0m 52s. Rate: 7.1 symbols/min [2025-10-17T19:31:58.711450] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:58.816256] [DEBUG] [LOCAL ] ICE: Loaded 53408 existing records from primary storage. [2025-10-17T19:31:58.817363] [INFO ] [MAIN ] ICE: Loaded 53408 existing records. [2025-10-17T19:31:58.988325] [DEBUG] [LOCAL ] IBP: Primary data saved (29142 records). [2025-10-17T19:31:58.996933] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-17T19:31:59.009956] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:59.004477] [INFO ] [MAIN ] Update Progress: 1082/2368 symbols completed. IBP took 26.5s. Estimated remaining: 3h 0m 34s. Rate: 7.1 symbols/min [2025-10-17T19:31:59.010354] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-17T19:31:59.042271] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-17T19:31:59.080538] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-17T19:31:59.086428] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-17T19:31:59.325240] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:59.559818] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:59.570031] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-17T19:31:59.572132] [DEBUG] [LOCAL ] ICL: Loaded 38831 existing records from primary storage. [2025-10-17T19:31:59.572338] [INFO ] [MAIN ] ICL: Loaded 38831 existing records. [2025-10-17T19:31:59.762537] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:59.763185] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-17T19:31:59.763251] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-17T19:31:59.763605] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-17T19:31:59.763717] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-17T19:32:00.212765] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-17T19:32:00.216091] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:00.227561] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-17T19:32:00.261906] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T19:32:00.758018] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-17T19:32:01.558028] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-17T19:32:01.844926] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-17T19:32:02.183400] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T19:32:02.358084] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-17T19:32:03.158034] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-17T19:32:03.244373] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:32:03.252464] [INFO ] [REMOTE ] IBN: Full fetch complete (76594 records). [2025-10-17T19:32:03.252778] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-17T19:32:03.588341] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-17T19:32:03.696239] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-17T19:32:03.696316] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-17T19:32:03.697432] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-17T19:32:03.697499] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-17T19:32:03.699001] [DEBUG] [LOCAL ] IBN: Trimmed 76594 records to 53593 (keeping 200 days of data) [2025-10-17T19:32:03.985427] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-17T19:32:04.038714] [DEBUG] [LOCAL ] IBN: Primary data saved (53593 records). [2025-10-17T19:32:04.038869] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-17T19:32:04.038953] [INFO ] [MAIN ] Update Progress: 1083/2368 symbols completed. IBN took 31.5s. Estimated remaining: 3h 0m 21s. Rate: 7.1 symbols/min [2025-10-17T19:32:04.213387] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:04.261779] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T19:32:04.296414] [DEBUG] [LOCAL ] IDA: Loaded 32985 existing records from primary storage. [2025-10-17T19:32:04.296768] [INFO ] [MAIN ] IDA: Loaded 32985 existing records. [2025-10-17T19:32:04.486318] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:04.486510] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-17T19:32:04.486559] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-17T19:32:04.487223] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-17T19:32:04.487281] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-17T19:32:04.763319] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-17T19:32:04.782403] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:32:04.886874] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:05.558048] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-17T19:32:06.358012] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-17T19:32:06.482061] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-17T19:32:06.520589] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T19:32:06.737515] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T19:32:07.158082] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-17T19:32:07.839016] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:32:07.958058] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-17T19:32:08.758035] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-17T19:32:08.907602] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T19:32:09.558024] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-17T19:32:09.592472] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:32:10.077143] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T19:32:10.358106] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-17T19:32:11.158096] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-17T19:32:11.183472] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T19:32:11.191932] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-17T19:32:11.192121] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-17T19:32:11.594202] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-17T19:32:11.594298] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-17T19:32:11.595347] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-17T19:32:11.605433] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-17T19:32:11.625216] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T19:32:11.635943] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 54411 (keeping 200 days of data) [2025-10-17T19:32:11.958122] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-17T19:32:11.979228] [DEBUG] [LOCAL ] IBM: Primary data saved (54411 records). [2025-10-17T19:32:11.979422] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-17T19:32:11.979512] [INFO ] [MAIN ] Update Progress: 1084/2368 symbols completed. IBM took 39.4s. Estimated remaining: 3h 0m 12s. Rate: 7.1 symbols/min [2025-10-17T19:32:12.149124] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:12.160509] [DEBUG] [LOCAL ] IDE: Loaded 9225 existing records from primary storage. [2025-10-17T19:32:12.160760] [INFO ] [MAIN ] IDE: Loaded 9225 existing records. [2025-10-17T19:32:12.335256] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:12.335448] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-17T19:32:12.335520] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-17T19:32:12.335790] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-17T19:32:12.335910] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-17T19:32:12.719188] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:12.721111] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:32:12.757977] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-17T19:32:13.261864] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:32:13.285678] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T19:32:13.557993] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-17T19:32:14.312061] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T19:32:14.357999] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-17T19:32:15.065212] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T19:32:15.158067] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-17T19:32:15.842190] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T19:32:15.958114] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-17T19:32:16.758079] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-17T19:32:17.366376] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:32:17.558034] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-17T19:32:18.310991] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T19:32:18.357994] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-17T19:32:18.780432] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:32:19.158053] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-17T19:32:19.840063] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:32:19.870836] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T19:32:19.958039] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-17T19:32:20.703226] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T19:32:20.757994] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-17T19:32:21.514162] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T19:32:21.558003] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-17T19:32:22.358026] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-17T19:32:23.158005] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-17T19:32:23.223572] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T19:32:23.224231] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T19:32:23.958000] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-17T19:32:24.132066] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T19:32:24.758074] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-17T19:32:25.440492] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:32:25.558026] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-17T19:32:26.358075] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-17T19:32:26.537708] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:32:26.920023] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:32:27.135196] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T19:32:27.158073] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-17T19:32:27.958080] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-17T19:32:28.549766] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:32:28.555029] [INFO ] [REMOTE ] ICL: Full fetch complete (56146 records). [2025-10-17T19:32:28.555135] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-17T19:32:28.765041] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-17T19:32:28.981209] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-17T19:32:28.981303] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-17T19:32:28.982186] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-17T19:32:28.982253] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-17T19:32:28.983482] [DEBUG] [LOCAL ] ICL: Trimmed 56146 records to 39044 (keeping 200 days of data) [2025-10-17T19:32:29.231662] [DEBUG] [LOCAL ] ICL: Primary data saved (39044 records). [2025-10-17T19:32:29.231826] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-17T19:32:29.231926] [INFO ] [MAIN ] Update Progress: 1085/2368 symbols completed. ICL took 30.2s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-17T19:32:29.413313] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:29.433920] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:32:29.456182] [DEBUG] [LOCAL ] IDT: Loaded 18660 existing records from primary storage. [2025-10-17T19:32:29.456431] [INFO ] [MAIN ] IDT: Loaded 18660 existing records. [2025-10-17T19:32:29.563124] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-17T19:32:29.644179] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:29.645453] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T19:32:29.645082] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-17T19:32:29.647977] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-17T19:32:29.648974] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-17T19:32:29.649089] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-17T19:32:30.003312] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:30.358058] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-17T19:32:31.158127] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-17T19:32:31.203552] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:32:31.307147] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:32:31.958010] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-17T19:32:32.733848] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:32:32.758029] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-17T19:32:32.816671] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:32:33.558041] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-17T19:32:34.063052] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T19:32:34.358092] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-17T19:32:34.414445] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T19:32:34.416430] [INFO ] [REMOTE ] IDE: Full fetch complete (12799 records). [2025-10-17T19:32:34.416509] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-17T19:32:34.777767] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-17T19:32:34.777852] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-17T19:32:34.778153] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-17T19:32:34.778192] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-17T19:32:34.778717] [DEBUG] [LOCAL ] IDE: Trimmed 12799 records to 9258 (keeping 200 days of data) [2025-10-17T19:32:34.835496] [DEBUG] [LOCAL ] IDE: Primary data saved (9258 records). [2025-10-17T19:32:34.835637] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-17T19:32:34.835762] [INFO ] [MAIN ] Update Progress: 1086/2368 symbols completed. IDE took 22.9s. Estimated remaining: 3h 0m 2s. Rate: 7.1 symbols/min [2025-10-17T19:32:35.009790] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:35.047491] [DEBUG] [LOCAL ] IEX: Loaded 38731 existing records from primary storage. [2025-10-17T19:32:35.047849] [INFO ] [MAIN ] IEX: Loaded 38731 existing records. [2025-10-17T19:32:35.155828] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T19:32:35.158011] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-17T19:32:35.239787] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:35.240012] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-17T19:32:35.240062] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-17T19:32:35.240834] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-17T19:32:35.240894] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-17T19:32:35.585472] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:35.958043] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-17T19:32:36.549567] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:32:36.758114] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-17T19:32:36.962610] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T19:32:37.558018] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-17T19:32:38.019315] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T19:32:38.357996] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-17T19:32:38.801733] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:32:39.158066] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-17T19:32:39.615869] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T19:32:39.958057] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-17T19:32:40.539749] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T19:32:40.758097] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-17T19:32:41.362672] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T19:32:41.367465] [INFO ] [REMOTE ] IDA: Full fetch complete (45271 records). [2025-10-17T19:32:41.367546] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-17T19:32:41.567687] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-17T19:32:41.747635] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-17T19:32:41.747739] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-17T19:32:41.748482] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-17T19:32:41.748528] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-17T19:32:41.750107] [DEBUG] [LOCAL ] IDA: Trimmed 45271 records to 33149 (keeping 200 days of data) [2025-10-17T19:32:41.954029] [DEBUG] [LOCAL ] IDA: Primary data saved (33149 records). [2025-10-17T19:32:41.954156] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-17T19:32:41.954936] [INFO ] [MAIN ] Update Progress: 1087/2368 symbols completed. IDA took 37.9s. Estimated remaining: 2h 59m 52s. Rate: 7.1 symbols/min [2025-10-17T19:32:42.119234] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:42.168201] [DEBUG] [LOCAL ] IFF: Loaded 51530 existing records from primary storage. [2025-10-17T19:32:42.168502] [INFO ] [MAIN ] IFF: Loaded 51530 existing records. [2025-10-17T19:32:42.350324] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:42.350571] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-17T19:32:42.350630] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-17T19:32:42.351164] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-17T19:32:42.351231] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-17T19:32:42.382049] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-17T19:32:42.709002] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:42.721204] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T19:32:42.754610] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T19:32:43.158025] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-17T19:32:43.887353] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:32:43.957984] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-17T19:32:44.095583] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T19:32:44.758029] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-17T19:32:45.474767] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:32:45.557995] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-17T19:32:46.358011] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-17T19:32:46.535837] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:32:47.148437] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:32:47.157995] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-17T19:32:47.161213] [INFO ] [REMOTE ] ICE: Full fetch complete (76984 records). [2025-10-17T19:32:47.161320] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-17T19:32:47.479684] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:32:47.578747] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-17T19:32:47.578828] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-17T19:32:47.579805] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-17T19:32:47.579887] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-17T19:32:47.581326] [DEBUG] [LOCAL ] ICE: Trimmed 76984 records to 53798 (keeping 200 days of data) [2025-10-17T19:32:47.922756] [DEBUG] [LOCAL ] ICE: Primary data saved (53798 records). [2025-10-17T19:32:47.922885] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-17T19:32:47.922976] [INFO ] [MAIN ] Update Progress: 1088/2368 symbols completed. ICE took 49.4s. Estimated remaining: 2h 59m 41s. Rate: 7.1 symbols/min [2025-10-17T19:32:47.965280] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-17T19:32:48.092551] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:48.112631] [DEBUG] [LOCAL ] IFN: Loaded 18627 existing records from primary storage. [2025-10-17T19:32:48.112876] [INFO ] [MAIN ] IFN: Loaded 18627 existing records. [2025-10-17T19:32:48.291710] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:48.291968] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-17T19:32:48.292038] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-17T19:32:48.292302] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-17T19:32:48.292367] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-17T19:32:48.640607] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:48.690967] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T19:32:48.758009] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-17T19:32:49.068196] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T19:32:49.558050] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-17T19:32:50.358036] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-17T19:32:50.417388] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T19:32:50.552577] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T19:32:51.158038] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-17T19:32:51.753036] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T19:32:51.958026] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-17T19:32:52.758884] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-17T19:32:52.762146] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:32:53.150297] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T19:32:53.558025] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-17T19:32:53.584085] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T19:32:54.358028] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-17T19:32:55.158064] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-17T19:32:55.251280] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:32:55.711208] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T19:32:55.832431] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T19:32:55.958026] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-17T19:32:56.758038] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-17T19:32:57.557992] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-17T19:32:57.778817] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T19:32:57.879743] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:32:58.358051] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-17T19:32:59.044610] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T19:32:59.158047] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-17T19:32:59.323220] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T19:32:59.958083] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-17T19:33:00.354155] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:33:00.758077] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-17T19:33:01.558056] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-17T19:33:01.767095] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T19:33:02.358100] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-17T19:33:03.158118] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-17T19:33:03.526624] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-17T19:33:03.531798] [INFO ] [REMOTE ] IEX: Full fetch complete (53760 records). [2025-10-17T19:33:03.531923] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-17T19:33:03.926581] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-17T19:33:03.926690] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-17T19:33:03.927521] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-17T19:33:03.927585] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-17T19:33:03.928735] [DEBUG] [LOCAL ] IEX: Trimmed 53760 records to 38977 (keeping 200 days of data) [2025-10-17T19:33:04.173700] [DEBUG] [LOCAL ] IEX: Primary data saved (38977 records). [2025-10-17T19:33:04.173841] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-17T19:33:04.173971] [INFO ] [MAIN ] Update Progress: 1089/2368 symbols completed. IEX took 29.3s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-17T19:33:04.361920] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:04.376039] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:33:04.381085] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-17T19:33:04.399623] [DEBUG] [LOCAL ] IFS: Loaded 22745 existing records from primary storage. [2025-10-17T19:33:04.399938] [INFO ] [MAIN ] IFS: Loaded 22745 existing records. [2025-10-17T19:33:04.591236] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:04.591581] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-17T19:33:04.591736] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-17T19:33:04.592080] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-17T19:33:04.592253] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-17T19:33:04.706889] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-17T19:33:04.736266] [INFO ] [REMOTE ] IDT: Full fetch complete (23892 records). [2025-10-17T19:33:04.760521] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-17T19:33:04.829073] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-17T19:33:04.993293] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-17T19:33:05.298852] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:05.420081] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-17T19:33:05.420233] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-17T19:33:05.420877] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-17T19:33:05.420943] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-17T19:33:05.421755] [DEBUG] [LOCAL ] IDT: Trimmed 23892 records to 18788 (keeping 200 days of data) [2025-10-17T19:33:05.527603] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T19:33:05.558764] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-17T19:33:05.562588] [DEBUG] [LOCAL ] IDT: Primary data saved (18788 records). [2025-10-17T19:33:05.562754] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-17T19:33:05.562847] [INFO ] [MAIN ] Update Progress: 1090/2368 symbols completed. IDT took 36.3s. Estimated remaining: 2h 59m 25s. Rate: 7.1 symbols/min [2025-10-17T19:33:05.728289] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:05.740419] [DEBUG] [LOCAL ] IGA: Loaded 10286 existing records from primary storage. [2025-10-17T19:33:05.740632] [INFO ] [MAIN ] IGA: Loaded 10286 existing records. [2025-10-17T19:33:05.923101] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:05.923316] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-17T19:33:05.923365] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-17T19:33:05.923513] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-17T19:33:05.923550] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-17T19:33:06.274259] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:06.358014] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-17T19:33:06.431115] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T19:33:06.636453] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:33:06.988270] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T19:33:07.158035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-17T19:33:07.901895] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T19:33:07.958003] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-17T19:33:08.687485] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T19:33:08.757998] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-17T19:33:09.465562] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-17T19:33:09.558002] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-17T19:33:10.358091] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-17T19:33:10.712621] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T19:33:11.158016] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-17T19:33:11.273519] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-17T19:33:11.958086] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-17T19:33:12.171484] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:33:12.758033] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-17T19:33:13.558002] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-17T19:33:13.675598] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:33:13.891415] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T19:33:14.027569] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:33:14.358027] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-17T19:33:15.158015] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-17T19:33:15.229107] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T19:33:15.958006] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-17T19:33:16.084900] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:33:16.758000] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-17T19:33:16.928180] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:33:17.558022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-17T19:33:18.358073] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-17T19:33:18.462752] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:33:18.685590] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:33:19.158036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-17T19:33:19.433014] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T19:33:19.435993] [INFO ] [REMOTE ] IFN: Full fetch complete (28436 records). [2025-10-17T19:33:19.436073] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-17T19:33:19.805822] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-17T19:33:19.805919] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-17T19:33:19.806566] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-17T19:33:19.806635] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-17T19:33:19.807390] [DEBUG] [LOCAL ] IFN: Trimmed 28436 records to 18730 (keeping 200 days of data) [2025-10-17T19:33:19.922748] [DEBUG] [LOCAL ] IFN: Primary data saved (18730 records). [2025-10-17T19:33:19.922890] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-17T19:33:19.922972] [INFO ] [MAIN ] Update Progress: 1091/2368 symbols completed. IFN took 32.0s. Estimated remaining: 2h 59m 24s. Rate: 7.1 symbols/min [2025-10-17T19:33:19.965771] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-17T19:33:20.098012] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:20.116315] [DEBUG] [LOCAL ] IGD: Loaded 19512 existing records from primary storage. [2025-10-17T19:33:20.116547] [INFO ] [MAIN ] IGD: Loaded 19512 existing records. [2025-10-17T19:33:20.291969] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:20.292176] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-17T19:33:20.292241] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-17T19:33:20.292696] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-17T19:33:20.292754] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-17T19:33:20.687370] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:20.757983] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-17T19:33:20.808463] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T19:33:21.008036] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T19:33:21.558034] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-17T19:33:21.721121] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T19:33:22.124487] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T19:33:22.358033] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-17T19:33:23.158018] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-17T19:33:23.444588] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T19:33:23.958046] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-17T19:33:24.752375] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:33:24.762910] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-17T19:33:24.764495] [INFO ] [REMOTE ] IFF: Full fetch complete (73651 records). [2025-10-17T19:33:24.764637] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-17T19:33:25.161218] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-17T19:33:25.161366] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-17T19:33:25.168114] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-17T19:33:25.177349] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-17T19:33:25.179154] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:33:25.186243] [DEBUG] [LOCAL ] IFF: Trimmed 73651 records to 51919 (keeping 200 days of data) [2025-10-17T19:33:25.507767] [DEBUG] [LOCAL ] IFF: Primary data saved (51919 records). [2025-10-17T19:33:25.507907] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-17T19:33:25.507987] [INFO ] [MAIN ] Update Progress: 1092/2368 symbols completed. IFF took 43.6s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-17T19:33:25.570783] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-17T19:33:25.684690] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:25.690579] [DEBUG] [LOCAL ] IGI: Loaded 4035 existing records from primary storage. [2025-10-17T19:33:25.690851] [INFO ] [MAIN ] IGI: Loaded 4035 existing records. [2025-10-17T19:33:25.871335] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:25.871619] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-17T19:33:25.871702] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-17T19:33:25.871965] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-17T19:33:25.872026] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-17T19:33:26.252022] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:26.253665] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T19:33:26.277178] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T19:33:26.358012] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-17T19:33:27.158055] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-17T19:33:27.785406] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:33:27.921181] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T19:33:27.958056] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-17T19:33:28.758063] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-17T19:33:28.976600] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T19:33:29.351010] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T19:33:29.353259] [INFO ] [REMOTE ] IGA: Full fetch complete (14266 records). [2025-10-17T19:33:29.353330] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-17T19:33:29.564556] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-17T19:33:29.716304] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-17T19:33:29.716386] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-17T19:33:29.716867] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-17T19:33:29.716928] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-17T19:33:29.717669] [DEBUG] [LOCAL ] IGA: Trimmed 14266 records to 10395 (keeping 200 days of data) [2025-10-17T19:33:29.782465] [DEBUG] [LOCAL ] IGA: Primary data saved (10395 records). [2025-10-17T19:33:29.782615] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-17T19:33:29.782734] [INFO ] [MAIN ] Update Progress: 1093/2368 symbols completed. IGA took 24.2s. Estimated remaining: 2h 58m 59s. Rate: 7.1 symbols/min [2025-10-17T19:33:29.948576] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:29.979364] [DEBUG] [LOCAL ] IGR: Loaded 30626 existing records from primary storage. [2025-10-17T19:33:29.979619] [INFO ] [MAIN ] IGR: Loaded 30626 existing records. [2025-10-17T19:33:30.153724] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:30.153940] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-17T19:33:30.154928] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-17T19:33:30.155122] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-17T19:33:30.155162] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-17T19:33:30.363111] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-17T19:33:30.525125] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:30.593871] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T19:33:31.158009] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-17T19:33:31.196749] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T19:33:31.876761] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T19:33:31.958032] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-17T19:33:32.758009] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-17T19:33:33.132987] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:33:33.558022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-17T19:33:33.816068] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T19:33:34.358594] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-17T19:33:34.359705] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T19:33:34.363899] [INFO ] [REMOTE ] IFS: Full fetch complete (32111 records). [2025-10-17T19:33:34.364046] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-17T19:33:34.761918] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-17T19:33:34.762000] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-17T19:33:34.762680] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-17T19:33:34.762741] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-17T19:33:34.763447] [DEBUG] [LOCAL ] IFS: Trimmed 32111 records to 22863 (keeping 200 days of data) [2025-10-17T19:33:34.896032] [DEBUG] [LOCAL ] IFS: Primary data saved (22863 records). [2025-10-17T19:33:34.896157] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-17T19:33:34.896237] [INFO ] [MAIN ] Update Progress: 1094/2368 symbols completed. IFS took 30.7s. Estimated remaining: 2h 58m 46s. Rate: 7.1 symbols/min [2025-10-17T19:33:35.069281] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:35.074311] [DEBUG] [LOCAL ] IH: Loaded 2814 existing records from primary storage. [2025-10-17T19:33:35.074464] [INFO ] [MAIN ] IH: Loaded 2814 existing records. [2025-10-17T19:33:35.164917] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-17T19:33:35.259493] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:35.259758] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-17T19:33:35.259810] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-17T19:33:35.259967] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-17T19:33:35.260026] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-17T19:33:35.624269] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:35.933152] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:33:35.958027] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-17T19:33:36.341218] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:33:36.396175] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T19:33:36.758033] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-17T19:33:37.201505] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-17T19:33:37.558012] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-17T19:33:38.068416] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T19:33:38.358046] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-17T19:33:38.459409] [DEBUG] [REMOTE ] IH: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-17T19:33:38.459704] [WARN ] [REMOTE ] IH: No data returned for month 2025-02 [2025-10-17T19:33:38.459792] [FATAL] [REMOTE ] IH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:33:38.459895] [FATAL] [MAIN ] IH: Failed to fetch primary data. [2025-10-17T19:33:38.459963] [WARN ] [MAIN ] IH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:33:38.460032] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-17T19:33:38.460095] [DEBUG] [LOCAL ] IH: No primary data file found to delete. [2025-10-17T19:33:38.460133] [INFO ] [LOCAL ] IH: Starting deletion of derivative data. [2025-10-17T19:33:38.460288] [DEBUG] [LOCAL ] IH: Deleted derivative data file. [2025-10-17T19:33:38.460371] [INFO ] [MAIN ] Update Progress: 1095/2368 symbols completed. IH took 3.6s. Estimated remaining: 2h 58m 32s. Rate: 7.1 symbols/min [2025-10-17T19:33:38.675485] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:38.684820] [DEBUG] [LOCAL ] IHD: Loaded 7367 existing records from primary storage. [2025-10-17T19:33:38.685016] [INFO ] [MAIN ] IHD: Loaded 7367 existing records. [2025-10-17T19:33:38.863259] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:38.863488] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-17T19:33:38.863537] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-17T19:33:38.863763] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-17T19:33:38.863822] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-17T19:33:39.163166] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-17T19:33:39.222250] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:39.641506] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:33:39.958036] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-17T19:33:40.758090] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-17T19:33:40.962055] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T19:33:41.523054] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T19:33:41.557984] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-17T19:33:42.311659] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T19:33:42.358010] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-17T19:33:43.089483] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T19:33:43.158037] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-17T19:33:43.958014] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-17T19:33:44.193483] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T19:33:44.528751] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T19:33:44.758020] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-17T19:33:45.428051] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T19:33:45.557996] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-17T19:33:46.358061] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-17T19:33:46.548080] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:33:47.158072] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-17T19:33:47.846894] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T19:33:47.958030] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-17T19:33:47.993982] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:33:48.758110] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-17T19:33:49.343945] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:33:49.558038] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-17T19:33:49.736463] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T19:33:50.358051] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-17T19:33:50.509855] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:33:50.800755] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T19:33:51.158040] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-17T19:33:51.958074] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-17T19:33:52.135398] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T19:33:52.698437] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T19:33:52.758028] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-17T19:33:53.414881] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T19:33:53.558010] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-17T19:33:54.358038] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-17T19:33:54.712898] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:33:54.716914] [INFO ] [REMOTE ] IGD: Full fetch complete (30126 records). [2025-10-17T19:33:54.716997] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-17T19:33:55.011460] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T19:33:55.095051] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-17T19:33:55.095123] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-17T19:33:55.095727] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-17T19:33:55.095789] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-17T19:33:55.096450] [DEBUG] [LOCAL ] IGD: Trimmed 30126 records to 19676 (keeping 200 days of data) [2025-10-17T19:33:55.175521] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-17T19:33:55.213589] [DEBUG] [LOCAL ] IGD: Primary data saved (19676 records). [2025-10-17T19:33:55.213754] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-17T19:33:55.213841] [INFO ] [MAIN ] Update Progress: 1096/2368 symbols completed. IGD took 35.3s. Estimated remaining: 2h 58m 34s. Rate: 7.1 symbols/min [2025-10-17T19:33:55.386404] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:55.411414] [DEBUG] [LOCAL ] IHG: Loaded 24519 existing records from primary storage. [2025-10-17T19:33:55.411717] [INFO ] [MAIN ] IHG: Loaded 24519 existing records. [2025-10-17T19:33:55.591036] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:55.591254] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-17T19:33:55.591301] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-17T19:33:55.591864] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-17T19:33:55.591922] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-17T19:33:55.941776] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:55.957977] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-17T19:33:56.491049] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T19:33:56.758022] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-17T19:33:57.198617] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T19:33:57.558022] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-17T19:33:57.759088] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:33:58.358034] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-17T19:33:58.571087] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:33:58.936405] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:33:59.158027] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-17T19:33:59.643765] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T19:33:59.958037] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-17T19:34:00.758047] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-17T19:34:01.055848] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:34:01.057736] [INFO ] [REMOTE ] IHD: Full fetch complete (11848 records). [2025-10-17T19:34:01.057811] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-17T19:34:01.412940] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-17T19:34:01.413024] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-17T19:34:01.413440] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-17T19:34:01.413482] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-17T19:34:01.413962] [DEBUG] [LOCAL ] IHD: Trimmed 11848 records to 7396 (keeping 200 days of data) [2025-10-17T19:34:01.458552] [DEBUG] [LOCAL ] IHD: Primary data saved (7396 records). [2025-10-17T19:34:01.458736] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-17T19:34:01.458836] [INFO ] [MAIN ] Update Progress: 1097/2368 symbols completed. IHD took 23.0s. Estimated remaining: 2h 58m 23s. Rate: 7.1 symbols/min [2025-10-17T19:34:01.563249] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-17T19:34:01.638572] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:01.674826] [DEBUG] [LOCAL ] IHS: Loaded 37894 existing records from primary storage. [2025-10-17T19:34:01.675164] [INFO ] [MAIN ] IHS: Loaded 37894 existing records. [2025-10-17T19:34:01.854910] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:01.855140] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-17T19:34:01.855188] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-17T19:34:01.855804] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-17T19:34:01.855863] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-17T19:34:02.210040] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:02.318614] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:34:02.358046] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-17T19:34:03.157998] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-17T19:34:03.527615] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T19:34:03.728230] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:34:03.752608] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T19:34:03.958067] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-17T19:34:04.620391] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T19:34:04.758167] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-17T19:34:05.558065] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-17T19:34:05.775696] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T19:34:06.358043] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-17T19:34:06.650466] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:34:06.944330] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:34:07.158041] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-17T19:34:07.957995] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-17T19:34:08.092020] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T19:34:08.093487] [INFO ] [REMOTE ] IGI: Full fetch complete (5518 records). [2025-10-17T19:34:08.093574] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-17T19:34:08.442231] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-17T19:34:08.442303] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-17T19:34:08.442436] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-17T19:34:08.442475] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-17T19:34:08.442860] [DEBUG] [LOCAL ] IGI: Trimmed 5518 records to 4092 (keeping 200 days of data) [2025-10-17T19:34:08.466754] [DEBUG] [LOCAL ] IGI: Primary data saved (4092 records). [2025-10-17T19:34:08.466823] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-17T19:34:08.466904] [INFO ] [MAIN ] Update Progress: 1098/2368 symbols completed. IGI took 43.0s. Estimated remaining: 2h 58m 13s. Rate: 7.1 symbols/min [2025-10-17T19:34:08.631728] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:08.638232] [DEBUG] [LOCAL ] IIF: Loaded 5612 existing records from primary storage. [2025-10-17T19:34:08.638386] [INFO ] [MAIN ] IIF: Loaded 5612 existing records. [2025-10-17T19:34:08.763145] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-17T19:34:08.817075] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:08.817775] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-17T19:34:08.817955] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-17T19:34:08.818336] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-17T19:34:08.818397] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-17T19:34:09.174753] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:09.189031] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T19:34:09.557985] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-17T19:34:09.953253] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T19:34:10.358085] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-17T19:34:10.972351] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:34:11.104180] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T19:34:11.158028] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-17T19:34:11.929116] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:34:11.957999] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-17T19:34:12.744888] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T19:34:12.757997] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-17T19:34:13.355003] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:34:13.557988] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-17T19:34:14.357999] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-17T19:34:14.607366] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T19:34:15.158017] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-17T19:34:15.694198] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T19:34:15.958047] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-17T19:34:16.000691] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T19:34:16.758007] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-17T19:34:16.990541] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:34:17.558037] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-17T19:34:18.219444] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:34:18.358074] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-17T19:34:18.978508] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:34:19.158001] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-17T19:34:19.180568] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T19:34:19.958108] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-17T19:34:20.266165] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T19:34:20.758038] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-17T19:34:21.326638] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:34:21.362360] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T19:34:21.558038] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-17T19:34:22.147551] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T19:34:22.358093] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-17T19:34:23.158124] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-17T19:34:23.667419] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T19:34:23.932907] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T19:34:23.958022] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-17T19:34:24.565671] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T19:34:24.758080] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-17T19:34:25.558111] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-17T19:34:26.094090] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T19:34:26.100059] [INFO ] [REMOTE ] IGR: Full fetch complete (44801 records). [2025-10-17T19:34:26.100208] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-17T19:34:26.363323] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-17T19:34:26.500955] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-17T19:34:26.501122] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-17T19:34:26.501949] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-17T19:34:26.502013] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-17T19:34:26.503084] [DEBUG] [LOCAL ] IGR: Trimmed 44801 records to 30813 (keeping 200 days of data) [2025-10-17T19:34:26.686955] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T19:34:26.705929] [DEBUG] [LOCAL ] IGR: Primary data saved (30813 records). [2025-10-17T19:34:26.706080] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-17T19:34:26.706163] [INFO ] [MAIN ] Update Progress: 1099/2368 symbols completed. IGR took 56.9s. Estimated remaining: 2h 58m 16s. Rate: 7.1 symbols/min [2025-10-17T19:34:26.902674] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:26.918810] [DEBUG] [LOCAL ] IIIN: Loaded 16246 existing records from primary storage. [2025-10-17T19:34:26.919071] [INFO ] [MAIN ] IIIN: Loaded 16246 existing records. [2025-10-17T19:34:27.049731] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-17T19:34:27.102617] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:27.102814] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-17T19:34:27.102880] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-17T19:34:27.103418] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-17T19:34:27.103477] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-17T19:34:27.164479] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-17T19:34:27.460899] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:27.794705] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-17T19:34:27.795684] [INFO ] [REMOTE ] IIF: Full fetch complete (8973 records). [2025-10-17T19:34:27.795755] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-17T19:34:27.967715] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-17T19:34:28.186728] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-17T19:34:28.186819] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-17T19:34:28.187070] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-17T19:34:28.187113] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-17T19:34:28.187572] [DEBUG] [LOCAL ] IIF: Trimmed 8973 records to 5622 (keeping 200 days of data) [2025-10-17T19:34:28.221758] [DEBUG] [LOCAL ] IIF: Primary data saved (5622 records). [2025-10-17T19:34:28.221908] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-17T19:34:28.221990] [INFO ] [MAIN ] Update Progress: 1100/2368 symbols completed. IIF took 19.8s. Estimated remaining: 2h 57m 59s. Rate: 7.1 symbols/min [2025-10-17T19:34:28.388401] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:28.404662] [DEBUG] [LOCAL ] IIM: Loaded 15782 existing records from primary storage. [2025-10-17T19:34:28.404945] [INFO ] [MAIN ] IIM: Loaded 15782 existing records. [2025-10-17T19:34:28.581746] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:28.581995] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-17T19:34:28.582055] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-17T19:34:28.582589] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-17T19:34:28.582683] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-17T19:34:28.763301] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-17T19:34:28.947960] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:29.275859] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:34:29.558000] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-17T19:34:29.939732] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T19:34:30.358017] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-17T19:34:30.693003] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:34:31.158062] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-17T19:34:31.687135] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:34:31.691111] [INFO ] [REMOTE ] IHG: Full fetch complete (34181 records). [2025-10-17T19:34:31.691197] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-17T19:34:31.966283] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-17T19:34:32.072852] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-17T19:34:32.072934] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-17T19:34:32.073708] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-17T19:34:32.073773] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-17T19:34:32.074588] [DEBUG] [LOCAL ] IHG: Trimmed 34181 records to 24671 (keeping 200 days of data) [2025-10-17T19:34:32.178788] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:34:32.242607] [DEBUG] [LOCAL ] IHG: Primary data saved (24671 records). [2025-10-17T19:34:32.242761] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-17T19:34:32.242848] [INFO ] [MAIN ] Update Progress: 1101/2368 symbols completed. IHG took 37.0s. Estimated remaining: 2h 57m 46s. Rate: 7.1 symbols/min [2025-10-17T19:34:32.423797] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:32.453186] [DEBUG] [LOCAL ] IIPR: Loaded 29694 existing records from primary storage. [2025-10-17T19:34:32.453458] [INFO ] [MAIN ] IIPR: Loaded 29694 existing records. [2025-10-17T19:34:32.636554] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:32.636809] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-17T19:34:32.636859] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-17T19:34:32.637505] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-17T19:34:32.637565] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-17T19:34:32.763195] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-17T19:34:33.008096] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:33.558008] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-17T19:34:33.614662] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T19:34:34.113980] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T19:34:34.358041] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-17T19:34:34.987247] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:34:35.158058] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-17T19:34:35.830774] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:34:35.958012] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-17T19:34:36.264216] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T19:34:36.758027] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-17T19:34:37.465230] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T19:34:37.558001] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-17T19:34:37.673844] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T19:34:38.358006] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-17T19:34:38.605938] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:34:39.158031] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-17T19:34:39.779451] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:34:39.958047] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-17T19:34:40.327215] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T19:34:40.758053] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-17T19:34:40.951422] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T19:34:41.558068] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-17T19:34:42.136370] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:34:42.358008] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-17T19:34:42.625338] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T19:34:43.158058] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-17T19:34:43.743777] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T19:34:43.958043] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-17T19:34:44.248169] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:34:44.758039] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-17T19:34:45.200181] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:34:45.204845] [INFO ] [REMOTE ] IHS: Full fetch complete (51661 records). [2025-10-17T19:34:45.205063] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-17T19:34:45.565467] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-17T19:34:45.610926] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-17T19:34:45.611010] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-17T19:34:45.611847] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-17T19:34:45.611909] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-17T19:34:45.613036] [DEBUG] [LOCAL ] IHS: Trimmed 51661 records to 38062 (keeping 200 days of data) [2025-10-17T19:34:45.826594] [DEBUG] [LOCAL ] IHS: Primary data saved (38062 records). [2025-10-17T19:34:45.826781] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-17T19:34:45.826934] [INFO ] [MAIN ] Update Progress: 1102/2368 symbols completed. IHS took 44.4s. Estimated remaining: 2h 57m 43s. Rate: 7.1 symbols/min [2025-10-17T19:34:45.936087] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T19:34:46.007412] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:46.049021] [DEBUG] [LOCAL ] IMAX: Loaded 43543 existing records from primary storage. [2025-10-17T19:34:46.049303] [INFO ] [MAIN ] IMAX: Loaded 43543 existing records. [2025-10-17T19:34:46.220666] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:46.220868] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-17T19:34:46.220915] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-17T19:34:46.221225] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-17T19:34:46.221278] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-17T19:34:46.366357] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-17T19:34:46.590260] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:47.134613] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:34:47.157995] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-17T19:34:47.452817] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T19:34:47.958027] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-17T19:34:48.465171] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:34:48.758005] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-17T19:34:48.888815] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T19:34:49.558029] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-17T19:34:49.785527] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:34:50.269698] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-17T19:34:50.358000] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-17T19:34:51.158015] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-17T19:34:51.701975] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:34:51.958019] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-17T19:34:52.104328] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:34:52.758038] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-17T19:34:53.410921] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:34:53.558031] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-17T19:34:54.365266] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-17T19:34:54.371274] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:34:54.387293] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T19:34:55.157995] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-17T19:34:55.279674] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T19:34:55.958019] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-17T19:34:56.107037] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:34:56.109595] [INFO ] [REMOTE ] IIIN: Full fetch complete (24807 records). [2025-10-17T19:34:56.109691] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-17T19:34:56.465409] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-17T19:34:56.465483] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-17T19:34:56.465949] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-17T19:34:56.466010] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-17T19:34:56.466591] [DEBUG] [LOCAL ] IIIN: Trimmed 24807 records to 16427 (keeping 200 days of data) [2025-10-17T19:34:56.567114] [DEBUG] [LOCAL ] IIIN: Primary data saved (16427 records). [2025-10-17T19:34:56.567244] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-17T19:34:56.567341] [INFO ] [MAIN ] Update Progress: 1103/2368 symbols completed. IIIN took 29.9s. Estimated remaining: 2h 57m 37s. Rate: 7.1 symbols/min [2025-10-17T19:34:56.736331] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:56.761258] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-17T19:34:56.783455] [DEBUG] [LOCAL ] INFA: Loaded 49327 existing records from primary storage. [2025-10-17T19:34:56.783831] [INFO ] [MAIN ] INFA: Loaded 49327 existing records. [2025-10-17T19:34:56.967692] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:56.967887] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-17T19:34:56.967957] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-17T19:34:56.968802] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-17T19:34:56.968869] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-17T19:34:57.326819] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:57.346872] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T19:34:57.558000] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-17T19:34:58.054172] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:34:58.358038] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-17T19:34:58.622540] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:34:59.158021] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-17T19:34:59.958019] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-17T19:35:00.073482] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T19:35:00.572199] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T19:35:00.577070] [INFO ] [REMOTE ] IIPR: Full fetch complete (44034 records). [2025-10-17T19:35:00.577159] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-17T19:35:00.764565] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-17T19:35:00.954564] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-17T19:35:00.954657] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-17T19:35:00.955424] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-17T19:35:00.955468] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-17T19:35:00.957263] [DEBUG] [LOCAL ] IIPR: Trimmed 44034 records to 29862 (keeping 200 days of data) [2025-10-17T19:35:01.155355] [DEBUG] [LOCAL ] IIPR: Primary data saved (29862 records). [2025-10-17T19:35:01.155522] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-17T19:35:01.155614] [INFO ] [MAIN ] Update Progress: 1104/2368 symbols completed. IIPR took 28.9s. Estimated remaining: 2h 57m 25s. Rate: 7.1 symbols/min [2025-10-17T19:35:01.333969] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:01.394958] [DEBUG] [LOCAL ] INFY: Loaded 53987 existing records from primary storage. [2025-10-17T19:35:01.395296] [INFO ] [MAIN ] INFY: Loaded 53987 existing records. [2025-10-17T19:35:01.572394] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:35:01.577858] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-17T19:35:01.614153] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:01.614787] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-17T19:35:01.614845] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-17T19:35:01.615192] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-17T19:35:01.615250] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-17T19:35:01.983500] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:02.358038] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-17T19:35:03.158041] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-17T19:35:03.237504] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T19:35:03.560502] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T19:35:03.927846] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-17T19:35:03.957988] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-17T19:35:04.758029] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-17T19:35:05.259984] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T19:35:05.558021] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-17T19:35:05.994695] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T19:35:06.301158] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T19:35:06.358092] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-17T19:35:07.158053] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-17T19:35:07.433759] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T19:35:07.436607] [INFO ] [REMOTE ] IIM: Full fetch complete (25064 records). [2025-10-17T19:35:07.436727] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-17T19:35:07.829767] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-17T19:35:07.829913] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-17T19:35:07.830478] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-17T19:35:07.830553] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-17T19:35:07.841528] [DEBUG] [LOCAL ] IIM: Trimmed 25064 records to 15903 (keeping 200 days of data) [2025-10-17T19:35:07.860324] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T19:35:07.960684] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-17T19:35:07.965220] [DEBUG] [LOCAL ] IIM: Primary data saved (15903 records). [2025-10-17T19:35:07.965322] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-17T19:35:07.965455] [INFO ] [MAIN ] Update Progress: 1105/2368 symbols completed. IIM took 39.7s. Estimated remaining: 2h 57m 14s. Rate: 7.1 symbols/min [2025-10-17T19:35:08.139854] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:08.190742] [DEBUG] [LOCAL ] ING: Loaded 51112 existing records from primary storage. [2025-10-17T19:35:08.191054] [INFO ] [MAIN ] ING: Loaded 51112 existing records. [2025-10-17T19:35:08.370148] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:08.370466] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-17T19:35:08.370555] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-17T19:35:08.371161] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-17T19:35:08.371272] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-17T19:35:08.623029] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:35:08.764097] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-17T19:35:08.770149] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:09.563156] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-17T19:35:09.577675] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:35:10.036375] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:35:10.358072] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-17T19:35:11.158086] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-17T19:35:11.625042] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T19:35:11.678358] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T19:35:11.958152] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-17T19:35:12.758080] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-17T19:35:12.995962] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T19:35:13.558035] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-17T19:35:13.666808] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T19:35:14.218564] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T19:35:14.358035] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-17T19:35:15.158032] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-17T19:35:15.455834] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T19:35:15.595862] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T19:35:15.958083] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-17T19:35:16.758089] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-17T19:35:16.792137] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:35:17.558003] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-17T19:35:17.790066] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:35:18.358011] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-17T19:35:18.549600] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:35:19.087236] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:35:19.157997] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-17T19:35:19.958018] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-17T19:35:20.159273] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:35:20.675108] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T19:35:20.758024] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-17T19:35:21.293068] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T19:35:21.558025] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-17T19:35:22.358019] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-17T19:35:22.440676] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T19:35:23.158010] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-17T19:35:23.218930] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:35:23.958101] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-17T19:35:24.045126] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:35:24.490141] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:35:24.758092] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-17T19:35:25.558060] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-17T19:35:25.723631] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T19:35:26.224708] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T19:35:26.358040] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-17T19:35:27.158077] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-17T19:35:27.224189] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:35:27.230796] [INFO ] [REMOTE ] IMAX: Full fetch complete (60843 records). [2025-10-17T19:35:27.230962] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-17T19:35:27.622357] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-17T19:35:27.622438] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-17T19:35:27.623326] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-17T19:35:27.623390] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-17T19:35:27.624831] [DEBUG] [LOCAL ] IMAX: Trimmed 60843 records to 43881 (keeping 200 days of data) [2025-10-17T19:35:27.874948] [DEBUG] [LOCAL ] IMAX: Primary data saved (43881 records). [2025-10-17T19:35:27.875084] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-17T19:35:27.875163] [INFO ] [MAIN ] Update Progress: 1106/2368 symbols completed. IMAX took 42.0s. Estimated remaining: 2h 57m 19s. Rate: 7.1 symbols/min [2025-10-17T19:35:27.965816] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-17T19:35:28.079867] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:28.111200] [DEBUG] [LOCAL ] INGM: Loaded 28536 existing records from primary storage. [2025-10-17T19:35:28.111495] [INFO ] [MAIN ] INGM: Loaded 28536 existing records. [2025-10-17T19:35:28.297214] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:28.297589] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-17T19:35:28.297713] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-17T19:35:28.298038] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-17T19:35:28.298113] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-17T19:35:28.519504] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T19:35:28.703346] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:28.757994] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-17T19:35:28.827950] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:35:29.450030] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:35:29.558031] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-17T19:35:30.158226] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:35:30.358053] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-17T19:35:31.158005] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-17T19:35:31.365829] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:35:31.958074] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-17T19:35:32.182464] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:35:32.584951] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:35:32.591003] [INFO ] [REMOTE ] INFA: Full fetch complete (70935 records). [2025-10-17T19:35:32.591142] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-17T19:35:32.765494] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-17T19:35:32.984342] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-17T19:35:32.984470] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-17T19:35:32.985496] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-17T19:35:32.985582] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-17T19:35:32.986954] [DEBUG] [LOCAL ] INFA: Trimmed 70935 records to 49646 (keeping 200 days of data) [2025-10-17T19:35:33.269773] [DEBUG] [LOCAL ] INFA: Primary data saved (49646 records). [2025-10-17T19:35:33.269919] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-17T19:35:33.270777] [INFO ] [MAIN ] Update Progress: 1107/2368 symbols completed. INFA took 36.7s. Estimated remaining: 2h 57m 7s. Rate: 7.1 symbols/min [2025-10-17T19:35:33.445155] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:33.480434] [DEBUG] [LOCAL ] INGR: Loaded 34043 existing records from primary storage. [2025-10-17T19:35:33.480868] [INFO ] [MAIN ] INGR: Loaded 34043 existing records. [2025-10-17T19:35:33.559412] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-17T19:35:33.660549] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:33.660862] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-17T19:35:33.660932] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-17T19:35:33.671265] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-17T19:35:33.685326] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-17T19:35:33.756237] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:35:34.064028] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T19:35:34.171018] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:34.358107] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-17T19:35:35.158055] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-17T19:35:35.501102] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T19:35:35.508370] [INFO ] [REMOTE ] INFY: Full fetch complete (77737 records). [2025-10-17T19:35:35.508495] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-17T19:35:35.896896] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-17T19:35:35.916286] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-17T19:35:35.917439] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-17T19:35:35.917524] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-17T19:35:35.919844] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:35:35.928533] [DEBUG] [LOCAL ] INFY: Trimmed 77737 records to 54376 (keeping 200 days of data) [2025-10-17T19:35:35.983056] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-17T19:35:36.260969] [DEBUG] [LOCAL ] INFY: Primary data saved (54376 records). [2025-10-17T19:35:36.261134] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-17T19:35:36.261219] [INFO ] [MAIN ] Update Progress: 1108/2368 symbols completed. INFY took 35.1s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-17T19:35:36.439982] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:36.477535] [DEBUG] [LOCAL ] INN: Loaded 42104 existing records from primary storage. [2025-10-17T19:35:36.477918] [INFO ] [MAIN ] INN: Loaded 42104 existing records. [2025-10-17T19:35:36.659753] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:36.660055] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-17T19:35:36.660128] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-17T19:35:36.660971] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-17T19:35:36.661033] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-17T19:35:36.763684] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-17T19:35:37.064164] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:37.066864] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:35:37.545735] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:35:37.557988] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-17T19:35:38.023222] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T19:35:38.358048] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-17T19:35:39.038776] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:35:39.158040] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-17T19:35:39.797084] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T19:35:39.958054] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-17T19:35:40.659320] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:35:40.757995] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-17T19:35:41.557993] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-17T19:35:41.622330] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:35:42.020729] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:35:42.358016] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-17T19:35:43.158077] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-17T19:35:43.191109] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:35:43.770593] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:35:43.958086] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-17T19:35:44.614040] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:35:44.758033] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-17T19:35:45.318797] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:35:45.558097] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-17T19:35:46.357994] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-17T19:35:46.659772] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T19:35:46.666983] [INFO ] [REMOTE ] ING: Full fetch complete (73828 records). [2025-10-17T19:35:46.667192] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-17T19:35:46.982346] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:35:47.081220] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-17T19:35:47.081294] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-17T19:35:47.082286] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-17T19:35:47.082350] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-17T19:35:47.083699] [DEBUG] [LOCAL ] ING: Trimmed 73828 records to 51494 (keeping 200 days of data) [2025-10-17T19:35:47.172274] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-17T19:35:47.394248] [DEBUG] [LOCAL ] ING: Primary data saved (51494 records). [2025-10-17T19:35:47.394375] [INFO ] [MAIN ] ING: Full history saved. [2025-10-17T19:35:47.394451] [INFO ] [MAIN ] Update Progress: 1109/2368 symbols completed. ING took 39.4s. Estimated remaining: 2h 56m 47s. Rate: 7.1 symbols/min [2025-10-17T19:35:47.570795] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:47.571041] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-17T19:35:47.571097] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-17T19:35:47.571208] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-17T19:35:47.571252] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-17T19:35:47.571328] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-17T19:35:47.571387] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-17T19:35:47.871548] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T19:35:47.957107] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:47.957984] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-17T19:35:48.162421] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:35:48.162750] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-17T19:35:48.162841] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:35:48.162940] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-17T19:35:48.163019] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:35:48.163081] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-17T19:35:48.163158] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-17T19:35:48.163212] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-17T19:35:48.163267] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-17T19:35:48.163329] [INFO ] [MAIN ] Update Progress: 1110/2368 symbols completed. INR took 0.8s. Estimated remaining: 2h 56m 30s. Rate: 7.1 symbols/min [2025-10-17T19:35:48.337514] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:48.373749] [DEBUG] [LOCAL ] INSP: Loaded 38596 existing records from primary storage. [2025-10-17T19:35:48.374054] [INFO ] [MAIN ] INSP: Loaded 38596 existing records. [2025-10-17T19:35:48.564266] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:48.564561] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-17T19:35:48.581858] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-17T19:35:48.583670] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:35:48.583724] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-17T19:35:48.590474] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-17T19:35:48.763245] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-17T19:35:48.958125] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:49.558032] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-17T19:35:50.303296] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:35:50.357996] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-17T19:35:50.907461] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:35:51.158045] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-17T19:35:51.889490] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T19:35:51.958015] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-17T19:35:52.624519] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:35:52.758066] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-17T19:35:53.311021] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:35:53.558080] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-17T19:35:53.894452] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:35:54.358129] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-17T19:35:54.938664] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:35:55.158049] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-17T19:35:55.178909] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T19:35:55.958021] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-17T19:35:56.758102] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-17T19:35:56.886339] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T19:35:57.558413] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-17T19:35:57.558274] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T19:35:58.001059] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T19:35:58.358077] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-17T19:35:59.080041] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:35:59.157980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-17T19:35:59.713312] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:35:59.719080] [INFO ] [REMOTE ] INGR: Full fetch complete (50746 records). [2025-10-17T19:35:59.719212] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-17T19:35:59.963911] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-17T19:36:00.102719] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-17T19:36:00.102814] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-17T19:36:00.103629] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-17T19:36:00.103710] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-17T19:36:00.104879] [DEBUG] [LOCAL ] INGR: Trimmed 50746 records to 34266 (keeping 200 days of data) [2025-10-17T19:36:00.318676] [DEBUG] [LOCAL ] INGR: Primary data saved (34266 records). [2025-10-17T19:36:00.318837] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-17T19:36:00.319339] [INFO ] [MAIN ] Update Progress: 1111/2368 symbols completed. INGR took 27.0s. Estimated remaining: 2h 56m 26s. Rate: 7.1 symbols/min [2025-10-17T19:36:00.492484] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:00.531504] [DEBUG] [LOCAL ] INSW: Loaded 39916 existing records from primary storage. [2025-10-17T19:36:00.531859] [INFO ] [MAIN ] INSW: Loaded 39916 existing records. [2025-10-17T19:36:00.680171] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:36:00.739823] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:00.740048] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-17T19:36:00.740095] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-17T19:36:00.740789] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-17T19:36:00.740847] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-17T19:36:00.763151] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-17T19:36:01.094306] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:01.523897] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T19:36:01.558029] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-17T19:36:02.358053] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-17T19:36:02.594084] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T19:36:03.158047] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-17T19:36:03.619750] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T19:36:03.623898] [INFO ] [REMOTE ] INGM: Full fetch complete (41842 records). [2025-10-17T19:36:03.623977] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-17T19:36:03.973479] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-17T19:36:04.034259] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-17T19:36:04.034363] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-17T19:36:04.035142] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-17T19:36:04.035223] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-17T19:36:04.037979] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-17T19:36:04.048068] [DEBUG] [LOCAL ] INGM: Trimmed 41842 records to 28706 (keeping 200 days of data) [2025-10-17T19:36:04.215394] [DEBUG] [LOCAL ] INGM: Primary data saved (28706 records). [2025-10-17T19:36:04.215523] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-17T19:36:04.215603] [INFO ] [MAIN ] Update Progress: 1112/2368 symbols completed. INGM took 36.3s. Estimated remaining: 2h 56m 12s. Rate: 7.1 symbols/min [2025-10-17T19:36:04.387684] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:04.436001] [DEBUG] [LOCAL ] INVH: Loaded 53585 existing records from primary storage. [2025-10-17T19:36:04.436300] [INFO ] [MAIN ] INVH: Loaded 53585 existing records. [2025-10-17T19:36:04.613275] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:04.613506] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-17T19:36:04.613563] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-17T19:36:04.614405] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-17T19:36:04.614462] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-17T19:36:04.759935] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-17T19:36:04.984974] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:05.009096] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T19:36:05.531525] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:36:05.558000] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-17T19:36:06.027853] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T19:36:06.358035] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-17T19:36:06.970244] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:36:07.158119] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-17T19:36:07.958109] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-17T19:36:08.046182] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T19:36:08.758073] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-17T19:36:08.799942] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:36:08.879053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T19:36:09.558030] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-17T19:36:10.117796] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:36:10.358134] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-17T19:36:11.158040] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-17T19:36:11.431224] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T19:36:11.683845] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T19:36:11.958061] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-17T19:36:12.602213] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T19:36:12.758041] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-17T19:36:13.411687] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:36:13.558036] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-17T19:36:14.358077] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-17T19:36:14.413389] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:36:15.158106] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-17T19:36:15.288085] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:36:15.958391] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:36:15.958566] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-17T19:36:16.519100] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T19:36:16.758272] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-17T19:36:17.558040] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-17T19:36:17.595044] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T19:36:18.358077] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-17T19:36:18.586118] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T19:36:19.060767] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T19:36:19.066340] [INFO ] [REMOTE ] INN: Full fetch complete (57800 records). [2025-10-17T19:36:19.066492] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-17T19:36:19.163123] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-17T19:36:19.455509] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-17T19:36:19.455592] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-17T19:36:19.456517] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-17T19:36:19.456580] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-17T19:36:19.457886] [DEBUG] [LOCAL ] INN: Trimmed 57800 records to 42375 (keeping 200 days of data) [2025-10-17T19:36:19.705552] [DEBUG] [LOCAL ] INN: Primary data saved (42375 records). [2025-10-17T19:36:19.705710] [INFO ] [MAIN ] INN: Full history saved. [2025-10-17T19:36:19.705808] [INFO ] [MAIN ] Update Progress: 1113/2368 symbols completed. INN took 43.4s. Estimated remaining: 2h 56m 12s. Rate: 7.1 symbols/min [2025-10-17T19:36:19.881964] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:19.909736] [DEBUG] [LOCAL ] INVX: Loaded 29473 existing records from primary storage. [2025-10-17T19:36:19.910011] [INFO ] [MAIN ] INVX: Loaded 29473 existing records. [2025-10-17T19:36:19.965685] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-17T19:36:20.122170] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:20.124300] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T19:36:20.122954] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-17T19:36:20.133018] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-17T19:36:20.133950] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-17T19:36:20.134015] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-17T19:36:20.495907] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:20.758077] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-17T19:36:20.882716] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:36:20.888960] [INFO ] [REMOTE ] INSP: Full fetch complete (53820 records). [2025-10-17T19:36:20.889107] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-17T19:36:21.279939] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-17T19:36:21.280014] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-17T19:36:21.280859] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-17T19:36:21.280922] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-17T19:36:21.281967] [DEBUG] [LOCAL ] INSP: Trimmed 53820 records to 38922 (keeping 200 days of data) [2025-10-17T19:36:21.508148] [DEBUG] [LOCAL ] INSP: Primary data saved (38922 records). [2025-10-17T19:36:21.508275] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-17T19:36:21.508352] [INFO ] [MAIN ] Update Progress: 1114/2368 symbols completed. INSP took 33.3s. Estimated remaining: 2h 55m 56s. Rate: 7.1 symbols/min [2025-10-17T19:36:21.570985] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-17T19:36:21.689661] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:21.739855] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-17T19:36:21.740151] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-10-17T19:36:21.909558] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:36:21.959899] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:21.960729] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-17T19:36:21.960818] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-17T19:36:21.961544] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-17T19:36:21.961603] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-17T19:36:22.227832] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:36:22.346039] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:22.357978] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-17T19:36:23.119331] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:36:23.158000] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-17T19:36:23.726774] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T19:36:23.958046] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-17T19:36:24.758032] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-17T19:36:24.918947] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T19:36:25.081852] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:36:25.558027] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-17T19:36:26.358086] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-17T19:36:26.814041] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T19:36:27.158023] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-17T19:36:27.424707] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-17T19:36:27.853336] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T19:36:27.958085] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-17T19:36:28.758020] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-17T19:36:28.936174] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:36:29.448565] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:36:29.558035] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-17T19:36:29.795991] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:36:30.358088] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-17T19:36:31.158069] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-17T19:36:31.812077] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:36:31.958026] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-17T19:36:32.083058] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-17T19:36:32.758058] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-17T19:36:32.983547] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T19:36:33.426224] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T19:36:33.431598] [INFO ] [REMOTE ] INSW: Full fetch complete (59863 records). [2025-10-17T19:36:33.431764] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-17T19:36:33.570597] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-17T19:36:33.820302] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-17T19:36:33.820380] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-17T19:36:33.821269] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-17T19:36:33.821369] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-17T19:36:33.822568] [DEBUG] [LOCAL ] INSW: Trimmed 59863 records to 40192 (keeping 200 days of data) [2025-10-17T19:36:34.066568] [DEBUG] [LOCAL ] INSW: Primary data saved (40192 records). [2025-10-17T19:36:34.066740] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-17T19:36:34.067676] [INFO ] [MAIN ] Update Progress: 1115/2368 symbols completed. INSW took 33.7s. Estimated remaining: 2h 55m 52s. Rate: 7.1 symbols/min [2025-10-17T19:36:34.242767] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:34.297808] [DEBUG] [LOCAL ] IOT: Loaded 53870 existing records from primary storage. [2025-10-17T19:36:34.298152] [INFO ] [MAIN ] IOT: Loaded 53870 existing records. [2025-10-17T19:36:34.365460] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-17T19:36:34.495816] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:34.496045] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-17T19:36:34.496095] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-17T19:36:34.497254] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-17T19:36:34.497359] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-17T19:36:34.881805] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:34.940255] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T19:36:34.941672] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T19:36:35.158079] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-17T19:36:35.958040] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-17T19:36:36.034628] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T19:36:36.758006] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-17T19:36:37.069639] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:36:37.558042] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-17T19:36:38.358092] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-17T19:36:38.560887] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:36:38.728310] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-17T19:36:38.773785] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:36:39.158134] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-17T19:36:39.778080] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:36:39.958043] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-17T19:36:40.066820] [DEBUG] [REMOTE ] INVX: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T19:36:40.067130] [WARN ] [REMOTE ] INVX: No data returned for month 2025-07 [2025-10-17T19:36:40.067221] [FATAL] [REMOTE ] INVX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:36:40.067343] [FATAL] [MAIN ] INVX: Failed to fetch primary data. [2025-10-17T19:36:40.067415] [WARN ] [MAIN ] INVX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:36:40.067486] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-17T19:36:40.067551] [DEBUG] [LOCAL ] INVX: No primary data file found to delete. [2025-10-17T19:36:40.067587] [INFO ] [LOCAL ] INVX: Starting deletion of derivative data. [2025-10-17T19:36:40.067757] [DEBUG] [LOCAL ] INVX: Deleted derivative data file. [2025-10-17T19:36:40.067841] [INFO ] [MAIN ] Update Progress: 1116/2368 symbols completed. INVX took 20.4s. Estimated remaining: 2h 55m 41s. Rate: 7.1 symbols/min [2025-10-17T19:36:40.240326] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:40.293383] [DEBUG] [LOCAL ] IP: Loaded 53697 existing records from primary storage. [2025-10-17T19:36:40.293799] [INFO ] [MAIN ] IP: Loaded 53697 existing records. [2025-10-17T19:36:40.469317] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:40.469534] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-17T19:36:40.469613] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-17T19:36:40.470156] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-17T19:36:40.470217] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-17T19:36:40.763200] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-17T19:36:40.839131] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:40.947440] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:36:40.954756] [INFO ] [REMOTE ] INVH: Full fetch complete (76970 records). [2025-10-17T19:36:40.954874] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-17T19:36:41.337217] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-17T19:36:41.337299] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-17T19:36:41.338590] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-17T19:36:41.338865] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-17T19:36:41.340284] [DEBUG] [LOCAL ] INVH: Trimmed 76970 records to 53973 (keeping 200 days of data) [2025-10-17T19:36:41.566875] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-17T19:36:41.663858] [DEBUG] [LOCAL ] INVH: Primary data saved (53973 records). [2025-10-17T19:36:41.664021] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-17T19:36:41.664105] [INFO ] [MAIN ] Update Progress: 1117/2368 symbols completed. INVH took 37.4s. Estimated remaining: 2h 55m 25s. Rate: 7.1 symbols/min [2025-10-17T19:36:42.358033] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-17T19:36:43.315757] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:36:43.325909] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-17T19:36:43.554915] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-17T19:36:43.958099] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-17T19:36:44.464420] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T19:36:44.758028] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-17T19:36:45.385046] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T19:36:45.558021] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-17T19:36:46.540007] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T19:36:46.550697] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-17T19:36:46.645360] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-17T19:36:47.035670] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:36:47.158027] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-17T19:36:47.958054] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-17T19:36:48.089939] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:36:48.586261] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:36:48.758012] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-17T19:36:49.558030] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-17T19:36:50.598209] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-17T19:36:50.609960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-17T19:36:50.663576] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:36:51.158027] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-17T19:36:51.237242] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:36:51.958027] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-17T19:36:53.158243] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T19:36:53.169338] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-17T19:36:53.362204] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-17T19:36:53.559518] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-17T19:36:53.566015] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:36:54.358085] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-17T19:36:55.031551] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:36:55.157997] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-17T19:36:56.191828] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T19:36:56.205369] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-17T19:36:56.323556] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T19:36:56.758004] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-17T19:36:56.893975] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T19:36:57.558054] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-17T19:36:58.706490] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T19:36:58.718063] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-17T19:36:58.751973] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-17T19:36:59.158012] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-17T19:36:59.457902] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T19:36:59.958025] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-17T19:37:00.813018] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T19:37:00.820352] [INFO ] [REMOTE ] IOT: Full fetch complete (77555 records). [2025-10-17T19:37:00.820475] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-17T19:37:01.219705] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-17T19:37:01.219796] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-17T19:37:01.220899] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-17T19:37:01.220975] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-17T19:37:01.222458] [DEBUG] [LOCAL ] IOT: Trimmed 77555 records to 54260 (keeping 200 days of data) [2025-10-17T19:37:01.538777] [DEBUG] [LOCAL ] IOT: Primary data saved (54260 records). [2025-10-17T19:37:01.539014] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-17T19:37:01.539127] [INFO ] [MAIN ] Update Progress: 1118/2368 symbols completed. IOT took 27.5s. Estimated remaining: 2h 55m 30s. Rate: 7.1 symbols/min [2025-10-17T19:37:02.080271] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T19:37:02.092808] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-17T19:37:02.430096] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (3.27 seconds). [2025-10-17T19:37:02.438185] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-17T19:37:02.438389] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-17T19:37:02.852477] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-17T19:37:02.852563] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-17T19:37:02.853578] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-17T19:37:02.853665] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-17T19:37:02.855132] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-17T19:37:03.182725] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-17T19:37:03.182953] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-17T19:37:03.183121] [INFO ] [MAIN ] Update Progress: 1119/2368 symbols completed. IONQ took 41.7s. Estimated remaining: 2h 55m 14s. Rate: 7.1 symbols/min [2025-10-17T19:37:03.893682] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:37:03.908423] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-17T19:37:05.818892] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T19:37:05.826294] [INFO ] [REMOTE ] IP: Full fetch complete (77394 records). [2025-10-17T19:37:05.826433] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-17T19:37:06.218168] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-17T19:37:06.218273] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-17T19:37:06.219288] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-17T19:37:06.219351] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-17T19:37:06.220789] [DEBUG] [LOCAL ] IP: Trimmed 77394 records to 54087 (keeping 200 days of data) [2025-10-17T19:37:06.552594] [DEBUG] [LOCAL ] IP: Primary data saved (54087 records). [2025-10-17T19:37:06.552795] [INFO ] [MAIN ] IP: Full history saved. [2025-10-17T19:37:06.552945] [INFO ] [MAIN ] Update Progress: 1120/2368 symbols completed. IP took 26.5s. Estimated remaining: 2h 54m 60s. Rate: 7.1 symbols/min [2025-10-17T19:37:07.155104] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.220171] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.256314] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.259916] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.285808] [DEBUG] [LOCAL ] IPI: Loaded 21575 existing records from primary storage. [2025-10-17T19:37:07.286435] [INFO ] [MAIN ] IPI: Loaded 21575 existing records. [2025-10-17T19:37:07.323868] [DEBUG] [LOCAL ] IQI: Loaded 17994 existing records from primary storage. [2025-10-17T19:37:07.358337] [INFO ] [MAIN ] IQI: Loaded 17994 existing records. [2025-10-17T19:37:07.706011] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:07.707401] [DEBUG] [LOCAL ] IPG: Loaded 53721 existing records from primary storage. [2025-10-17T19:37:07.706517] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-17T19:37:07.707791] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-17T19:37:07.707925] [INFO ] [MAIN ] IPG: Loaded 53721 existing records. [2025-10-17T19:37:07.713143] [DEBUG] [LOCAL ] IQV: Loaded 50425 existing records from primary storage. [2025-10-17T19:37:07.736304] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-17T19:37:07.756251] [INFO ] [MAIN ] IQV: Loaded 50425 existing records. [2025-10-17T19:37:07.741740] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-17T19:37:07.776004] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:07.841983] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-17T19:37:07.938188] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-17T19:37:08.082804] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-17T19:37:08.140249] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:08.174320] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-17T19:37:08.198677] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-17T19:37:08.231348] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-17T19:37:08.231274] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:08.280770] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-17T19:37:08.293678] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-17T19:37:08.328965] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-17T19:37:08.298926] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-17T19:37:08.361799] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-17T19:37:08.356617] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-17T19:37:08.926549] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:08.981104] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-17T19:37:09.381750] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:09.414295] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-17T19:37:09.576901] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:09.571373] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:09.577204] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-17T19:37:09.577502] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-17T19:37:10.144097] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T19:37:10.147841] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-17T19:37:10.796921] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:37:10.801665] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-17T19:37:11.104299] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T19:37:11.108466] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-17T19:37:11.286139] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:37:11.296066] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-17T19:37:11.678858] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T19:37:11.698045] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-17T19:37:11.703160] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-17T19:37:11.714296] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-17T19:37:11.881889] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:37:11.886347] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-17T19:37:12.770584] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:37:12.780248] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-17T19:37:12.838683] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:37:12.843992] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-17T19:37:12.953925] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T19:37:12.958845] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-17T19:37:13.502857] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:37:13.547416] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:37:13.557974] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-17T19:37:13.953499] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T19:37:14.220208] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T19:37:14.358012] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-17T19:37:14.401817] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:37:15.158038] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-17T19:37:15.957993] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-17T19:37:16.060761] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:37:16.758034] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-17T19:37:17.061351] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T19:37:17.151049] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T19:37:17.558068] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-17T19:37:18.358027] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-17T19:37:18.520089] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:37:19.158050] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-17T19:37:19.254255] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:37:19.291008] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T19:37:19.958073] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-17T19:37:20.217930] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:37:20.758035] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-17T19:37:21.093678] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:37:21.558008] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-17T19:37:21.849425] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:37:22.358027] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-17T19:37:23.158013] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-17T19:37:23.323228] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T19:37:23.373353] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T19:37:23.958028] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-17T19:37:24.758077] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-17T19:37:25.004597] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T19:37:25.037428] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T19:37:25.558000] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-17T19:37:26.317587] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:37:26.357982] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-17T19:37:26.584481] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T19:37:27.158023] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-17T19:37:27.958070] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-17T19:37:28.040341] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:37:28.396778] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:37:28.400547] [INFO ] [REMOTE ] IPI: Full fetch complete (30124 records). [2025-10-17T19:37:28.400672] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-17T19:37:28.764077] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-17T19:37:28.767231] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-17T19:37:28.767348] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-17T19:37:28.768032] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-17T19:37:28.768094] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-17T19:37:28.769054] [DEBUG] [LOCAL ] IPI: Trimmed 30124 records to 21783 (keeping 200 days of data) [2025-10-17T19:37:28.896086] [DEBUG] [LOCAL ] IPI: Primary data saved (21783 records). [2025-10-17T19:37:28.896229] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-17T19:37:28.896313] [INFO ] [MAIN ] Update Progress: 1121/2368 symbols completed. IPI took 22.3s. Estimated remaining: 2h 55m 7s. Rate: 7.1 symbols/min [2025-10-17T19:37:29.066347] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:29.123101] [DEBUG] [LOCAL ] IR: Loaded 53164 existing records from primary storage. [2025-10-17T19:37:29.123479] [INFO ] [MAIN ] IR: Loaded 53164 existing records. [2025-10-17T19:37:29.306965] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:29.307305] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-17T19:37:29.307449] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-17T19:37:29.308351] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-17T19:37:29.308425] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-17T19:37:29.489430] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:37:29.565328] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-17T19:37:29.760592] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:29.769160] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:37:30.358029] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-17T19:37:31.158031] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-17T19:37:31.409035] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T19:37:31.958085] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-17T19:37:32.184742] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T19:37:32.757997] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-17T19:37:32.945815] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T19:37:33.558008] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-17T19:37:33.607954] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T19:37:34.358013] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-17T19:37:34.527096] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:37:34.575375] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T19:37:35.158057] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-17T19:37:35.958096] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-17T19:37:36.061296] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:37:36.758056] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-17T19:37:36.866809] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T19:37:37.558039] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-17T19:37:37.643193] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T19:37:38.357993] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-17T19:37:38.511460] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:37:38.514627] [INFO ] [REMOTE ] IQI: Full fetch complete (26483 records). [2025-10-17T19:37:38.514751] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-17T19:37:38.718602] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T19:37:38.805256] [INFO ] [REMOTE ] IQV: Full fetch complete (72431 records). [2025-10-17T19:37:38.829914] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-17T19:37:39.079698] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-17T19:37:39.081130] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-17T19:37:39.115841] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-17T19:37:39.161697] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-17T19:37:39.161804] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-17T19:37:39.213146] [DEBUG] [LOCAL ] IQI: Trimmed 26483 records to 18096 (keeping 200 days of data) [2025-10-17T19:37:39.401786] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-17T19:37:39.402122] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-17T19:37:39.403163] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-17T19:37:39.404063] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-17T19:37:39.413361] [DEBUG] [LOCAL ] IQV: Trimmed 72431 records to 50750 (keeping 200 days of data) [2025-10-17T19:37:39.528040] [DEBUG] [LOCAL ] IQI: Primary data saved (18096 records). [2025-10-17T19:37:39.528959] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-17T19:37:39.529303] [INFO ] [MAIN ] Update Progress: 1122/2368 symbols completed. IQI took 33.0s. Estimated remaining: 2h 55m 1s. Rate: 7.1 symbols/min [2025-10-17T19:37:39.716269] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:39.927898] [DEBUG] [LOCAL ] IQV: Primary data saved (50750 records). [2025-10-17T19:37:39.928287] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-17T19:37:39.940723] [INFO ] [MAIN ] Update Progress: 1123/2368 symbols completed. IQV took 33.4s. Estimated remaining: 2h 54m 43s. Rate: 7.1 symbols/min [2025-10-17T19:37:39.943713] [DEBUG] [LOCAL ] IRM: Loaded 49463 existing records from primary storage. [2025-10-17T19:37:39.974564] [INFO ] [MAIN ] IRM: Loaded 49463 existing records. [2025-10-17T19:37:40.259213] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:40.332516] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:40.333087] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-17T19:37:40.335100] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T19:37:40.335287] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-17T19:37:40.346054] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-17T19:37:40.347006] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-17T19:37:40.347078] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-17T19:37:40.467086] [DEBUG] [LOCAL ] IRS: Loaded 23269 existing records from primary storage. [2025-10-17T19:37:40.478160] [INFO ] [MAIN ] IRS: Loaded 23269 existing records. [2025-10-17T19:37:40.871382] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:40.889296] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-17T19:37:40.889428] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-17T19:37:40.918257] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:40.918782] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-17T19:37:40.918886] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-17T19:37:40.919110] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-17T19:37:41.203340] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T19:37:41.237909] [INFO ] [REMOTE ] IPG: Full fetch complete (77435 records). [2025-10-17T19:37:41.248344] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-17T19:37:41.416511] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:41.575795] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-17T19:37:41.710467] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-17T19:37:41.710695] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-17T19:37:41.711890] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-17T19:37:41.712011] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-17T19:37:41.713723] [DEBUG] [LOCAL ] IPG: Trimmed 77435 records to 54111 (keeping 200 days of data) [2025-10-17T19:37:41.990509] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:37:42.087599] [DEBUG] [LOCAL ] IPG: Primary data saved (54111 records). [2025-10-17T19:37:42.087747] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-17T19:37:42.087856] [INFO ] [MAIN ] Update Progress: 1124/2368 symbols completed. IPG took 35.5s. Estimated remaining: 2h 54m 28s. Rate: 7.1 symbols/min [2025-10-17T19:37:42.261816] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:42.295305] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:37:42.344791] [DEBUG] [LOCAL ] IRT: Loaded 50924 existing records from primary storage. [2025-10-17T19:37:42.345112] [INFO ] [MAIN ] IRT: Loaded 50924 existing records. [2025-10-17T19:37:42.365407] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-17T19:37:42.537548] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:42.537787] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-17T19:37:42.537842] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-17T19:37:42.538336] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-17T19:37:42.538403] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-17T19:37:42.841985] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:37:42.922174] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:43.158005] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-17T19:37:43.958000] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-17T19:37:44.154732] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T19:37:44.661179] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:37:44.758004] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-17T19:37:45.195330] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:37:45.558023] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-17T19:37:46.330056] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:37:46.357982] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-17T19:37:47.158002] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-17T19:37:47.319775] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T19:37:47.839089] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T19:37:47.958001] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-17T19:37:48.147023] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:37:48.758036] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-17T19:37:49.553697] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T19:37:49.563399] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-17T19:37:49.808788] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:37:50.358029] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-17T19:37:51.163107] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-17T19:37:51.182676] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:37:51.958044] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-17T19:37:52.090944] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:37:52.704576] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T19:37:52.758013] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-17T19:37:52.842616] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:37:53.558027] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-17T19:37:54.115594] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:37:54.358016] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-17T19:37:54.604161] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T19:37:55.158058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-17T19:37:55.824228] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T19:37:55.957995] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-17T19:37:56.758037] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-17T19:37:57.020327] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:37:57.558004] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-17T19:37:57.772110] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:37:57.791297] [INFO ] [REMOTE ] IR: Full fetch complete (76494 records). [2025-10-17T19:37:57.791705] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-17T19:37:57.792718] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:37:58.182337] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-17T19:37:58.182441] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-17T19:37:58.183442] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-17T19:37:58.183504] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-17T19:37:58.185073] [DEBUG] [LOCAL ] IR: Trimmed 76494 records to 53548 (keeping 200 days of data) [2025-10-17T19:37:58.364122] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-17T19:37:58.510063] [DEBUG] [LOCAL ] IR: Primary data saved (53548 records). [2025-10-17T19:37:58.510192] [INFO ] [MAIN ] IR: Full history saved. [2025-10-17T19:37:58.510933] [INFO ] [MAIN ] Update Progress: 1125/2368 symbols completed. IR took 29.6s. Estimated remaining: 2h 54m 28s. Rate: 7.1 symbols/min [2025-10-17T19:37:58.678255] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:58.694813] [DEBUG] [LOCAL ] ISD: Loaded 15985 existing records from primary storage. [2025-10-17T19:37:58.695098] [INFO ] [MAIN ] ISD: Loaded 15985 existing records. [2025-10-17T19:37:58.879823] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:58.880014] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-17T19:37:58.880091] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-17T19:37:58.880551] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-17T19:37:58.880612] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-17T19:37:59.163113] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-17T19:37:59.256518] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:59.284060] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:37:59.958038] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-17T19:38:00.168446] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T19:38:00.299069] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T19:38:00.758057] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-17T19:38:01.558017] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-17T19:38:02.354265] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-17T19:38:02.358067] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-17T19:38:02.777804] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T19:38:02.810155] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:38:03.158070] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-17T19:38:03.958048] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-17T19:38:04.144023] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T19:38:04.298836] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T19:38:04.758083] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-17T19:38:05.309161] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:38:05.558053] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-17T19:38:06.357996] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-17T19:38:06.448792] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:38:06.467811] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T19:38:07.158032] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-17T19:38:07.453487] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:38:07.458034] [INFO ] [REMOTE ] IRS: Full fetch complete (32700 records). [2025-10-17T19:38:07.458191] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-17T19:38:07.850113] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-17T19:38:07.850188] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-17T19:38:07.850967] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-17T19:38:07.851032] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-17T19:38:07.852036] [DEBUG] [LOCAL ] IRS: Trimmed 32700 records to 23427 (keeping 200 days of data) [2025-10-17T19:38:07.959005] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-17T19:38:07.987914] [DEBUG] [LOCAL ] IRS: Primary data saved (23427 records). [2025-10-17T19:38:07.988054] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-17T19:38:07.988152] [INFO ] [MAIN ] Update Progress: 1126/2368 symbols completed. IRS took 28.0s. Estimated remaining: 2h 54m 21s. Rate: 7.1 symbols/min [2025-10-17T19:38:08.166602] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:08.205262] [DEBUG] [LOCAL ] IT: Loaded 42544 existing records from primary storage. [2025-10-17T19:38:08.205615] [INFO ] [MAIN ] IT: Loaded 42544 existing records. [2025-10-17T19:38:08.381000] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:08.381783] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-17T19:38:08.381835] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-17T19:38:08.382583] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-17T19:38:08.382664] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-17T19:38:08.759879] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-17T19:38:08.759811] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:08.891578] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:38:09.558053] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-17T19:38:09.728745] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:38:09.768599] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:38:10.358034] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-17T19:38:10.953210] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:38:11.158020] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-17T19:38:11.958034] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-17T19:38:12.136580] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:38:12.504245] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:38:12.758072] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-17T19:38:13.558003] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-17T19:38:13.600603] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:38:13.828772] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T19:38:14.358147] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-17T19:38:15.158014] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-17T19:38:15.427990] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T19:38:15.471281] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:38:15.958033] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-17T19:38:16.548409] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:38:16.758009] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-17T19:38:16.891459] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T19:38:17.558042] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-17T19:38:18.104309] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:38:18.358047] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-17T19:38:18.846976] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T19:38:19.158031] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-17T19:38:19.958013] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-17T19:38:20.122190] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T19:38:20.489800] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T19:38:20.758003] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-17T19:38:20.815941] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:38:21.558033] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-17T19:38:22.357995] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-17T19:38:22.466447] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T19:38:22.588178] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T19:38:22.595000] [INFO ] [REMOTE ] IRM: Full fetch complete (72285 records). [2025-10-17T19:38:22.595114] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-17T19:38:22.976411] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-17T19:38:22.976481] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-17T19:38:22.977509] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-17T19:38:22.977575] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-17T19:38:22.978909] [DEBUG] [LOCAL ] IRM: Trimmed 72285 records to 49820 (keeping 200 days of data) [2025-10-17T19:38:23.163493] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-17T19:38:23.284496] [DEBUG] [LOCAL ] IRM: Primary data saved (49820 records). [2025-10-17T19:38:23.284636] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-17T19:38:23.284770] [INFO ] [MAIN ] Update Progress: 1127/2368 symbols completed. IRM took 43.8s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-10-17T19:38:23.448192] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:23.477994] [DEBUG] [LOCAL ] ITGR: Loaded 31563 existing records from primary storage. [2025-10-17T19:38:23.478276] [INFO ] [MAIN ] ITGR: Loaded 31563 existing records. [2025-10-17T19:38:23.652261] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:23.652501] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-17T19:38:23.652549] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-17T19:38:23.653347] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-17T19:38:23.653428] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-17T19:38:23.965552] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-17T19:38:24.062380] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:24.064159] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T19:38:24.071928] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:38:24.079118] [INFO ] [REMOTE ] IRT: Full fetch complete (72946 records). [2025-10-17T19:38:24.079220] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-17T19:38:24.453332] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-17T19:38:24.453412] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-17T19:38:24.454384] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-17T19:38:24.454448] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-17T19:38:24.455812] [DEBUG] [LOCAL ] IRT: Trimmed 72946 records to 51273 (keeping 200 days of data) [2025-10-17T19:38:24.758075] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-17T19:38:24.762226] [DEBUG] [LOCAL ] IRT: Primary data saved (51273 records). [2025-10-17T19:38:24.762402] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-17T19:38:24.762545] [INFO ] [MAIN ] Update Progress: 1128/2368 symbols completed. IRT took 42.7s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-17T19:38:24.928664] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:24.960811] [DEBUG] [LOCAL ] ITT: Loaded 32949 existing records from primary storage. [2025-10-17T19:38:24.961084] [INFO ] [MAIN ] ITT: Loaded 32949 existing records. [2025-10-17T19:38:25.132785] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:25.133014] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-17T19:38:25.133062] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-17T19:38:25.133775] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-17T19:38:25.133845] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-17T19:38:25.486571] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:25.557985] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-17T19:38:25.691938] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:38:25.801598] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T19:38:26.358027] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-17T19:38:26.877553] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T19:38:27.158011] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-17T19:38:27.417705] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:38:27.958029] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-17T19:38:28.450103] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:38:28.758096] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-17T19:38:28.892476] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T19:38:28.895996] [INFO ] [REMOTE ] ISD: Full fetch complete (24138 records). [2025-10-17T19:38:28.896155] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-17T19:38:29.416003] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-17T19:38:29.416103] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-17T19:38:29.416761] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-17T19:38:29.416826] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-17T19:38:29.417755] [DEBUG] [LOCAL ] ISD: Trimmed 24138 records to 16121 (keeping 200 days of data) [2025-10-17T19:38:29.518084] [DEBUG] [LOCAL ] ISD: Primary data saved (16121 records). [2025-10-17T19:38:29.518247] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-17T19:38:29.518338] [INFO ] [MAIN ] Update Progress: 1129/2368 symbols completed. ISD took 31.0s. Estimated remaining: 2h 53m 52s. Rate: 7.1 symbols/min [2025-10-17T19:38:29.563603] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-17T19:38:29.707674] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:29.762313] [DEBUG] [LOCAL ] ITUB: Loaded 53720 existing records from primary storage. [2025-10-17T19:38:29.762629] [INFO ] [MAIN ] ITUB: Loaded 53720 existing records. [2025-10-17T19:38:29.950391] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:29.950810] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-17T19:38:29.950884] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-17T19:38:29.951436] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-17T19:38:29.951495] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-17T19:38:30.244226] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T19:38:30.325257] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:30.358022] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-17T19:38:30.510987] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T19:38:31.158030] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-17T19:38:31.380305] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:38:31.958146] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-17T19:38:32.699529] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T19:38:32.757994] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-17T19:38:33.374873] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:38:33.558050] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-17T19:38:33.910262] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T19:38:34.358033] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-17T19:38:35.158015] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-17T19:38:35.243892] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:38:35.958015] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-17T19:38:36.202631] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:38:36.693545] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:38:36.758015] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-17T19:38:37.558001] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-17T19:38:37.996893] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:38:38.358076] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-17T19:38:38.572766] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T19:38:39.146611] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:38:39.157986] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-17T19:38:39.928455] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:38:39.957980] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-17T19:38:40.404185] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T19:38:40.758083] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-17T19:38:41.418728] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:38:41.558045] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-17T19:38:42.109531] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:38:42.358029] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-17T19:38:43.158019] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-17T19:38:43.282135] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T19:38:43.958000] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-17T19:38:44.000046] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T19:38:44.037869] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T19:38:44.044014] [INFO ] [REMOTE ] IT: Full fetch complete (57583 records). [2025-10-17T19:38:44.044113] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-17T19:38:44.430909] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-17T19:38:44.431024] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-17T19:38:44.431902] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-17T19:38:44.431965] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-17T19:38:44.433119] [DEBUG] [LOCAL ] IT: Trimmed 57583 records to 42892 (keeping 200 days of data) [2025-10-17T19:38:44.681943] [DEBUG] [LOCAL ] IT: Primary data saved (42892 records). [2025-10-17T19:38:44.682071] [INFO ] [MAIN ] IT: Full history saved. [2025-10-17T19:38:44.682147] [INFO ] [MAIN ] Update Progress: 1130/2368 symbols completed. IT took 36.7s. Estimated remaining: 2h 53m 51s. Rate: 7.1 symbols/min [2025-10-17T19:38:44.763191] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-17T19:38:44.849315] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:44.888685] [DEBUG] [LOCAL ] ITW: Loaded 46082 existing records from primary storage. [2025-10-17T19:38:44.888973] [INFO ] [MAIN ] ITW: Loaded 46082 existing records. [2025-10-17T19:38:45.068353] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:45.068573] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-17T19:38:45.068630] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-17T19:38:45.069616] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-17T19:38:45.069708] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-17T19:38:45.423251] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:45.440709] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:38:45.557994] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-17T19:38:46.164161] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T19:38:46.357991] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-17T19:38:47.085466] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:38:47.158005] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-17T19:38:47.753132] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T19:38:47.958022] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-17T19:38:48.758034] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-17T19:38:48.939066] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T19:38:49.098166] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T19:38:49.558039] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-17T19:38:50.357998] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-17T19:38:50.395204] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:38:50.988907] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:38:51.157996] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-17T19:38:51.957996] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-17T19:38:52.171845] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:38:52.377158] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T19:38:52.758082] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-17T19:38:53.291231] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T19:38:53.558060] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-17T19:38:54.092365] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:38:54.097166] [INFO ] [REMOTE ] ITT: Full fetch complete (47401 records). [2025-10-17T19:38:54.097362] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-17T19:38:54.363251] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-17T19:38:54.491233] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-17T19:38:54.491325] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-17T19:38:54.492168] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-17T19:38:54.492344] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-17T19:38:54.493543] [DEBUG] [LOCAL ] ITT: Trimmed 47401 records to 33177 (keeping 200 days of data) [2025-10-17T19:38:54.703469] [DEBUG] [LOCAL ] ITT: Primary data saved (33177 records). [2025-10-17T19:38:54.703611] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-17T19:38:54.703728] [INFO ] [MAIN ] Update Progress: 1131/2368 symbols completed. ITT took 29.9s. Estimated remaining: 2h 53m 44s. Rate: 7.1 symbols/min [2025-10-17T19:38:54.889119] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:54.908027] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:38:54.953439] [DEBUG] [LOCAL ] IVR: Loaded 48437 existing records from primary storage. [2025-10-17T19:38:54.953798] [INFO ] [MAIN ] IVR: Loaded 48437 existing records. [2025-10-17T19:38:55.140245] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:55.140450] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-17T19:38:55.140498] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-17T19:38:55.140948] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-17T19:38:55.141006] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-17T19:38:55.163120] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-17T19:38:55.505485] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:55.878418] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:38:55.958003] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-17T19:38:56.599044] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:38:56.603436] [INFO ] [REMOTE ] ITGR: Full fetch complete (42898 records). [2025-10-17T19:38:56.603532] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-17T19:38:56.763631] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-17T19:38:57.010318] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-17T19:38:57.010399] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-17T19:38:57.011150] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-17T19:38:57.011212] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-17T19:38:57.012762] [DEBUG] [LOCAL ] ITGR: Trimmed 42898 records to 31722 (keeping 200 days of data) [2025-10-17T19:38:57.201620] [DEBUG] [LOCAL ] ITGR: Primary data saved (31722 records). [2025-10-17T19:38:57.201785] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-17T19:38:57.201885] [INFO ] [MAIN ] Update Progress: 1132/2368 symbols completed. ITGR took 33.9s. Estimated remaining: 2h 53m 29s. Rate: 7.1 symbols/min [2025-10-17T19:38:57.369501] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:57.400900] [DEBUG] [LOCAL ] IVT: Loaded 31572 existing records from primary storage. [2025-10-17T19:38:57.401158] [INFO ] [MAIN ] IVT: Loaded 31572 existing records. [2025-10-17T19:38:57.563671] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-17T19:38:57.585825] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:57.586115] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-17T19:38:57.586164] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-17T19:38:57.586441] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-17T19:38:57.586489] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-17T19:38:57.944223] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:57.973090] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T19:38:58.358011] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-17T19:38:58.700018] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:38:59.158001] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-17T19:38:59.320240] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:38:59.958052] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-17T19:38:59.994095] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:39:00.758074] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-17T19:39:01.558034] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-17T19:39:01.695560] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-17T19:39:02.358069] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-17T19:39:02.401398] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:39:02.467093] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-17T19:39:03.158129] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-17T19:39:03.219961] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:39:03.746387] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:39:03.958057] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-17T19:39:04.747497] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:39:04.758049] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-17T19:39:04.903587] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T19:39:05.558033] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-17T19:39:06.358011] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-17T19:39:06.517518] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:39:07.158014] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-17T19:39:07.237130] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:39:07.958037] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-17T19:39:08.175884] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:39:08.758077] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-17T19:39:09.044466] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T19:39:09.244456] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T19:39:09.558065] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-17T19:39:10.316224] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:39:10.358030] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-17T19:39:11.158032] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-17T19:39:11.824222] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T19:39:11.831504] [INFO ] [REMOTE ] ITUB: Full fetch complete (77318 records). [2025-10-17T19:39:11.831700] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-17T19:39:11.959098] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-17T19:39:12.207514] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T19:39:12.274239] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-17T19:39:12.274985] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-17T19:39:12.276114] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-17T19:39:12.276179] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-17T19:39:12.277962] [DEBUG] [LOCAL ] ITUB: Trimmed 77318 records to 54103 (keeping 200 days of data) [2025-10-17T19:39:12.499521] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T19:39:12.622607] [DEBUG] [LOCAL ] ITUB: Primary data saved (54103 records). [2025-10-17T19:39:12.622779] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-17T19:39:12.623606] [INFO ] [MAIN ] Update Progress: 1133/2368 symbols completed. ITUB took 43.1s. Estimated remaining: 2h 53m 28s. Rate: 7.1 symbols/min [2025-10-17T19:39:12.765102] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-17T19:39:12.798706] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:12.852325] [DEBUG] [LOCAL ] IVZ: Loaded 53506 existing records from primary storage. [2025-10-17T19:39:12.852693] [INFO ] [MAIN ] IVZ: Loaded 53506 existing records. [2025-10-17T19:39:13.030148] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:13.030413] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-17T19:39:13.030481] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-17T19:39:13.031411] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-17T19:39:13.031504] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-17T19:39:13.386847] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:13.558105] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-17T19:39:13.689284] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:39:14.237478] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T19:39:14.358038] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-17T19:39:15.158030] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-17T19:39:15.247350] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:39:15.254576] [INFO ] [REMOTE ] ITW: Full fetch complete (66724 records). [2025-10-17T19:39:15.254713] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-17T19:39:15.644496] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-17T19:39:15.644576] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-17T19:39:15.645512] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-17T19:39:15.645579] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-17T19:39:15.647085] [DEBUG] [LOCAL ] ITW: Trimmed 66724 records to 46398 (keeping 200 days of data) [2025-10-17T19:39:15.948611] [DEBUG] [LOCAL ] ITW: Primary data saved (46398 records). [2025-10-17T19:39:15.948887] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-17T19:39:15.949097] [INFO ] [MAIN ] Update Progress: 1134/2368 symbols completed. ITW took 31.3s. Estimated remaining: 2h 53m 14s. Rate: 7.1 symbols/min [2025-10-17T19:39:15.980262] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-17T19:39:16.128477] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:39:16.145305] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:16.176665] [DEBUG] [LOCAL ] IX: Loaded 22439 existing records from primary storage. [2025-10-17T19:39:16.176947] [INFO ] [MAIN ] IX: Loaded 22439 existing records. [2025-10-17T19:39:16.351011] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:16.351246] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-17T19:39:16.351297] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-17T19:39:16.351770] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-17T19:39:16.351870] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-17T19:39:16.719458] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:16.758019] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-17T19:39:17.070307] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:39:17.357839] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T19:39:17.558038] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-17T19:39:18.276467] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T19:39:18.358005] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-17T19:39:18.846035] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T19:39:19.158048] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-17T19:39:19.576574] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:39:19.958028] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-17T19:39:20.758112] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-17T19:39:20.813369] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T19:39:20.903751] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T19:39:21.558060] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-17T19:39:22.358092] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-17T19:39:22.426752] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:39:23.158095] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-17T19:39:23.188029] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T19:39:23.362183] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:39:23.958108] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-17T19:39:24.511512] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:39:24.758085] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-17T19:39:25.040680] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T19:39:25.558037] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-17T19:39:26.358008] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-17T19:39:26.656837] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T19:39:26.664275] [INFO ] [REMOTE ] IVR: Full fetch complete (69175 records). [2025-10-17T19:39:26.664429] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-17T19:39:26.995439] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T19:39:27.132132] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-17T19:39:27.132323] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-17T19:39:27.134088] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-17T19:39:27.134162] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-17T19:39:27.136150] [DEBUG] [LOCAL ] IVR: Trimmed 69175 records to 48761 (keeping 200 days of data) [2025-10-17T19:39:27.193195] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-17T19:39:27.359380] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T19:39:27.489036] [DEBUG] [LOCAL ] IVR: Primary data saved (48761 records). [2025-10-17T19:39:27.489226] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-17T19:39:27.489385] [INFO ] [MAIN ] Update Progress: 1135/2368 symbols completed. IVR took 32.8s. Estimated remaining: 2h 53m 9s. Rate: 7.1 symbols/min [2025-10-17T19:39:27.662077] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:27.705372] [DEBUG] [LOCAL ] J: Loaded 40700 existing records from primary storage. [2025-10-17T19:39:27.705790] [INFO ] [MAIN ] J: Loaded 40700 existing records. [2025-10-17T19:39:27.886808] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:27.887098] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-17T19:39:27.887150] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-17T19:39:27.888191] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-17T19:39:27.888259] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-17T19:39:27.966368] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-17T19:39:28.254199] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:28.758046] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-17T19:39:28.873323] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:39:29.506565] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T19:39:29.557983] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-17T19:39:30.139826] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T19:39:30.358043] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-17T19:39:30.710857] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:39:31.158055] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-17T19:39:31.843943] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T19:39:31.849180] [INFO ] [REMOTE ] IVT: Full fetch complete (45899 records). [2025-10-17T19:39:31.849267] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-17T19:39:31.963285] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-17T19:39:32.234487] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-17T19:39:32.234565] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-17T19:39:32.235362] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-17T19:39:32.235423] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-17T19:39:32.236424] [DEBUG] [LOCAL ] IVT: Trimmed 45899 records to 31836 (keeping 200 days of data) [2025-10-17T19:39:32.432533] [DEBUG] [LOCAL ] IVT: Primary data saved (31836 records). [2025-10-17T19:39:32.432734] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-17T19:39:32.432838] [INFO ] [MAIN ] Update Progress: 1136/2368 symbols completed. IVT took 35.2s. Estimated remaining: 2h 52m 57s. Rate: 7.1 symbols/min [2025-10-17T19:39:32.606521] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:32.648801] [DEBUG] [LOCAL ] JBGS: Loaded 42407 existing records from primary storage. [2025-10-17T19:39:32.649159] [INFO ] [MAIN ] JBGS: Loaded 42407 existing records. [2025-10-17T19:39:32.762617] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-17T19:39:32.831544] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:32.831905] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-17T19:39:32.832020] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-17T19:39:32.833260] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-17T19:39:32.833327] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-17T19:39:33.235963] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-17T19:39:33.233924] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:33.248422] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:39:33.558024] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-17T19:39:34.358030] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-17T19:39:34.439610] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:39:34.534604] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T19:39:35.158018] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-17T19:39:35.407849] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:39:35.958066] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-17T19:39:36.758019] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-17T19:39:37.012016] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T19:39:37.335079] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T19:39:37.352881] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:39:37.558038] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-17T19:39:38.358060] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-17T19:39:39.000410] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:39:39.072965] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T19:39:39.076946] [INFO ] [REMOTE ] IX: Full fetch complete (28358 records). [2025-10-17T19:39:39.077021] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-17T19:39:39.163217] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-17T19:39:39.445072] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-17T19:39:39.445161] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-17T19:39:39.445766] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-17T19:39:39.445826] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-17T19:39:39.447166] [DEBUG] [LOCAL ] IX: Trimmed 28358 records to 22572 (keeping 200 days of data) [2025-10-17T19:39:39.574015] [DEBUG] [LOCAL ] IX: Primary data saved (22572 records). [2025-10-17T19:39:39.574140] [INFO ] [MAIN ] IX: Full history saved. [2025-10-17T19:39:39.574239] [INFO ] [MAIN ] Update Progress: 1137/2368 symbols completed. IX took 23.6s. Estimated remaining: 2h 52m 47s. Rate: 7.1 symbols/min [2025-10-17T19:39:39.740834] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:39.778458] [DEBUG] [LOCAL ] JBI: Loaded 43293 existing records from primary storage. [2025-10-17T19:39:39.778789] [INFO ] [MAIN ] JBI: Loaded 43293 existing records. [2025-10-17T19:39:39.951394] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:39.951601] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-17T19:39:39.951677] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-17T19:39:39.952344] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-17T19:39:39.952417] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-17T19:39:39.963635] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-17T19:39:40.309108] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:40.557445] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:39:40.757990] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-17T19:39:41.438010] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T19:39:41.558003] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-17T19:39:42.351411] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T19:39:42.359825] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-17T19:39:43.065765] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:39:43.158002] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-17T19:39:43.963202] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-17T19:39:43.985751] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:39:44.695466] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T19:39:44.758048] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-17T19:39:45.558020] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-17T19:39:45.796715] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T19:39:46.358005] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-17T19:39:46.390599] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:39:47.069915] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:39:47.158037] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-17T19:39:47.906821] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:39:47.958037] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-17T19:39:48.758036] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-17T19:39:48.884729] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:39:49.534124] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T19:39:49.558019] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-17T19:39:50.299891] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T19:39:50.357991] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-17T19:39:51.161081] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-17T19:39:51.166603] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:39:51.391485] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:39:51.958224] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-17T19:39:52.758005] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-17T19:39:53.141528] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T19:39:53.518285] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:39:53.557994] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-17T19:39:54.358043] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-17T19:39:54.507479] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:39:55.056971] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:39:55.158070] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-17T19:39:55.958081] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-17T19:39:56.000477] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:39:56.700147] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:39:56.757992] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-17T19:39:57.123964] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T19:39:57.558042] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-17T19:39:58.187350] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:39:58.358012] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-17T19:39:59.104149] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:39:59.158055] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-17T19:39:59.808781] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:39:59.958003] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-17T19:40:00.758075] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-17T19:40:01.558123] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-17T19:40:01.644508] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:40:01.740942] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-17T19:40:01.749542] [INFO ] [REMOTE ] IVZ: Full fetch complete (77024 records). [2025-10-17T19:40:01.749856] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-17T19:40:02.184245] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-17T19:40:02.184341] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-17T19:40:02.185404] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-17T19:40:02.185469] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-17T19:40:02.186969] [DEBUG] [LOCAL ] IVZ: Trimmed 77024 records to 53895 (keeping 200 days of data) [2025-10-17T19:40:02.362391] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-17T19:40:02.516753] [DEBUG] [LOCAL ] IVZ: Primary data saved (53895 records). [2025-10-17T19:40:02.516910] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-17T19:40:02.517674] [INFO ] [MAIN ] Update Progress: 1138/2368 symbols completed. IVZ took 49.9s. Estimated remaining: 2h 52m 55s. Rate: 7.1 symbols/min [2025-10-17T19:40:02.698255] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:02.728268] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T19:40:02.780944] [DEBUG] [LOCAL ] JBL: Loaded 48716 existing records from primary storage. [2025-10-17T19:40:02.781279] [INFO ] [MAIN ] JBL: Loaded 48716 existing records. [2025-10-17T19:40:02.967186] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:02.967507] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-17T19:40:02.967578] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-17T19:40:02.967959] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-17T19:40:02.968032] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-17T19:40:03.159796] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-17T19:40:03.331136] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T19:40:03.382065] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:03.958017] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-17T19:40:04.286775] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T19:40:04.292808] [INFO ] [REMOTE ] JBGS: Full fetch complete (59299 records). [2025-10-17T19:40:04.293019] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-17T19:40:04.683581] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-17T19:40:04.683734] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-17T19:40:04.684769] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-17T19:40:04.684848] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-17T19:40:04.686104] [DEBUG] [LOCAL ] JBGS: Trimmed 59299 records to 42660 (keeping 200 days of data) [2025-10-17T19:40:04.773051] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-17T19:40:04.934195] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:40:04.992732] [DEBUG] [LOCAL ] JBGS: Primary data saved (42660 records). [2025-10-17T19:40:04.992879] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-17T19:40:04.992964] [INFO ] [MAIN ] Update Progress: 1139/2368 symbols completed. JBGS took 32.6s. Estimated remaining: 2h 52m 40s. Rate: 7.1 symbols/min [2025-10-17T19:40:05.168557] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:05.194923] [DEBUG] [LOCAL ] JBND: Loaded 27187 existing records from primary storage. [2025-10-17T19:40:05.195189] [INFO ] [MAIN ] JBND: Loaded 27187 existing records. [2025-10-17T19:40:05.373219] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:05.373482] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-17T19:40:05.373620] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-17T19:40:05.373950] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-17T19:40:05.374023] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-17T19:40:05.564471] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-17T19:40:05.585522] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T19:40:05.624122] [INFO ] [REMOTE ] JBI: Full fetch complete (63909 records). [2025-10-17T19:40:05.656398] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-17T19:40:05.929551] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:06.167527] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-17T19:40:06.167624] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-17T19:40:06.168740] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-17T19:40:06.168822] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-17T19:40:06.170292] [DEBUG] [LOCAL ] JBI: Trimmed 63909 records to 43558 (keeping 200 days of data) [2025-10-17T19:40:06.370126] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-17T19:40:06.426720] [DEBUG] [LOCAL ] JBI: Primary data saved (43558 records). [2025-10-17T19:40:06.426859] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-17T19:40:06.427681] [INFO ] [MAIN ] Update Progress: 1140/2368 symbols completed. JBI took 26.9s. Estimated remaining: 2h 52m 24s. Rate: 7.1 symbols/min [2025-10-17T19:40:06.609065] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:06.609470] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-17T19:40:06.609523] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-17T19:40:06.631495] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-17T19:40:06.634267] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-17T19:40:06.634529] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-17T19:40:06.635015] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-17T19:40:06.636040] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T19:40:07.005409] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:07.158006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-17T19:40:07.184030] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T19:40:07.958065] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-17T19:40:08.076165] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:40:08.758050] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-17T19:40:08.932113] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T19:40:08.959068] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:40:08.959448] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-17T19:40:08.959561] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:40:08.959609] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-17T19:40:08.959672] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:40:08.959734] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-17T19:40:08.959795] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-17T19:40:08.959831] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-17T19:40:08.959871] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-17T19:40:08.959920] [INFO ] [MAIN ] Update Progress: 1141/2368 symbols completed. JBS took 2.5s. Estimated remaining: 2h 52m 9s. Rate: 7.1 symbols/min [2025-10-17T19:40:09.154120] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:09.154311] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-17T19:40:09.154351] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-17T19:40:09.154471] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-17T19:40:09.154514] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-17T19:40:09.154559] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-17T19:40:09.154593] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-17T19:40:09.562692] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-17T19:40:09.562551] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:09.628281] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:40:10.358090] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-17T19:40:10.529383] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:40:10.552287] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:40:10.552618] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-17T19:40:10.552734] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:40:10.552782] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-17T19:40:10.552815] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:40:10.552852] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-17T19:40:10.552909] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-17T19:40:10.552943] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-17T19:40:10.552982] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-17T19:40:10.553028] [INFO ] [MAIN ] Update Progress: 1142/2368 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 51m 53s. Rate: 7.1 symbols/min [2025-10-17T19:40:10.720750] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:10.720920] [DEBUG] [LOCAL ] JCE: No existing data file found in primary storage. [2025-10-17T19:40:10.720957] [WARN ] [MAIN ] JCE: No existing data found, performing full refresh instead. [2025-10-17T19:40:10.721070] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-17T19:40:10.721111] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-17T19:40:10.721151] [DEBUG] [LOCAL ] JCE: No primary data file found to delete. [2025-10-17T19:40:10.721183] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-17T19:40:11.068009] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:11.158013] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-17T19:40:11.958068] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-17T19:40:12.025769] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T19:40:12.758127] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-17T19:40:12.889892] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:40:13.558029] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-17T19:40:14.238483] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T19:40:14.358027] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-17T19:40:14.485779] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T19:40:14.493433] [INFO ] [REMOTE ] J: Full fetch complete (59639 records). [2025-10-17T19:40:14.493619] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-17T19:40:15.068357] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-17T19:40:15.068474] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-17T19:40:15.069987] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-17T19:40:15.070101] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-17T19:40:15.071884] [DEBUG] [LOCAL ] J: Trimmed 59639 records to 41066 (keeping 200 days of data) [2025-10-17T19:40:15.161684] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-17T19:40:15.464044] [DEBUG] [LOCAL ] J: Primary data saved (41066 records). [2025-10-17T19:40:15.464228] [INFO ] [MAIN ] J: Full history saved. [2025-10-17T19:40:15.464333] [INFO ] [MAIN ] Update Progress: 1143/2368 symbols completed. J took 48.0s. Estimated remaining: 2h 51m 41s. Rate: 7.1 symbols/min [2025-10-17T19:40:15.614863] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T19:40:15.681775] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:15.735111] [DEBUG] [LOCAL ] JCI: Loaded 53916 existing records from primary storage. [2025-10-17T19:40:15.735460] [INFO ] [MAIN ] JCI: Loaded 53916 existing records. [2025-10-17T19:40:15.931466] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:15.931812] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-17T19:40:15.936410] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-17T19:40:15.936605] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T19:40:15.938497] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-17T19:40:15.939142] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-17T19:40:15.963194] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-17T19:40:16.318422] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:16.758045] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-17T19:40:17.244161] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T19:40:17.558052] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-17T19:40:18.225296] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T19:40:18.358069] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-17T19:40:18.744102] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T19:40:19.158082] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-17T19:40:19.945852] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T19:40:19.957992] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-17T19:40:19.996519] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T19:40:20.592596] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T19:40:20.758040] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-17T19:40:21.514473] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T19:40:21.558017] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-17T19:40:22.309823] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:40:22.358064] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-17T19:40:23.158064] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-17T19:40:23.504347] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T19:40:23.958051] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-17T19:40:24.758002] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-17T19:40:24.981787] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T19:40:25.080502] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T19:40:25.358141] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T19:40:25.558068] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-17T19:40:26.358043] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-17T19:40:27.158021] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-17T19:40:27.177514] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:40:27.446121] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:40:27.958081] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-17T19:40:28.371274] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T19:40:28.758070] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-17T19:40:29.558050] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-17T19:40:29.681894] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T19:40:29.684004] [INFO ] [REMOTE ] JCE: Full fetch complete (9741 records). [2025-10-17T19:40:29.684074] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-17T19:40:30.006143] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T19:40:30.084736] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-17T19:40:30.084816] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-17T19:40:30.085038] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-17T19:40:30.085075] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-17T19:40:30.085485] [DEBUG] [LOCAL ] JCE: Trimmed 9741 records to 7507 (keeping 200 days of data) [2025-10-17T19:40:30.131417] [DEBUG] [LOCAL ] JCE: Primary data saved (7507 records). [2025-10-17T19:40:30.131538] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-17T19:40:30.131608] [INFO ] [MAIN ] Update Progress: 1144/2368 symbols completed. JCE took 19.6s. Estimated remaining: 2h 51m 39s. Rate: 7.1 symbols/min [2025-10-17T19:40:30.296890] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:30.343169] [DEBUG] [LOCAL ] JEF: Loaded 50561 existing records from primary storage. [2025-10-17T19:40:30.343480] [INFO ] [MAIN ] JEF: Loaded 50561 existing records. [2025-10-17T19:40:30.363566] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-17T19:40:30.522574] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:30.522845] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-17T19:40:30.522900] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-17T19:40:30.523935] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-17T19:40:30.523995] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-17T19:40:30.881147] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:31.166424] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-17T19:40:31.185399] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T19:40:31.301762] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T19:40:31.958043] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-17T19:40:32.758051] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-17T19:40:32.794499] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T19:40:33.290557] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:40:33.558037] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-17T19:40:34.358019] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-17T19:40:34.535852] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:40:34.990483] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:40:34.995770] [INFO ] [REMOTE ] JBND: Full fetch complete (35748 records). [2025-10-17T19:40:34.995847] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-17T19:40:35.161984] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-17T19:40:35.388266] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-17T19:40:35.388339] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-17T19:40:35.389043] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-17T19:40:35.389107] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-17T19:40:35.389964] [DEBUG] [LOCAL ] JBND: Trimmed 35748 records to 27442 (keeping 200 days of data) [2025-10-17T19:40:35.559735] [DEBUG] [LOCAL ] JBND: Primary data saved (27442 records). [2025-10-17T19:40:35.560132] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-17T19:40:35.560220] [INFO ] [MAIN ] Update Progress: 1145/2368 symbols completed. JBND took 30.6s. Estimated remaining: 2h 51m 28s. Rate: 7.1 symbols/min [2025-10-17T19:40:35.730146] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:35.769466] [DEBUG] [LOCAL ] JELD: Loaded 46434 existing records from primary storage. [2025-10-17T19:40:35.769783] [INFO ] [MAIN ] JELD: Loaded 46434 existing records. [2025-10-17T19:40:35.958272] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-17T19:40:35.958181] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:35.959361] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-17T19:40:35.959560] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-17T19:40:35.960831] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-17T19:40:35.960895] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-17T19:40:36.090974] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T19:40:36.352286] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:36.758013] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-17T19:40:37.036161] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T19:40:37.558034] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-17T19:40:37.906607] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T19:40:38.309247] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:40:38.358025] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-17T19:40:39.158084] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-17T19:40:39.307055] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:40:39.699287] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T19:40:39.958044] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-17T19:40:40.758084] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-17T19:40:40.993587] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:40:41.470889] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:40:41.558037] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-17T19:40:42.268552] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:40:42.357984] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-17T19:40:43.157992] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-17T19:40:43.280890] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:40:43.964900] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-17T19:40:43.971182] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:40:44.758043] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-17T19:40:45.097553] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T19:40:45.558008] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-17T19:40:45.678202] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:40:46.358009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-17T19:40:46.646021] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T19:40:47.158015] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-17T19:40:47.365477] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T19:40:47.958001] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-17T19:40:48.129585] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:40:48.758009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-17T19:40:48.903914] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:40:49.557994] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-17T19:40:49.878426] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T19:40:50.279284] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T19:40:50.358029] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-17T19:40:51.074070] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:40:51.158005] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-17T19:40:51.906709] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T19:40:51.914637] [INFO ] [REMOTE ] JBL: Full fetch complete (70582 records). [2025-10-17T19:40:51.914898] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-17T19:40:51.963328] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-17T19:40:52.307749] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-17T19:40:52.307834] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-17T19:40:52.308863] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-17T19:40:52.308928] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-17T19:40:52.310268] [DEBUG] [LOCAL ] JBL: Trimmed 70582 records to 49045 (keeping 200 days of data) [2025-10-17T19:40:52.611139] [DEBUG] [LOCAL ] JBL: Primary data saved (49045 records). [2025-10-17T19:40:52.611275] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-17T19:40:52.611891] [INFO ] [MAIN ] Update Progress: 1146/2368 symbols completed. JBL took 50.1s. Estimated remaining: 2h 51m 29s. Rate: 7.1 symbols/min [2025-10-17T19:40:52.761500] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-17T19:40:52.794573] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:52.829092] [DEBUG] [LOCAL ] JFR: Loaded 31245 existing records from primary storage. [2025-10-17T19:40:52.829368] [INFO ] [MAIN ] JFR: Loaded 31245 existing records. [2025-10-17T19:40:53.024372] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:53.024688] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-17T19:40:53.024863] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-17T19:40:53.035017] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-17T19:40:53.052356] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-17T19:40:53.097280] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T19:40:53.440962] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:53.567760] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-17T19:40:53.589915] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:40:54.087360] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:40:54.358032] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-17T19:40:55.153273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T19:40:55.157980] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-17T19:40:55.162161] [INFO ] [REMOTE ] JCI: Full fetch complete (77631 records). [2025-10-17T19:40:55.162269] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-17T19:40:55.314329] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T19:40:55.581084] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-17T19:40:55.581170] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-17T19:40:55.582171] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-17T19:40:55.582242] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-17T19:40:55.583760] [DEBUG] [LOCAL ] JCI: Trimmed 77631 records to 54306 (keeping 200 days of data) [2025-10-17T19:40:55.918393] [DEBUG] [LOCAL ] JCI: Primary data saved (54306 records). [2025-10-17T19:40:55.918538] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-17T19:40:55.918621] [INFO ] [MAIN ] Update Progress: 1147/2368 symbols completed. JCI took 40.5s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-17T19:40:55.965248] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-17T19:40:56.098244] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:56.111120] [DEBUG] [LOCAL ] JGH: Loaded 12686 existing records from primary storage. [2025-10-17T19:40:56.111338] [INFO ] [MAIN ] JGH: Loaded 12686 existing records. [2025-10-17T19:40:56.286284] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:56.286475] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-17T19:40:56.286543] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-17T19:40:56.286913] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-17T19:40:56.286982] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-17T19:40:56.641616] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:56.757989] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-17T19:40:56.843470] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:40:57.558084] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-17T19:40:57.692626] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:40:57.753221] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T19:40:58.358082] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-17T19:40:59.119543] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T19:40:59.129258] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:40:59.157997] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-17T19:40:59.817226] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T19:40:59.958100] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-17T19:41:00.758044] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-17T19:41:01.558022] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-17T19:41:01.891360] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T19:41:02.217455] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T19:41:02.358057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-17T19:41:02.512309] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:41:03.157999] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-17T19:41:03.438047] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T19:41:03.958078] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-17T19:41:04.642066] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:41:04.758058] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-17T19:41:05.056882] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T19:41:05.229486] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:41:05.558012] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-17T19:41:06.358158] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-17T19:41:07.158037] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-17T19:41:07.410474] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:41:07.418266] [INFO ] [REMOTE ] JEF: Full fetch complete (73319 records). [2025-10-17T19:41:07.418450] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-17T19:41:07.824914] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-17T19:41:07.825087] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-17T19:41:07.826217] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-17T19:41:07.826344] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-17T19:41:07.857024] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:41:07.865553] [DEBUG] [LOCAL ] JEF: Trimmed 73319 records to 50950 (keeping 200 days of data) [2025-10-17T19:41:07.963715] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-17T19:41:08.193521] [DEBUG] [LOCAL ] JEF: Primary data saved (50950 records). [2025-10-17T19:41:08.193724] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-17T19:41:08.194338] [INFO ] [MAIN ] Update Progress: 1148/2368 symbols completed. JEF took 38.1s. Estimated remaining: 2h 51m 10s. Rate: 7.1 symbols/min [2025-10-17T19:41:08.369514] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:08.412907] [DEBUG] [LOCAL ] JHG: Loaded 47922 existing records from primary storage. [2025-10-17T19:41:08.413239] [INFO ] [MAIN ] JHG: Loaded 47922 existing records. [2025-10-17T19:41:08.609122] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:08.609475] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-17T19:41:08.609611] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-17T19:41:08.610595] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-17T19:41:08.610690] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-17T19:41:08.767445] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-17T19:41:08.878844] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T19:41:08.953234] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T19:41:09.042583] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:09.558033] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-17T19:41:10.144963] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T19:41:10.358082] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-17T19:41:11.045578] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:41:11.158098] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-17T19:41:11.923465] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:41:11.958018] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-17T19:41:12.689883] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:41:12.696032] [INFO ] [REMOTE ] JELD: Full fetch complete (64468 records). [2025-10-17T19:41:12.696143] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-17T19:41:12.763130] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-17T19:41:13.073548] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-17T19:41:13.073637] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-17T19:41:13.074571] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-17T19:41:13.074617] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-17T19:41:13.075991] [DEBUG] [LOCAL ] JELD: Trimmed 64468 records to 46697 (keeping 200 days of data) [2025-10-17T19:41:13.340104] [DEBUG] [LOCAL ] JELD: Primary data saved (46697 records). [2025-10-17T19:41:13.340239] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-17T19:41:13.340319] [INFO ] [MAIN ] Update Progress: 1149/2368 symbols completed. JELD took 37.8s. Estimated remaining: 2h 50m 59s. Rate: 7.1 symbols/min [2025-10-17T19:41:13.515088] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:13.542616] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:41:13.554286] [DEBUG] [LOCAL ] JHI: Loaded 4106 existing records from primary storage. [2025-10-17T19:41:13.555192] [INFO ] [MAIN ] JHI: Loaded 4106 existing records. [2025-10-17T19:41:13.566183] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-17T19:41:13.666978] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T19:41:13.747595] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:13.747841] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-17T19:41:13.747889] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-17T19:41:13.748107] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-17T19:41:13.748164] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-17T19:41:14.106755] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:14.358029] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-17T19:41:15.158009] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-17T19:41:15.214095] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T19:41:15.230284] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T19:41:15.958045] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-17T19:41:16.074963] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T19:41:16.758004] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-17T19:41:16.758448] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T19:41:17.558033] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-17T19:41:18.358002] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-17T19:41:18.465005] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T19:41:18.814160] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T19:41:19.158050] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-17T19:41:19.453931] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:41:19.457671] [INFO ] [REMOTE ] JGH: Full fetch complete (16365 records). [2025-10-17T19:41:19.457745] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-17T19:41:19.810072] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-17T19:41:19.810144] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-17T19:41:19.810507] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-17T19:41:19.810569] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-17T19:41:19.811144] [DEBUG] [LOCAL ] JGH: Trimmed 16365 records to 12828 (keeping 200 days of data) [2025-10-17T19:41:19.911254] [DEBUG] [LOCAL ] JGH: Primary data saved (12828 records). [2025-10-17T19:41:19.911465] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-17T19:41:19.911615] [INFO ] [MAIN ] Update Progress: 1150/2368 symbols completed. JGH took 24.0s. Estimated remaining: 2h 50m 48s. Rate: 7.1 symbols/min [2025-10-17T19:41:19.963315] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-17T19:41:20.089808] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:20.094539] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-17T19:41:20.094789] [INFO ] [MAIN ] JHS: Loaded 2944 existing records. [2025-10-17T19:41:20.269482] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:20.269777] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-17T19:41:20.269830] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-17T19:41:20.270028] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-17T19:41:20.270084] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-17T19:41:20.660075] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:20.758005] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-17T19:41:21.212393] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T19:41:21.266471] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-17T19:41:21.406751] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T19:41:21.558029] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-17T19:41:22.358029] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-17T19:41:23.158062] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-17T19:41:23.332954] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T19:41:23.663452] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:41:23.709270] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T19:41:23.958088] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-17T19:41:24.758086] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-17T19:41:25.547937] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T19:41:25.558222] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-17T19:41:25.572957] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:41:26.358134] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-17T19:41:26.897531] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T19:41:27.134150] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:41:27.158042] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-17T19:41:27.668002] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T19:41:27.958085] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-17T19:41:28.467749] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T19:41:28.758054] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-17T19:41:29.232384] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T19:41:29.558028] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-17T19:41:30.358049] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-17T19:41:30.876202] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T19:41:31.158093] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-17T19:41:31.541909] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-17T19:41:31.583434] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T19:41:31.958081] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-17T19:41:32.543140] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:41:32.758037] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-17T19:41:33.352829] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T19:41:33.558027] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-17T19:41:34.030868] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:41:34.358071] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-17T19:41:34.787735] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T19:41:35.158093] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-17T19:41:35.958027] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-17T19:41:36.432187] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T19:41:36.597381] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:41:36.602398] [INFO ] [REMOTE ] JFR: Full fetch complete (48412 records). [2025-10-17T19:41:36.602484] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-17T19:41:36.773638] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-17T19:41:36.978839] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-17T19:41:36.978902] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-17T19:41:36.979711] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-17T19:41:36.979774] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-17T19:41:36.980775] [DEBUG] [LOCAL ] JFR: Trimmed 48412 records to 31519 (keeping 200 days of data) [2025-10-17T19:41:37.157080] [DEBUG] [LOCAL ] JFR: Primary data saved (31519 records). [2025-10-17T19:41:37.157208] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-17T19:41:37.157287] [INFO ] [MAIN ] Update Progress: 1151/2368 symbols completed. JFR took 44.5s. Estimated remaining: 2h 50m 49s. Rate: 7.1 symbols/min [2025-10-17T19:41:37.328638] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:37.378736] [DEBUG] [LOCAL ] JHX: Loaded 53550 existing records from primary storage. [2025-10-17T19:41:37.379159] [INFO ] [MAIN ] JHX: Loaded 53550 existing records. [2025-10-17T19:41:37.461878] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T19:41:37.558085] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:37.558174] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-17T19:41:37.558548] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-17T19:41:37.559387] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-17T19:41:37.560384] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-17T19:41:37.560447] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-17T19:41:37.911584] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:38.176037] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:41:38.358027] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-17T19:41:38.896065] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T19:41:39.158021] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-17T19:41:39.710736] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T19:41:39.958063] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-17T19:41:40.758045] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-17T19:41:41.558049] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-17T19:41:42.038155] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:41:42.070021] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T19:41:42.358026] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-17T19:41:42.901431] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T19:41:43.070234] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:41:43.158031] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-17T19:41:43.727031] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T19:41:43.958035] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-17T19:41:44.519027] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T19:41:44.519974] [INFO ] [REMOTE ] JHS: Full fetch complete (4473 records). [2025-10-17T19:41:44.520041] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-17T19:41:44.763244] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-17T19:41:44.881219] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-17T19:41:44.881301] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-17T19:41:44.881443] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-17T19:41:44.881482] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-17T19:41:44.881880] [DEBUG] [LOCAL ] JHS: Trimmed 4473 records to 2952 (keeping 200 days of data) [2025-10-17T19:41:44.899339] [DEBUG] [LOCAL ] JHS: Primary data saved (2952 records). [2025-10-17T19:41:44.899445] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-17T19:41:44.899523] [INFO ] [MAIN ] Update Progress: 1152/2368 symbols completed. JHS took 25.0s. Estimated remaining: 2h 50m 40s. Rate: 7.1 symbols/min [2025-10-17T19:41:45.069291] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:45.085140] [DEBUG] [LOCAL ] JILL: Loaded 15989 existing records from primary storage. [2025-10-17T19:41:45.085359] [INFO ] [MAIN ] JILL: Loaded 15989 existing records. [2025-10-17T19:41:45.262145] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:45.262393] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-17T19:41:45.262441] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-17T19:41:45.262838] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-17T19:41:45.262896] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-17T19:41:45.561749] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-17T19:41:45.629299] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:45.635427] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:41:45.637341] [INFO ] [REMOTE ] JHI: Full fetch complete (5772 records). [2025-10-17T19:41:45.637435] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-17T19:41:45.992416] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-17T19:41:45.992493] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-17T19:41:45.992665] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-17T19:41:45.992726] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-17T19:41:45.993097] [DEBUG] [LOCAL ] JHI: Trimmed 5772 records to 4176 (keeping 200 days of data) [2025-10-17T19:41:46.018433] [DEBUG] [LOCAL ] JHI: Primary data saved (4176 records). [2025-10-17T19:41:46.018570] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-17T19:41:46.018677] [INFO ] [MAIN ] Update Progress: 1153/2368 symbols completed. JHI took 32.7s. Estimated remaining: 2h 50m 24s. Rate: 7.1 symbols/min [2025-10-17T19:41:46.186663] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:46.222493] [DEBUG] [LOCAL ] JKS: Loaded 39945 existing records from primary storage. [2025-10-17T19:41:46.222805] [INFO ] [MAIN ] JKS: Loaded 39945 existing records. [2025-10-17T19:41:46.363205] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-17T19:41:46.402842] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:46.403044] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-17T19:41:46.403091] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-17T19:41:46.403786] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-17T19:41:46.403844] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-17T19:41:46.754209] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:47.158062] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-17T19:41:47.370091] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:41:47.376843] [INFO ] [REMOTE ] JHG: Full fetch complete (68579 records). [2025-10-17T19:41:47.377001] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-17T19:41:47.777820] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-17T19:41:47.777630] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:41:47.778021] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-17T19:41:47.783494] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-17T19:41:47.783564] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-17T19:41:47.785008] [DEBUG] [LOCAL ] JHG: Trimmed 68579 records to 48298 (keeping 200 days of data) [2025-10-17T19:41:47.961997] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-17T19:41:48.081282] [DEBUG] [LOCAL ] JHG: Primary data saved (48298 records). [2025-10-17T19:41:48.081420] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-17T19:41:48.081954] [INFO ] [MAIN ] Update Progress: 1154/2368 symbols completed. JHG took 39.9s. Estimated remaining: 2h 50m 9s. Rate: 7.1 symbols/min [2025-10-17T19:41:48.191854] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T19:41:48.264455] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:48.294513] [DEBUG] [LOCAL ] JLL: Loaded 31952 existing records from primary storage. [2025-10-17T19:41:48.294834] [INFO ] [MAIN ] JLL: Loaded 31952 existing records. [2025-10-17T19:41:48.465105] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:48.465320] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-17T19:41:48.465369] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-17T19:41:48.466071] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-17T19:41:48.466131] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-17T19:41:48.763261] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-17T19:41:48.819762] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:48.829180] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T19:41:49.558049] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-17T19:41:49.687401] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T19:41:50.358134] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-17T19:41:51.158066] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-17T19:41:51.192239] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T19:41:51.254522] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T19:41:51.958095] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-17T19:41:52.318407] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T19:41:52.758051] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-17T19:41:53.558069] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-17T19:41:53.691678] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:41:54.358047] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-17T19:41:54.412210] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T19:41:54.784002] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T19:41:55.158078] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-17T19:41:55.942060] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:41:55.957986] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-17T19:41:56.541890] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T19:41:56.758040] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-17T19:41:57.558004] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-17T19:41:57.691467] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:41:58.058568] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T19:41:58.358062] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-17T19:41:58.781927] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T19:41:59.155138] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T19:41:59.158068] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-17T19:41:59.958059] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-17T19:42:00.758148] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-17T19:42:01.563669] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-17T19:42:01.581512] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T19:42:02.119563] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T19:42:02.206576] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T19:42:02.358024] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-17T19:42:03.157998] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-17T19:42:03.556286] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:42:03.958044] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-17T19:42:04.488118] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T19:42:04.758028] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-17T19:42:05.161607] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T19:42:05.381328] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:42:05.558012] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-17T19:42:05.884732] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T19:42:06.358066] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-17T19:42:07.158001] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-17T19:42:07.180556] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T19:42:07.958033] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-17T19:42:08.319028] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T19:42:08.541064] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T19:42:08.757999] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-17T19:42:08.874371] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T19:42:09.558000] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-17T19:42:09.751619] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T19:42:10.358031] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-17T19:42:11.158020] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-17T19:42:11.498184] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:42:11.601790] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T19:42:11.609279] [INFO ] [REMOTE ] JHX: Full fetch complete (61683 records). [2025-10-17T19:42:11.609428] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-17T19:42:11.963829] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-17T19:42:12.009587] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-17T19:42:12.009699] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-17T19:42:12.010629] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-17T19:42:12.010716] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-17T19:42:12.012162] [DEBUG] [LOCAL ] JHX: Trimmed 61683 records to 53939 (keeping 200 days of data) [2025-10-17T19:42:12.332782] [DEBUG] [LOCAL ] JHX: Primary data saved (53939 records). [2025-10-17T19:42:12.332940] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-17T19:42:12.333744] [INFO ] [MAIN ] Update Progress: 1155/2368 symbols completed. JHX took 35.2s. Estimated remaining: 2h 50m 17s. Rate: 7.1 symbols/min [2025-10-17T19:42:12.502179] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:12.509251] [DEBUG] [LOCAL ] JLS: Loaded 4239 existing records from primary storage. [2025-10-17T19:42:12.509790] [INFO ] [MAIN ] JLS: Loaded 4239 existing records. [2025-10-17T19:42:12.698579] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:12.714555] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-17T19:42:12.714683] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-17T19:42:12.716689] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:42:12.716756] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-17T19:42:12.716972] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-17T19:42:12.766285] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-17T19:42:13.073125] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:13.558033] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-17T19:42:13.587052] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T19:42:13.677852] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T19:42:14.358028] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-17T19:42:14.906254] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:42:15.158083] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-17T19:42:15.898926] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:42:15.958104] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-17T19:42:16.113618] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T19:42:16.758075] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-17T19:42:17.344181] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:42:17.348225] [INFO ] [REMOTE ] JLL: Full fetch complete (45122 records). [2025-10-17T19:42:17.348350] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-17T19:42:17.566125] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-17T19:42:17.761918] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-17T19:42:17.762017] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-17T19:42:17.762966] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-17T19:42:17.763031] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-17T19:42:17.764272] [DEBUG] [LOCAL ] JLL: Trimmed 45122 records to 32147 (keeping 200 days of data) [2025-10-17T19:42:17.869583] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:42:17.988599] [DEBUG] [LOCAL ] JLL: Primary data saved (32147 records). [2025-10-17T19:42:17.988837] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-17T19:42:17.988974] [INFO ] [MAIN ] Update Progress: 1156/2368 symbols completed. JLL took 29.9s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-17T19:42:18.168596] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:18.219480] [DEBUG] [LOCAL ] JMIA: Loaded 51442 existing records from primary storage. [2025-10-17T19:42:18.225460] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T19:42:18.225946] [INFO ] [MAIN ] JMIA: Loaded 51442 existing records. [2025-10-17T19:42:18.363254] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-17T19:42:18.405169] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:18.405525] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-17T19:42:18.405576] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-17T19:42:18.406460] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-17T19:42:18.406520] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-17T19:42:18.773862] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:19.158069] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-17T19:42:19.813799] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T19:42:19.911269] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:42:19.957992] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-17T19:42:20.758119] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-17T19:42:21.395683] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T19:42:21.470147] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:42:21.558001] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-17T19:42:22.358037] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-17T19:42:22.858060] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T19:42:23.158026] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-17T19:42:23.312747] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T19:42:23.318623] [INFO ] [REMOTE ] JKS: Full fetch complete (58833 records). [2025-10-17T19:42:23.318815] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-17T19:42:23.715741] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-17T19:42:23.715883] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-17T19:42:23.716930] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-17T19:42:23.717005] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-17T19:42:23.718364] [DEBUG] [LOCAL ] JKS: Trimmed 58833 records to 40154 (keeping 200 days of data) [2025-10-17T19:42:23.962881] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-17T19:42:23.962798] [DEBUG] [LOCAL ] JKS: Primary data saved (40154 records). [2025-10-17T19:42:23.964052] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-17T19:42:23.964139] [INFO ] [MAIN ] Update Progress: 1157/2368 symbols completed. JKS took 37.9s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-17T19:42:24.173874] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:42:24.176151] [INFO ] [REMOTE ] JILL: Full fetch complete (22480 records). [2025-10-17T19:42:24.176256] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-17T19:42:24.563120] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-17T19:42:24.567958] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-17T19:42:24.569159] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-17T19:42:24.569277] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-17T19:42:24.568606] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:42:24.572347] [DEBUG] [LOCAL ] JILL: Trimmed 22480 records to 16049 (keeping 200 days of data) [2025-10-17T19:42:24.672624] [DEBUG] [LOCAL ] JILL: Primary data saved (16049 records). [2025-10-17T19:42:24.672791] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-17T19:42:24.672922] [INFO ] [MAIN ] Update Progress: 1158/2368 symbols completed. JILL took 39.8s. Estimated remaining: 2h 49m 38s. Rate: 7.1 symbols/min [2025-10-17T19:42:24.758043] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-17T19:42:25.558025] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-17T19:42:26.151953] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T19:42:26.358045] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-17T19:42:26.498099] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:42:26.694579] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T19:42:27.158002] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-17T19:42:27.958074] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-17T19:42:28.552157] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T19:42:28.757971] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-17T19:42:28.944002] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:42:29.066302] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T19:42:29.558058] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-17T19:42:30.135825] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T19:42:30.357996] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-17T19:42:31.036002] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T19:42:31.037127] [INFO ] [REMOTE ] JLS: Full fetch complete (5842 records). [2025-10-17T19:42:31.037219] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-17T19:42:31.163137] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-17T19:42:31.402214] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-17T19:42:31.402290] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-17T19:42:31.402454] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-17T19:42:31.402512] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-17T19:42:31.402918] [DEBUG] [LOCAL ] JLS: Trimmed 5842 records to 4259 (keeping 200 days of data) [2025-10-17T19:42:31.428194] [DEBUG] [LOCAL ] JLS: Primary data saved (4259 records). [2025-10-17T19:42:31.428267] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-17T19:42:31.428450] [INFO ] [MAIN ] Update Progress: 1159/2368 symbols completed. JLS took 19.1s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-17T19:42:33.099510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:42:33.109298] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-17T19:42:34.970482] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:42:34.980510] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-17T19:42:36.703123] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:42:36.713784] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-17T19:42:38.435773] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T19:42:38.446345] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-17T19:42:40.176556] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:42:40.190428] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-17T19:42:41.911139] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:42:41.922441] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-17T19:42:43.891356] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T19:42:43.902477] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-17T19:42:49.415630] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (5.51 seconds). [2025-10-17T19:42:49.426889] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-17T19:42:51.626128] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T19:42:51.633349] [INFO ] [REMOTE ] JMIA: Full fetch complete (73456 records). [2025-10-17T19:42:51.633486] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-17T19:42:52.022672] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-17T19:42:52.022766] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-17T19:42:52.023745] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-17T19:42:52.023810] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-17T19:42:52.025173] [DEBUG] [LOCAL ] JMIA: Trimmed 73456 records to 51831 (keeping 200 days of data) [2025-10-17T19:42:52.319927] [DEBUG] [LOCAL ] JMIA: Primary data saved (51831 records). [2025-10-17T19:42:52.320066] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-17T19:42:52.320735] [INFO ] [MAIN ] Update Progress: 1160/2368 symbols completed. JMIA took 34.3s. Estimated remaining: 2h 49m 33s. Rate: 7.1 symbols/min [2025-10-17T19:42:53.003437] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.033232] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.009718] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.044275] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-17T19:42:53.058951] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-17T19:42:53.060071] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-17T19:42:53.060410] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-17T19:42:53.091369] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-17T19:42:53.095174] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.095582] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-17T19:42:53.227567] [DEBUG] [LOCAL ] JOE: Loaded 24021 existing records from primary storage. [2025-10-17T19:42:53.258447] [INFO ] [MAIN ] JOE: Loaded 24021 existing records. [2025-10-17T19:42:53.573151] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-17T19:42:53.626419] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-10-17T19:42:53.668621] [DEBUG] [LOCAL ] JOBY: Loaded 54198 existing records from primary storage. [2025-10-17T19:42:53.699166] [INFO ] [MAIN ] JOBY: Loaded 54198 existing records. [2025-10-17T19:42:53.734143] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:53.792299] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-17T19:42:53.844491] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:53.859821] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-17T19:42:53.854296] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-17T19:42:53.905600] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-17T19:42:53.911216] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-17T19:42:54.223819] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:54.257449] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-17T19:42:54.257555] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-17T19:42:54.257048] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:54.266043] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-17T19:42:54.266141] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-17T19:42:54.272754] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-17T19:42:54.273083] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-17T19:42:54.278403] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-17T19:42:54.285459] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-17T19:42:54.608162] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T19:42:54.614434] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-17T19:42:55.145761] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T19:42:55.135223] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:55.163020] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-17T19:42:55.174747] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-17T19:42:55.370212] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:55.382628] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-17T19:42:55.393574] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:55.395004] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-17T19:42:55.645746] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:42:55.647208] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-17T19:42:55.982596] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-17T19:42:55.983554] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-17T19:42:56.467082] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T19:42:56.472853] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-17T19:42:56.519559] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T19:42:56.520726] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-17T19:42:57.027298] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-17T19:42:57.028698] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-17T19:42:57.501015] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T19:42:57.502298] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-17T19:42:57.686222] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T19:42:57.693451] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-17T19:42:57.782263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-17T19:42:57.793919] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-17T19:42:58.019311] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-17T19:42:58.031409] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-17T19:42:58.043417] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-17T19:42:58.044932] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-17T19:42:58.484955] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:42:58.486168] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-17T19:42:58.733774] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:42:58.739297] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-17T19:42:58.958312] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-17T19:42:58.959509] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-17T19:42:59.411794] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T19:42:59.412587] [INFO ] [REMOTE ] JMM: Full fetch complete (2295 records). [2025-10-17T19:42:59.412696] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-17T19:42:59.626324] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-17T19:42:59.626518] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:42:59.626563] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:42:59.626602] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-17T19:42:59.626684] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-17T19:42:59.626738] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-17T19:42:59.626781] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-17T19:42:59.626837] [INFO ] [MAIN ] Update Progress: 1161/2368 symbols completed. JMM took 7.3s. Estimated remaining: 2h 49m 23s. Rate: 7.1 symbols/min [2025-10-17T19:42:59.800605] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:59.808598] [DEBUG] [LOCAL ] JOF: Loaded 6944 existing records from primary storage. [2025-10-17T19:42:59.808801] [INFO ] [MAIN ] JOF: Loaded 6944 existing records. [2025-10-17T19:42:59.991764] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:59.992241] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-17T19:42:59.992626] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-17T19:42:59.993268] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-17T19:42:59.993472] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-17T19:43:00.087887] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:43:00.122414] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-17T19:43:00.248908] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T19:43:00.349124] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-17T19:43:00.466976] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:00.467604] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-17T19:43:00.657369] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-17T19:43:00.667969] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-17T19:43:02.066697] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:43:02.073417] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-17T19:43:02.207784] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:43:02.210210] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-17T19:43:02.601890] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-17T19:43:02.612793] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-17T19:43:02.802816] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T19:43:02.804906] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-17T19:43:03.215420] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-17T19:43:03.225918] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-17T19:43:03.282910] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:43:03.288508] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-17T19:43:03.348858] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-17T19:43:03.350571] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-17T19:43:04.221172] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T19:43:04.223943] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-17T19:43:04.554547] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T19:43:04.560051] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-17T19:43:04.665734] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T19:43:04.677124] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-17T19:43:05.069797] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T19:43:05.072914] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-17T19:43:05.385341] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T19:43:05.456009] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T19:43:05.558001] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-17T19:43:05.701584] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T19:43:06.358002] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-17T19:43:06.761286] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T19:43:06.975950] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:43:07.158000] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-17T19:43:07.197626] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:43:07.815632] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T19:43:07.958081] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-17T19:43:08.758103] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-17T19:43:09.046958] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T19:43:09.558083] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-17T19:43:10.358066] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-17T19:43:10.602807] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:43:10.606092] [INFO ] [REMOTE ] JOE: Full fetch complete (35653 records). [2025-10-17T19:43:10.606231] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-17T19:43:10.966026] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-17T19:43:10.966114] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-17T19:43:10.966837] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-17T19:43:10.966898] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-17T19:43:10.967750] [DEBUG] [LOCAL ] JOE: Trimmed 35653 records to 24168 (keeping 200 days of data) [2025-10-17T19:43:11.116823] [DEBUG] [LOCAL ] JOE: Primary data saved (24168 records). [2025-10-17T19:43:11.117072] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-17T19:43:11.117363] [INFO ] [MAIN ] Update Progress: 1162/2368 symbols completed. JOE took 18.8s. Estimated remaining: 2h 49m 18s. Rate: 7.1 symbols/min [2025-10-17T19:43:11.185703] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-17T19:43:11.212766] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T19:43:11.303213] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:11.334198] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-17T19:43:11.375247] [DEBUG] [LOCAL ] JPC: Loaded 37494 existing records from primary storage. [2025-10-17T19:43:11.375532] [INFO ] [MAIN ] JPC: Loaded 37494 existing records. [2025-10-17T19:43:11.548386] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:11.548631] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-17T19:43:11.548714] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-17T19:43:11.549427] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-17T19:43:11.549497] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-17T19:43:11.893104] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:11.957996] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-17T19:43:12.758034] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-17T19:43:13.469999] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:43:13.557999] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-17T19:43:13.591092] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-17T19:43:14.358023] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-17T19:43:15.023128] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:43:15.158055] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-17T19:43:15.233765] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-17T19:43:15.958131] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-17T19:43:16.490741] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-17T19:43:16.633102] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:43:16.675025] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T19:43:16.758060] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-17T19:43:17.558062] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-17T19:43:18.173519] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:43:18.358047] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-17T19:43:19.158071] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-17T19:43:19.857832] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:43:19.960872] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-17T19:43:19.965624] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-17T19:43:20.758113] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-17T19:43:20.774692] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T19:43:20.777477] [INFO ] [REMOTE ] JOF: Full fetch complete (9416 records). [2025-10-17T19:43:20.777581] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-17T19:43:21.162952] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-17T19:43:21.163062] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-17T19:43:21.163308] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-17T19:43:21.163371] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-17T19:43:21.163968] [DEBUG] [LOCAL ] JOF: Trimmed 9416 records to 6969 (keeping 200 days of data) [2025-10-17T19:43:21.207133] [DEBUG] [LOCAL ] JOF: Primary data saved (6969 records). [2025-10-17T19:43:21.207278] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-17T19:43:21.207414] [INFO ] [MAIN ] Update Progress: 1163/2368 symbols completed. JOF took 21.6s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-17T19:43:21.382720] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:21.434896] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-17T19:43:21.435261] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-10-17T19:43:21.560077] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-17T19:43:21.646663] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-17T19:43:21.663815] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:21.676050] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-17T19:43:21.676609] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-17T19:43:21.677910] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-17T19:43:21.677994] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-17T19:43:22.033981] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:22.242108] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:43:22.358045] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-17T19:43:23.158046] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-17T19:43:23.771763] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T19:43:23.958015] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-17T19:43:24.335327] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-17T19:43:24.758039] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-17T19:43:25.021730] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:43:25.067117] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T19:43:25.558033] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-17T19:43:26.358071] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-17T19:43:26.801757] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T19:43:27.011227] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:43:27.157997] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-17T19:43:27.958038] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-17T19:43:28.758013] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-17T19:43:29.155549] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-17T19:43:29.340955] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T19:43:29.453945] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-17T19:43:29.558042] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-17T19:43:30.358042] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-17T19:43:31.074505] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-17T19:43:31.158007] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-17T19:43:31.546298] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T19:43:31.554220] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-17T19:43:31.554394] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-17T19:43:31.949319] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-17T19:43:31.949411] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-17T19:43:31.950546] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-17T19:43:31.950612] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-17T19:43:31.952225] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54533 (keeping 200 days of data) [2025-10-17T19:43:32.007505] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-17T19:43:32.289117] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-17T19:43:32.289260] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-17T19:43:32.290400] [INFO ] [MAIN ] Update Progress: 1164/2368 symbols completed. JNJ took 40.0s. Estimated remaining: 2h 49m 5s. Rate: 7.1 symbols/min [2025-10-17T19:43:32.453400] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:32.485736] [DEBUG] [LOCAL ] JQC: Loaded 33945 existing records from primary storage. [2025-10-17T19:43:32.486011] [INFO ] [MAIN ] JQC: Loaded 33945 existing records. [2025-10-17T19:43:32.662756] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:32.662982] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-17T19:43:32.663033] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-17T19:43:32.663634] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-17T19:43:32.663721] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-17T19:43:33.026486] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:33.026825] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-17T19:43:33.113708] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-17T19:43:33.184126] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-17T19:43:33.433689] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:43:33.439188] [INFO ] [REMOTE ] JPC: Full fetch complete (55191 records). [2025-10-17T19:43:33.439298] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-17T19:43:33.563128] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-17T19:43:33.820822] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-17T19:43:33.820904] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-17T19:43:33.821772] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-17T19:43:33.821835] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-17T19:43:33.822965] [DEBUG] [LOCAL ] JPC: Trimmed 55191 records to 37747 (keeping 200 days of data) [2025-10-17T19:43:34.035304] [DEBUG] [LOCAL ] JPC: Primary data saved (37747 records). [2025-10-17T19:43:34.035439] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-17T19:43:34.035993] [INFO ] [MAIN ] Update Progress: 1165/2368 symbols completed. JPC took 22.9s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-17T19:43:34.200332] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:34.217161] [DEBUG] [LOCAL ] JRI: Loaded 15503 existing records from primary storage. [2025-10-17T19:43:34.217420] [INFO ] [MAIN ] JRI: Loaded 15503 existing records. [2025-10-17T19:43:34.366698] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-17T19:43:34.397251] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:34.397459] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-17T19:43:34.397506] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-17T19:43:34.397989] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-17T19:43:34.398047] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-17T19:43:34.561433] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:43:34.765964] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:35.158031] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-17T19:43:35.958046] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-17T19:43:36.472361] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-17T19:43:36.481451] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-17T19:43:36.481733] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-17T19:43:36.615158] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T19:43:36.788577] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-17T19:43:36.908031] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-17T19:43:36.966924] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-17T19:43:36.967359] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-17T19:43:36.968406] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-17T19:43:36.968616] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-17T19:43:36.970153] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54588 (keeping 200 days of data) [2025-10-17T19:43:37.185986] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T19:43:37.308171] [DEBUG] [LOCAL ] JOBY: Primary data saved (54588 records). [2025-10-17T19:43:37.308315] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-17T19:43:37.308422] [INFO ] [MAIN ] Update Progress: 1166/2368 symbols completed. JOBY took 45.0s. Estimated remaining: 2h 48m 36s. Rate: 7.1 symbols/min [2025-10-17T19:43:37.471330] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:37.482432] [DEBUG] [LOCAL ] JRS: Loaded 11746 existing records from primary storage. [2025-10-17T19:43:37.482620] [INFO ] [MAIN ] JRS: Loaded 11746 existing records. [2025-10-17T19:43:37.563281] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-17T19:43:37.658887] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:37.659099] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-17T19:43:37.659158] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-17T19:43:37.659473] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-17T19:43:37.659530] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-17T19:43:38.011052] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:38.106848] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:43:38.358012] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-17T19:43:39.158018] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-17T19:43:39.523278] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T19:43:39.958006] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-17T19:43:40.117077] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-17T19:43:40.576608] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:43:40.758031] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-17T19:43:41.402525] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T19:43:41.411431] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T19:43:41.558068] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-17T19:43:42.358038] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-17T19:43:43.097488] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T19:43:43.158045] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-17T19:43:43.814749] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T19:43:43.958028] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-17T19:43:43.980486] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T19:43:44.758059] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-17T19:43:45.533039] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T19:43:45.558039] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-17T19:43:46.342590] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-17T19:43:46.357988] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-17T19:43:46.375669] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T19:43:47.158030] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-17T19:43:47.947930] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T19:43:47.957989] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-17T19:43:48.364923] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T19:43:48.758021] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-17T19:43:48.772828] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T19:43:49.558067] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-17T19:43:50.327502] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:43:50.357999] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-17T19:43:50.534724] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T19:43:51.158006] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-17T19:43:51.181350] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:43:51.958083] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-17T19:43:52.758135] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-17T19:43:53.202194] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T19:43:53.558066] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-17T19:43:53.776303] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-17T19:43:53.818840] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T19:43:54.358005] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-17T19:43:54.506712] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:43:54.513951] [INFO ] [REMOTE ] JRS: Full fetch complete (16256 records). [2025-10-17T19:43:54.514251] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-17T19:43:54.899576] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-17T19:43:54.899739] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-17T19:43:54.900366] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-17T19:43:54.900417] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-17T19:43:54.901582] [DEBUG] [LOCAL ] JRS: Trimmed 16256 records to 11802 (keeping 200 days of data) [2025-10-17T19:43:54.976448] [DEBUG] [LOCAL ] JRS: Primary data saved (11802 records). [2025-10-17T19:43:54.976679] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-17T19:43:54.976810] [INFO ] [MAIN ] Update Progress: 1167/2368 symbols completed. JRS took 17.7s. Estimated remaining: 2h 48m 37s. Rate: 7.1 symbols/min [2025-10-17T19:43:55.151035] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:55.158070] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-17T19:43:55.197000] [DEBUG] [LOCAL ] JXN: Loaded 45020 existing records from primary storage. [2025-10-17T19:43:55.197461] [INFO ] [MAIN ] JXN: Loaded 45020 existing records. [2025-10-17T19:43:55.382724] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:55.383028] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-17T19:43:55.383081] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-17T19:43:55.384101] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-17T19:43:55.384164] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-17T19:43:55.755872] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:55.958055] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-17T19:43:56.563605] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T19:43:56.724606] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-17T19:43:56.757983] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-17T19:43:56.944561] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:43:57.558024] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-17T19:43:58.358024] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-17T19:43:58.861502] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:43:59.158043] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-17T19:43:59.189770] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-17T19:43:59.791067] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T19:43:59.933417] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:43:59.958023] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-17T19:44:00.758115] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-17T19:44:01.558049] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-17T19:44:01.733372] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T19:44:02.358043] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-17T19:44:02.548277] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T19:44:03.158031] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-17T19:44:03.413155] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T19:44:03.894721] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (3.14 seconds). [2025-10-17T19:44:03.903065] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-17T19:44:03.903295] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-17T19:44:03.969129] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-17T19:44:04.133383] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T19:44:04.429453] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-17T19:44:04.429568] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-17T19:44:04.431157] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-17T19:44:04.431228] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-17T19:44:04.433337] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54574 (keeping 200 days of data) [2025-10-17T19:44:04.775924] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-17T19:44:04.808918] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-17T19:44:04.809133] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-17T19:44:04.810197] [INFO ] [MAIN ] Update Progress: 1168/2368 symbols completed. JPM took 43.6s. Estimated remaining: 2h 48m 31s. Rate: 7.1 symbols/min [2025-10-17T19:44:04.987471] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:05.050782] [DEBUG] [LOCAL ] K: Loaded 50804 existing records from primary storage. [2025-10-17T19:44:05.051237] [INFO ] [MAIN ] K: Loaded 50804 existing records. [2025-10-17T19:44:05.236784] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:05.237103] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-17T19:44:05.237157] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-17T19:44:05.238332] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-17T19:44:05.238394] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-17T19:44:05.585037] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-17T19:44:05.614186] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:05.644243] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:44:06.245774] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T19:44:06.254701] [INFO ] [REMOTE ] JQC: Full fetch complete (49816 records). [2025-10-17T19:44:06.254883] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-17T19:44:06.366000] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-17T19:44:06.682095] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-17T19:44:06.682210] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-17T19:44:06.683379] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-17T19:44:06.683455] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-17T19:44:06.684937] [DEBUG] [LOCAL ] JQC: Trimmed 49816 records to 34272 (keeping 200 days of data) [2025-10-17T19:44:06.803498] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T19:44:06.928137] [DEBUG] [LOCAL ] JQC: Primary data saved (34272 records). [2025-10-17T19:44:06.928290] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-17T19:44:06.928376] [INFO ] [MAIN ] Update Progress: 1169/2368 symbols completed. JQC took 34.6s. Estimated remaining: 2h 48m 16s. Rate: 7.1 symbols/min [2025-10-17T19:44:07.109455] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:07.123794] [DEBUG] [LOCAL ] KAI: Loaded 13688 existing records from primary storage. [2025-10-17T19:44:07.124041] [INFO ] [MAIN ] KAI: Loaded 13688 existing records. [2025-10-17T19:44:07.167557] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-17T19:44:07.308521] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:07.308780] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-17T19:44:07.308842] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-17T19:44:07.309243] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-17T19:44:07.309300] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-17T19:44:07.658163] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:07.958015] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-17T19:44:08.096206] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T19:44:08.117098] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:44:08.758040] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-17T19:44:09.558026] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-17T19:44:09.634253] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:44:09.799233] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T19:44:10.358088] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-17T19:44:11.158071] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-17T19:44:11.214235] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T19:44:11.252430] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T19:44:11.255500] [INFO ] [REMOTE ] JRI: Full fetch complete (23151 records). [2025-10-17T19:44:11.255592] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-17T19:44:11.630824] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-17T19:44:11.630904] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-17T19:44:11.631386] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-17T19:44:11.631426] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-17T19:44:11.632131] [DEBUG] [LOCAL ] JRI: Trimmed 23151 records to 15593 (keeping 200 days of data) [2025-10-17T19:44:11.727947] [DEBUG] [LOCAL ] JRI: Primary data saved (15593 records). [2025-10-17T19:44:11.728083] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-17T19:44:11.728164] [INFO ] [MAIN ] Update Progress: 1170/2368 symbols completed. JRI took 37.7s. Estimated remaining: 2h 48m 3s. Rate: 7.1 symbols/min [2025-10-17T19:44:11.896724] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:11.933151] [DEBUG] [LOCAL ] KAR: Loaded 40339 existing records from primary storage. [2025-10-17T19:44:11.933445] [INFO ] [MAIN ] KAR: Loaded 40339 existing records. [2025-10-17T19:44:11.963310] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-17T19:44:12.109393] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:12.109631] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-17T19:44:12.109714] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-17T19:44:12.110430] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-17T19:44:12.110488] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-17T19:44:12.487634] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:12.758047] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-17T19:44:12.869943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T19:44:13.558073] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-17T19:44:13.656627] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T19:44:13.900564] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:44:14.358045] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-17T19:44:14.952483] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T19:44:15.158049] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-17T19:44:15.958021] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-17T19:44:15.995786] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:44:16.534144] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T19:44:16.758028] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-17T19:44:17.558024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-17T19:44:17.627274] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:44:18.331538] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:44:18.357985] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-17T19:44:18.412601] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T19:44:19.158076] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-17T19:44:19.351999] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T19:44:19.958038] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-17T19:44:20.584280] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:44:20.758054] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-17T19:44:21.436090] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:44:21.558053] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-17T19:44:22.358011] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-17T19:44:22.512672] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:44:23.136833] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T19:44:23.158107] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-17T19:44:23.367932] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:44:23.958065] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-17T19:44:24.758084] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-17T19:44:24.842774] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:44:25.467507] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:44:25.558002] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-17T19:44:26.277149] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T19:44:26.358064] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-17T19:44:27.050965] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T19:44:27.158062] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-17T19:44:27.958008] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-17T19:44:28.020063] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T19:44:28.619344] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T19:44:28.757992] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-17T19:44:29.016975] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T19:44:29.558032] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-17T19:44:30.080766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T19:44:30.358027] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-17T19:44:31.158063] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-17T19:44:31.307840] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T19:44:31.313731] [INFO ] [REMOTE ] JXN: Full fetch complete (65629 records). [2025-10-17T19:44:31.313916] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-17T19:44:31.714063] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-17T19:44:31.714178] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-17T19:44:31.715342] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-17T19:44:31.715455] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-17T19:44:31.716832] [DEBUG] [LOCAL ] JXN: Trimmed 65629 records to 45301 (keeping 200 days of data) [2025-10-17T19:44:31.962382] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-17T19:44:31.965000] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:44:32.046482] [DEBUG] [LOCAL ] JXN: Primary data saved (45301 records). [2025-10-17T19:44:32.046691] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-17T19:44:32.047421] [INFO ] [MAIN ] Update Progress: 1171/2368 symbols completed. JXN took 37.1s. Estimated remaining: 2h 48m 7s. Rate: 7.1 symbols/min [2025-10-17T19:44:32.234743] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:32.233070] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:44:32.261108] [DEBUG] [LOCAL ] KB: Loaded 23518 existing records from primary storage. [2025-10-17T19:44:32.261360] [INFO ] [MAIN ] KB: Loaded 23518 existing records. [2025-10-17T19:44:32.437242] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:32.437517] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-17T19:44:32.437585] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-17T19:44:32.438082] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-17T19:44:32.438140] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-17T19:44:32.760469] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-17T19:44:32.796735] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:33.527266] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T19:44:33.558001] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-17T19:44:34.358062] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-17T19:44:34.453056] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:44:34.797042] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T19:44:35.158042] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-17T19:44:35.790838] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:44:35.958007] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-17T19:44:36.349123] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T19:44:36.758042] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-17T19:44:37.462173] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T19:44:37.558045] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-17T19:44:37.833142] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T19:44:38.358054] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-17T19:44:39.158058] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-17T19:44:39.271408] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T19:44:39.774065] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T19:44:39.779519] [INFO ] [REMOTE ] KAR: Full fetch complete (56988 records). [2025-10-17T19:44:39.779609] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-17T19:44:39.968338] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-17T19:44:40.161353] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-17T19:44:40.161428] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-17T19:44:40.162355] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-17T19:44:40.162417] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-17T19:44:40.163497] [DEBUG] [LOCAL ] KAR: Trimmed 56988 records to 40601 (keeping 200 days of data) [2025-10-17T19:44:40.400468] [DEBUG] [LOCAL ] KAR: Primary data saved (40601 records). [2025-10-17T19:44:40.400604] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-17T19:44:40.401304] [INFO ] [MAIN ] Update Progress: 1172/2368 symbols completed. KAR took 28.7s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-17T19:44:40.538180] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T19:44:40.606226] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:40.628499] [DEBUG] [LOCAL ] KBDC: Loaded 22431 existing records from primary storage. [2025-10-17T19:44:40.628789] [INFO ] [MAIN ] KBDC: Loaded 22431 existing records. [2025-10-17T19:44:40.763291] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-17T19:44:40.801986] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:40.802155] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-17T19:44:40.802200] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-17T19:44:40.802672] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-17T19:44:40.802730] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-17T19:44:41.144496] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:41.558029] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-17T19:44:41.911548] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T19:44:41.919959] [INFO ] [REMOTE ] K: Full fetch complete (72339 records). [2025-10-17T19:44:41.920286] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-17T19:44:42.040292] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T19:44:42.330895] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-17T19:44:42.330972] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-17T19:44:42.331933] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-17T19:44:42.331995] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-17T19:44:42.333332] [DEBUG] [LOCAL ] K: Trimmed 72339 records to 51154 (keeping 200 days of data) [2025-10-17T19:44:42.390501] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-17T19:44:42.598835] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T19:44:42.668947] [DEBUG] [LOCAL ] K: Primary data saved (51154 records). [2025-10-17T19:44:42.669074] [INFO ] [MAIN ] K: Full history saved. [2025-10-17T19:44:42.669153] [INFO ] [MAIN ] Update Progress: 1173/2368 symbols completed. K took 37.9s. Estimated remaining: 2h 47m 44s. Rate: 7.1 symbols/min [2025-10-17T19:44:42.832987] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:42.873412] [DEBUG] [LOCAL ] KBH: Loaded 49212 existing records from primary storage. [2025-10-17T19:44:42.873731] [INFO ] [MAIN ] KBH: Loaded 49212 existing records. [2025-10-17T19:44:43.045839] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:43.045989] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-17T19:44:43.046036] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-17T19:44:43.046902] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-17T19:44:43.046960] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-17T19:44:43.162543] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-17T19:44:43.397252] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:43.565408] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T19:44:43.958003] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-17T19:44:44.202986] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T19:44:44.757999] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-17T19:44:45.074093] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T19:44:45.558033] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-17T19:44:45.759928] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T19:44:46.228758] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T19:44:46.358019] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-17T19:44:47.158054] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-17T19:44:47.272446] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T19:44:47.958050] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-17T19:44:48.758073] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-17T19:44:49.068424] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:44:49.119624] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T19:44:49.558004] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-17T19:44:49.589308] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T19:44:50.358024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-17T19:44:51.157999] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-17T19:44:51.238704] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T19:44:51.343425] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:44:51.958009] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-17T19:44:52.254218] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T19:44:52.757996] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-17T19:44:52.987438] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T19:44:52.990028] [INFO ] [REMOTE ] KAI: Full fetch complete (19233 records). [2025-10-17T19:44:52.990103] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-17T19:44:53.360548] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-17T19:44:53.360626] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-17T19:44:53.361106] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-17T19:44:53.361159] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-17T19:44:53.361772] [DEBUG] [LOCAL ] KAI: Trimmed 19233 records to 13783 (keeping 200 days of data) [2025-10-17T19:44:53.447497] [DEBUG] [LOCAL ] KAI: Primary data saved (13783 records). [2025-10-17T19:44:53.447637] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-17T19:44:53.447764] [INFO ] [MAIN ] Update Progress: 1174/2368 symbols completed. KAI took 46.5s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-17T19:44:53.563104] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-17T19:44:53.620270] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:53.662742] [DEBUG] [LOCAL ] KBR: Loaded 48409 existing records from primary storage. [2025-10-17T19:44:53.663106] [INFO ] [MAIN ] KBR: Loaded 48409 existing records. [2025-10-17T19:44:53.843275] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:53.843503] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-17T19:44:53.843551] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-17T19:44:53.844495] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-17T19:44:53.844555] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-17T19:44:54.237992] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:54.358020] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-17T19:44:54.405628] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T19:44:54.594085] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T19:44:55.158122] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-17T19:44:55.379762] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T19:44:55.958098] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-17T19:44:56.758067] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-17T19:44:56.837829] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:44:57.045957] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T19:44:57.558013] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-17T19:44:57.662575] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T19:44:58.358006] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-17T19:44:59.163313] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-17T19:44:59.182177] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:44:59.418787] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:44:59.958085] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-17T19:45:00.758044] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-17T19:45:01.477635] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T19:45:01.558039] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-17T19:45:01.811534] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-17T19:45:02.358049] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-17T19:45:02.704390] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T19:45:03.158086] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-17T19:45:03.482962] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:45:03.958074] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-17T19:45:04.758144] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-17T19:45:04.835021] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-17T19:45:05.320956] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T19:45:05.346915] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:45:05.352076] [INFO ] [REMOTE ] KBDC: Full fetch complete (30621 records). [2025-10-17T19:45:05.352212] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-17T19:45:05.565703] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-17T19:45:05.743194] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-17T19:45:05.743358] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-17T19:45:05.744272] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-17T19:45:05.744338] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-17T19:45:05.745550] [DEBUG] [LOCAL ] KBDC: Trimmed 30621 records to 22794 (keeping 200 days of data) [2025-10-17T19:45:05.860158] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:45:05.888116] [INFO ] [REMOTE ] KB: Full fetch complete (33622 records). [2025-10-17T19:45:05.893874] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-17T19:45:06.004242] [DEBUG] [LOCAL ] KBDC: Primary data saved (22794 records). [2025-10-17T19:45:06.027473] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-17T19:45:06.039108] [INFO ] [MAIN ] Update Progress: 1175/2368 symbols completed. KBDC took 25.6s. Estimated remaining: 2h 47m 34s. Rate: 7.1 symbols/min [2025-10-17T19:45:06.362753] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-17T19:45:06.396012] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:06.522872] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-17T19:45:06.522964] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-17T19:45:06.523673] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-17T19:45:06.523812] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-17T19:45:06.524715] [DEBUG] [LOCAL ] KB: Trimmed 33622 records to 23613 (keeping 200 days of data) [2025-10-17T19:45:06.652725] [DEBUG] [LOCAL ] KD: Loaded 52742 existing records from primary storage. [2025-10-17T19:45:06.654527] [INFO ] [MAIN ] KD: Loaded 52742 existing records. [2025-10-17T19:45:06.849406] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:06.851131] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-17T19:45:06.852128] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-17T19:45:06.853611] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-17T19:45:06.853712] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-17T19:45:07.052226] [DEBUG] [LOCAL ] KB: Primary data saved (23613 records). [2025-10-17T19:45:07.086548] [INFO ] [MAIN ] KB: Full history saved. [2025-10-17T19:45:07.137298] [INFO ] [MAIN ] Update Progress: 1176/2368 symbols completed. KB took 35.1s. Estimated remaining: 2h 47m 18s. Rate: 7.1 symbols/min [2025-10-17T19:45:07.405324] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:07.437601] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-17T19:45:07.458183] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:07.494197] [DEBUG] [LOCAL ] KEN: Loaded 4721 existing records from primary storage. [2025-10-17T19:45:07.494536] [INFO ] [MAIN ] KEN: Loaded 4721 existing records. [2025-10-17T19:45:07.562470] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T19:45:07.687775] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:07.687967] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-17T19:45:07.688039] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-17T19:45:07.688270] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-17T19:45:07.688342] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-17T19:45:07.958475] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-17T19:45:08.069693] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:08.120126] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:45:08.758083] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-17T19:45:09.260665] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T19:45:09.258962] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-17T19:45:09.346058] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:45:09.558042] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-17T19:45:10.358103] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-17T19:45:11.158084] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-17T19:45:11.634467] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T19:45:11.958053] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-17T19:45:12.080177] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:45:12.710253] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T19:45:12.758001] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-17T19:45:12.961705] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T19:45:13.558036] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-17T19:45:14.082092] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T19:45:14.357997] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-17T19:45:14.465942] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:45:15.158036] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-17T19:45:15.958008] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-17T19:45:16.190695] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:45:16.573272] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:45:16.758039] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-17T19:45:17.557994] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-17T19:45:17.792842] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T19:45:18.058568] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T19:45:18.358142] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-17T19:45:18.554332] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T19:45:18.561868] [INFO ] [REMOTE ] KBH: Full fetch complete (71099 records). [2025-10-17T19:45:18.562050] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-17T19:45:18.961454] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-17T19:45:18.961558] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-17T19:45:18.962677] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-17T19:45:18.962764] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-17T19:45:18.964342] [DEBUG] [LOCAL ] KBH: Trimmed 71099 records to 49532 (keeping 200 days of data) [2025-10-17T19:45:19.168038] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-17T19:45:19.258095] [DEBUG] [LOCAL ] KBH: Primary data saved (49532 records). [2025-10-17T19:45:19.258226] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-17T19:45:19.258395] [INFO ] [MAIN ] Update Progress: 1177/2368 symbols completed. KBH took 36.6s. Estimated remaining: 2h 47m 13s. Rate: 7.1 symbols/min [2025-10-17T19:45:19.423259] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:19.453524] [DEBUG] [LOCAL ] KEP: Loaded 32230 existing records from primary storage. [2025-10-17T19:45:19.453831] [INFO ] [MAIN ] KEP: Loaded 32230 existing records. [2025-10-17T19:45:19.638976] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:19.639224] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-17T19:45:19.639290] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-17T19:45:19.640015] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-17T19:45:19.640084] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-17T19:45:19.964600] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-17T19:45:20.007752] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:20.016364] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T19:45:20.202994] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:45:20.758071] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-17T19:45:21.558012] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-17T19:45:21.595492] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:45:22.027364] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:45:22.358072] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-17T19:45:23.158007] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-17T19:45:23.439354] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T19:45:23.538812] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T19:45:23.606377] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T19:45:23.958060] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-17T19:45:24.758027] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-17T19:45:25.558016] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-17T19:45:25.740624] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:45:25.926206] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-17T19:45:26.358036] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-17T19:45:26.507184] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:45:26.981200] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T19:45:27.158048] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-17T19:45:27.958028] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-17T19:45:28.758831] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:45:28.758957] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-17T19:45:28.997539] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:45:29.356739] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T19:45:29.558026] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-17T19:45:30.358017] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-17T19:45:31.157999] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-17T19:45:31.340248] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:45:31.435475] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T19:45:31.566866] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-17T19:45:31.958044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-17T19:45:32.544559] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T19:45:32.545592] [INFO ] [REMOTE ] KEN: Full fetch complete (5954 records). [2025-10-17T19:45:32.545717] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-17T19:45:32.763175] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-17T19:45:32.907787] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-17T19:45:32.907873] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-17T19:45:32.908056] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-17T19:45:32.908098] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-17T19:45:32.908478] [DEBUG] [LOCAL ] KEN: Trimmed 5954 records to 4731 (keeping 200 days of data) [2025-10-17T19:45:32.940528] [DEBUG] [LOCAL ] KEN: Primary data saved (4731 records). [2025-10-17T19:45:32.940719] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-17T19:45:32.940830] [INFO ] [MAIN ] Update Progress: 1178/2368 symbols completed. KEN took 25.8s. Estimated remaining: 2h 47m 10s. Rate: 7.1 symbols/min [2025-10-17T19:45:33.119416] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:33.157572] [DEBUG] [LOCAL ] KEX: Loaded 38962 existing records from primary storage. [2025-10-17T19:45:33.157939] [INFO ] [MAIN ] KEX: Loaded 38962 existing records. [2025-10-17T19:45:33.333813] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:33.334031] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-17T19:45:33.334077] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-17T19:45:33.335238] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-17T19:45:33.335298] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-17T19:45:33.563284] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-17T19:45:33.686276] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:34.358054] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-17T19:45:34.422429] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:45:35.158011] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-17T19:45:35.469179] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:45:35.879953] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:45:35.957997] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-17T19:45:36.431966] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:45:36.758047] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-17T19:45:37.558105] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-17T19:45:37.839822] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T19:45:38.103499] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:45:38.358096] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-17T19:45:39.001617] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:45:39.008274] [INFO ] [REMOTE ] KBR: Full fetch complete (69959 records). [2025-10-17T19:45:39.008425] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-17T19:45:39.163273] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-17T19:45:39.401701] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-17T19:45:39.401803] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-17T19:45:39.402813] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-17T19:45:39.402882] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-17T19:45:39.404313] [DEBUG] [LOCAL ] KBR: Trimmed 69959 records to 48737 (keeping 200 days of data) [2025-10-17T19:45:39.696678] [DEBUG] [LOCAL ] KBR: Primary data saved (48737 records). [2025-10-17T19:45:39.696829] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-17T19:45:39.696956] [INFO ] [MAIN ] Update Progress: 1179/2368 symbols completed. KBR took 46.2s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-17T19:45:39.869418] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:39.869615] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-17T19:45:39.869684] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-17T19:45:39.869805] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-17T19:45:39.869846] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-17T19:45:39.869887] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-17T19:45:39.869919] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-17T19:45:39.960012] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-17T19:45:40.230023] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:40.260489] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T19:45:40.758136] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-17T19:45:40.814095] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T19:45:41.482324] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:45:41.558006] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-17T19:45:42.358116] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-17T19:45:42.408627] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T19:45:42.415989] [INFO ] [REMOTE ] KD: Full fetch complete (76090 records). [2025-10-17T19:45:42.416141] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-17T19:45:42.818142] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-17T19:45:42.818303] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-17T19:45:42.819411] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-17T19:45:42.819536] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-17T19:45:42.821363] [DEBUG] [LOCAL ] KD: Trimmed 76090 records to 53125 (keeping 200 days of data) [2025-10-17T19:45:42.943867] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:45:43.158293] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-17T19:45:43.171360] [DEBUG] [LOCAL ] KD: Primary data saved (53125 records). [2025-10-17T19:45:43.171523] [INFO ] [MAIN ] KD: Full history saved. [2025-10-17T19:45:43.172169] [INFO ] [MAIN ] Update Progress: 1180/2368 symbols completed. KD took 37.1s. Estimated remaining: 2h 46m 47s. Rate: 7.1 symbols/min [2025-10-17T19:45:43.341864] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:43.383584] [DEBUG] [LOCAL ] KEYS: Loaded 43613 existing records from primary storage. [2025-10-17T19:45:43.383945] [INFO ] [MAIN ] KEYS: Loaded 43613 existing records. [2025-10-17T19:45:43.560029] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:43.560253] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-17T19:45:43.560300] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-17T19:45:43.561082] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-17T19:45:43.561151] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-17T19:45:43.924438] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:43.957995] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-17T19:45:44.111795] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T19:45:44.758117] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-17T19:45:44.781424] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T19:45:45.258726] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T19:45:45.558035] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-17T19:45:46.358048] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-17T19:45:46.627784] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:45:46.860259] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:45:47.158007] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-17T19:45:47.820482] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:45:47.958098] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-17T19:45:48.446170] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:45:48.758029] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-17T19:45:49.437769] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:45:49.558038] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-17T19:45:50.222629] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:45:50.358024] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-17T19:45:51.137357] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:45:51.157994] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-17T19:45:51.903871] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T19:45:51.958041] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-17T19:45:52.739787] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:45:52.758014] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-17T19:45:52.973347] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T19:45:53.558026] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-17T19:45:54.358004] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-17T19:45:54.393521] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:45:54.980890] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:45:55.158041] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-17T19:45:55.511709] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:45:55.516513] [INFO ] [REMOTE ] KEP: Full fetch complete (42229 records). [2025-10-17T19:45:55.516622] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-17T19:45:55.899872] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-17T19:45:55.899970] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-17T19:45:55.900739] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-17T19:45:55.900801] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-17T19:45:55.901821] [DEBUG] [LOCAL ] KEP: Trimmed 42229 records to 32548 (keeping 200 days of data) [2025-10-17T19:45:55.959358] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-17T19:45:56.092685] [DEBUG] [LOCAL ] KEP: Primary data saved (32548 records). [2025-10-17T19:45:56.092829] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-17T19:45:56.092912] [INFO ] [MAIN ] Update Progress: 1181/2368 symbols completed. KEP took 36.8s. Estimated remaining: 2h 46m 43s. Rate: 7.1 symbols/min [2025-10-17T19:45:56.261916] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:56.265835] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-17T19:45:56.265987] [INFO ] [MAIN ] KF: Loaded 2377 existing records. [2025-10-17T19:45:56.446294] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:56.446550] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-17T19:45:56.446617] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-17T19:45:56.446899] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-17T19:45:56.446974] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-17T19:45:56.786698] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-17T19:45:56.811067] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:56.841161] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:45:57.558035] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-17T19:45:57.929626] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T19:45:58.343512] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:45:58.357983] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-17T19:45:58.437086] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T19:45:59.158032] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-17T19:45:59.958021] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-17T19:46:00.055560] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:46:00.223260] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T19:46:00.758066] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-17T19:46:01.558056] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-17T19:46:02.149841] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T19:46:02.186997] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T19:46:02.358016] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-17T19:46:02.718619] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T19:46:02.724867] [INFO ] [REMOTE ] KEX: Full fetch complete (56100 records). [2025-10-17T19:46:02.724983] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-17T19:46:02.910000] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T19:46:03.133371] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-17T19:46:03.133483] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-17T19:46:03.134795] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-17T19:46:03.134880] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-17T19:46:03.136523] [DEBUG] [LOCAL ] KEX: Trimmed 56100 records to 39285 (keeping 200 days of data) [2025-10-17T19:46:03.194553] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-17T19:46:03.394387] [DEBUG] [LOCAL ] KEX: Primary data saved (39285 records). [2025-10-17T19:46:03.394542] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-17T19:46:03.394671] [INFO ] [MAIN ] Update Progress: 1182/2368 symbols completed. KEX took 30.5s. Estimated remaining: 2h 46m 33s. Rate: 7.1 symbols/min [2025-10-17T19:46:03.578749] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:03.605727] [DEBUG] [LOCAL ] KFRC: Loaded 20719 existing records from primary storage. [2025-10-17T19:46:03.606039] [INFO ] [MAIN ] KFRC: Loaded 20719 existing records. [2025-10-17T19:46:03.859852] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:03.860157] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-17T19:46:03.860228] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-17T19:46:03.860694] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-17T19:46:03.860754] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-17T19:46:03.963251] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-17T19:46:04.322776] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:04.566733] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T19:46:04.758006] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-17T19:46:05.161062] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:46:05.187896] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T19:46:05.558082] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-17T19:46:06.136410] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T19:46:06.358019] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-17T19:46:07.158088] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-17T19:46:07.754089] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:46:07.958085] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-17T19:46:08.377053] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T19:46:08.697952] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T19:46:08.758051] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-17T19:46:09.558027] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-17T19:46:10.274721] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:46:10.358049] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-17T19:46:11.158027] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-17T19:46:11.558868] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T19:46:11.625215] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T19:46:11.958016] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-17T19:46:12.106380] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:46:12.758085] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-17T19:46:13.546317] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T19:46:13.557985] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-17T19:46:13.652509] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:46:14.358006] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-17T19:46:14.481001] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T19:46:15.158073] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-17T19:46:15.616002] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T19:46:15.958043] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-17T19:46:16.147083] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T19:46:16.758089] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-17T19:46:17.504491] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:46:17.558025] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-17T19:46:18.358026] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-17T19:46:18.534468] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:46:18.795689] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T19:46:19.158057] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-17T19:46:19.958064] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-17T19:46:20.520222] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T19:46:20.521245] [INFO ] [REMOTE ] KF: Full fetch complete (3531 records). [2025-10-17T19:46:20.521319] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-17T19:46:20.760049] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-17T19:46:20.880283] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-17T19:46:20.880362] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-17T19:46:20.880506] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-17T19:46:20.880547] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-17T19:46:20.880930] [DEBUG] [LOCAL ] KF: Trimmed 3531 records to 2385 (keeping 200 days of data) [2025-10-17T19:46:20.894931] [DEBUG] [LOCAL ] KF: Primary data saved (2385 records). [2025-10-17T19:46:20.894994] [INFO ] [MAIN ] KF: Full history saved. [2025-10-17T19:46:20.895063] [INFO ] [MAIN ] Update Progress: 1183/2368 symbols completed. KF took 24.8s. Estimated remaining: 2h 46m 34s. Rate: 7.1 symbols/min [2025-10-17T19:46:21.068130] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:21.077727] [DEBUG] [LOCAL ] KFS: Loaded 8736 existing records from primary storage. [2025-10-17T19:46:21.077939] [INFO ] [MAIN ] KFS: Loaded 8736 existing records. [2025-10-17T19:46:21.257911] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:21.258243] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-17T19:46:21.258319] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-17T19:46:21.258737] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-17T19:46:21.258799] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-17T19:46:21.336045] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T19:46:21.392589] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-17T19:46:21.392782] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-17T19:46:21.756627] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T19:46:21.762855] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:46:21.776441] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:46:21.780983] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-17T19:46:21.797088] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-17T19:46:21.871532] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:21.871606] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-17T19:46:21.874380] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-17T19:46:21.874132] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:46:21.875455] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-17T19:46:21.875598] [INFO ] [MAIN ] Update Progress: 1184/2368 symbols completed. KEY took 42.2s. Estimated remaining: 2h 46m 18s. Rate: 7.1 symbols/min [2025-10-17T19:46:22.053576] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (4.50 seconds). [2025-10-17T19:46:22.070680] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:22.076418] [INFO ] [REMOTE ] KEYS: Full fetch complete (62699 records). [2025-10-17T19:46:22.076505] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-17T19:46:22.077599] [FATAL] [VALIDATOR ] KEYS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T19:46:22.077744] [FATAL] [MAIN ] KEYS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:46:22.077791] [WARN ] [MAIN ] KEYS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:46:22.077890] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-17T19:46:22.077982] [DEBUG] [LOCAL ] KEYS: No primary data file found to delete. [2025-10-17T19:46:22.078033] [INFO ] [LOCAL ] KEYS: Starting deletion of derivative data. [2025-10-17T19:46:22.078317] [DEBUG] [LOCAL ] KEYS: Deleted derivative data file. [2025-10-17T19:46:22.078790] [INFO ] [MAIN ] Update Progress: 1185/2368 symbols completed. KEYS took 38.9s. Estimated remaining: 2h 46m 1s. Rate: 7.1 symbols/min [2025-10-17T19:46:22.267049] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:22.269141] [DEBUG] [LOCAL ] KFY: Loaded 30189 existing records from primary storage. [2025-10-17T19:46:22.269552] [INFO ] [MAIN ] KFY: Loaded 30189 existing records. [2025-10-17T19:46:22.360157] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-17T19:46:22.457024] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:22.457365] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-17T19:46:22.457428] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-17T19:46:22.458068] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-17T19:46:22.458126] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-17T19:46:22.569293] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T19:46:22.659691] [DEBUG] [LOCAL ] KGC: Loaded 54090 existing records from primary storage. [2025-10-17T19:46:22.679850] [INFO ] [MAIN ] KGC: Loaded 54090 existing records. [2025-10-17T19:46:23.085343] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:23.122009] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:23.122557] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-17T19:46:23.123064] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-17T19:46:23.124189] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-17T19:46:23.124251] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-17T19:46:23.160118] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-17T19:46:23.472282] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T19:46:23.526730] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:23.926572] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:46:23.958056] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-17T19:46:24.758034] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-17T19:46:25.349337] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T19:46:25.558044] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-17T19:46:26.114580] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-17T19:46:26.358082] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-17T19:46:26.986292] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:46:27.053747] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T19:46:27.158025] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-17T19:46:27.753426] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:46:27.958034] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-17T19:46:28.758032] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-17T19:46:29.135334] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T19:46:29.317709] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:46:29.558012] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-17T19:46:30.358031] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-17T19:46:30.992557] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:46:31.158029] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-17T19:46:31.957988] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-17T19:46:32.365470] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T19:46:32.410148] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T19:46:32.467168] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T19:46:32.758093] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-17T19:46:33.558037] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-17T19:46:34.358016] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-17T19:46:34.685566] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:46:34.719456] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T19:46:35.158038] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-17T19:46:35.529529] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:46:35.958025] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-17T19:46:36.714331] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:46:36.757989] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-17T19:46:37.256193] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T19:46:37.558024] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-17T19:46:37.574615] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T19:46:38.358047] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-17T19:46:38.919420] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T19:46:39.158018] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-17T19:46:39.639417] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:46:39.643129] [INFO ] [REMOTE ] KFRC: Full fetch complete (26733 records). [2025-10-17T19:46:39.643201] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-17T19:46:39.963261] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-17T19:46:40.009982] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-17T19:46:40.010061] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-17T19:46:40.010672] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-17T19:46:40.010736] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-17T19:46:40.011484] [DEBUG] [LOCAL ] KFRC: Trimmed 26733 records to 20885 (keeping 200 days of data) [2025-10-17T19:46:40.140945] [DEBUG] [LOCAL ] KFRC: Primary data saved (20885 records). [2025-10-17T19:46:40.141069] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-17T19:46:40.141145] [INFO ] [MAIN ] Update Progress: 1186/2368 symbols completed. KFRC took 36.7s. Estimated remaining: 2h 46m 3s. Rate: 7.1 symbols/min [2025-10-17T19:46:40.309891] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:40.331536] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T19:46:40.389796] [DEBUG] [LOCAL ] KGS: Loaded 46426 existing records from primary storage. [2025-10-17T19:46:40.390138] [INFO ] [MAIN ] KGS: Loaded 46426 existing records. [2025-10-17T19:46:40.571980] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:40.572199] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-17T19:46:40.572246] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-17T19:46:40.573016] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-17T19:46:40.573075] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-17T19:46:40.763270] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-17T19:46:40.932854] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:41.362503] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T19:46:41.558005] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-17T19:46:41.860930] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:46:42.320100] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:46:42.357986] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-17T19:46:43.158051] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-17T19:46:43.866699] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:46:43.957990] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-17T19:46:44.683434] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:46:44.757994] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-17T19:46:45.333960] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T19:46:45.558024] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-17T19:46:46.306187] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T19:46:46.357981] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-17T19:46:46.505097] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:46:47.124518] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T19:46:47.158003] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-17T19:46:47.958032] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-17T19:46:48.758062] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-17T19:46:49.186599] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T19:46:49.483137] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:46:49.542837] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T19:46:49.557977] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-17T19:46:50.358073] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-17T19:46:51.143811] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:46:51.145736] [INFO ] [REMOTE ] KFS: Full fetch complete (11104 records). [2025-10-17T19:46:51.145820] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-17T19:46:51.166599] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-17T19:46:51.363537] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:46:51.552373] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-17T19:46:51.552471] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-17T19:46:51.552841] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-17T19:46:51.552907] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-17T19:46:51.553446] [DEBUG] [LOCAL ] KFS: Trimmed 11104 records to 8837 (keeping 200 days of data) [2025-10-17T19:46:51.603894] [DEBUG] [LOCAL ] KFS: Primary data saved (8837 records). [2025-10-17T19:46:51.604024] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-17T19:46:51.604107] [INFO ] [MAIN ] Update Progress: 1187/2368 symbols completed. KFS took 30.7s. Estimated remaining: 2h 45m 57s. Rate: 7.1 symbols/min [2025-10-17T19:46:51.769570] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:51.820113] [DEBUG] [LOCAL ] KIM: Loaded 53394 existing records from primary storage. [2025-10-17T19:46:51.820490] [INFO ] [MAIN ] KIM: Loaded 53394 existing records. [2025-10-17T19:46:51.963169] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-17T19:46:52.002320] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:52.002496] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-17T19:46:52.002545] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-17T19:46:52.003503] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-17T19:46:52.003560] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-17T19:46:52.367401] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:52.758001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-17T19:46:53.210395] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T19:46:53.563123] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-17T19:46:53.579853] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:46:54.358007] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-17T19:46:54.473318] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T19:46:54.520248] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:46:55.158028] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-17T19:46:55.473558] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:46:55.958062] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-17T19:46:56.758108] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-17T19:46:56.902422] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:46:57.558075] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-17T19:46:58.316373] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T19:46:58.358017] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-17T19:46:58.424353] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T19:46:58.892856] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:46:58.897209] [INFO ] [REMOTE ] KFY: Full fetch complete (43366 records). [2025-10-17T19:46:58.897319] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-17T19:46:59.163201] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-17T19:46:59.288341] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-17T19:46:59.288422] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-17T19:46:59.289244] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-17T19:46:59.289308] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-17T19:46:59.290358] [DEBUG] [LOCAL ] KFY: Trimmed 43366 records to 30339 (keeping 200 days of data) [2025-10-17T19:46:59.470216] [DEBUG] [LOCAL ] KFY: Primary data saved (30339 records). [2025-10-17T19:46:59.470348] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-17T19:46:59.470430] [INFO ] [MAIN ] Update Progress: 1188/2368 symbols completed. KFY took 37.6s. Estimated remaining: 2h 45m 48s. Rate: 7.1 symbols/min [2025-10-17T19:46:59.636126] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:59.655984] [DEBUG] [LOCAL ] KIO: Loaded 21866 existing records from primary storage. [2025-10-17T19:46:59.656205] [INFO ] [MAIN ] KIO: Loaded 21866 existing records. [2025-10-17T19:46:59.832322] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:59.832530] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-17T19:46:59.832576] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-17T19:46:59.833085] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-17T19:46:59.833142] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-17T19:46:59.962417] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-17T19:47:00.149518] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T19:47:00.234894] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:00.758017] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-17T19:47:01.017293] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:47:01.558056] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-17T19:47:01.800096] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T19:47:02.358036] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-17T19:47:02.758376] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T19:47:03.158051] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-17T19:47:03.958112] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-17T19:47:04.482810] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T19:47:04.763558] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-17T19:47:04.777308] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T19:47:05.019302] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:47:05.558020] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-17T19:47:05.912447] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (5.15 seconds). [2025-10-17T19:47:06.358013] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-17T19:47:07.073374] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T19:47:07.081513] [INFO ] [REMOTE ] KGC: Full fetch complete (77872 records). [2025-10-17T19:47:07.081711] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-17T19:47:07.168307] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-17T19:47:07.213760] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T19:47:07.446254] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T19:47:07.570775] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-17T19:47:07.570858] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-17T19:47:07.571993] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-17T19:47:07.572059] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-17T19:47:07.573530] [DEBUG] [LOCAL ] KGC: Trimmed 77872 records to 54480 (keeping 200 days of data) [2025-10-17T19:47:07.907387] [DEBUG] [LOCAL ] KGC: Primary data saved (54480 records). [2025-10-17T19:47:07.907524] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-17T19:47:07.908289] [INFO ] [MAIN ] Update Progress: 1189/2368 symbols completed. KGC took 45.8s. Estimated remaining: 2h 45m 40s. Rate: 7.1 symbols/min [2025-10-17T19:47:07.970084] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-17T19:47:08.075468] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:08.126661] [DEBUG] [LOCAL ] KKR: Loaded 53893 existing records from primary storage. [2025-10-17T19:47:08.126997] [INFO ] [MAIN ] KKR: Loaded 53893 existing records. [2025-10-17T19:47:08.302120] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:08.302317] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-17T19:47:08.302362] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-17T19:47:08.303383] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-17T19:47:08.303442] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-17T19:47:08.671083] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:08.757992] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-17T19:47:09.140399] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T19:47:09.166080] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T19:47:09.558029] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-17T19:47:10.358035] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-17T19:47:10.593321] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:47:11.158001] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-17T19:47:11.340993] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T19:47:11.387268] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T19:47:11.958050] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-17T19:47:12.758002] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-17T19:47:12.880473] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:47:12.887484] [INFO ] [REMOTE ] KGS: Full fetch complete (66496 records). [2025-10-17T19:47:12.887674] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-17T19:47:13.022797] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T19:47:13.282396] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-17T19:47:13.282479] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-17T19:47:13.283432] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-17T19:47:13.283499] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-17T19:47:13.284895] [DEBUG] [LOCAL ] KGS: Trimmed 66496 records to 46744 (keeping 200 days of data) [2025-10-17T19:47:13.558137] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-17T19:47:13.565120] [DEBUG] [LOCAL ] KGS: Primary data saved (46744 records). [2025-10-17T19:47:13.565293] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-17T19:47:13.565858] [INFO ] [MAIN ] Update Progress: 1190/2368 symbols completed. KGS took 33.4s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-10-17T19:47:13.733636] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:13.741481] [DEBUG] [LOCAL ] KKRS: Loaded 5648 existing records from primary storage. [2025-10-17T19:47:13.741760] [INFO ] [MAIN ] KKRS: Loaded 5648 existing records. [2025-10-17T19:47:13.912627] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:13.912856] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-17T19:47:13.912903] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-17T19:47:13.913125] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-17T19:47:13.913181] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-17T19:47:14.262572] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:14.357987] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-17T19:47:14.553955] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T19:47:15.072527] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T19:47:15.158058] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-17T19:47:15.368871] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:47:15.958088] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-17T19:47:16.352342] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T19:47:16.765106] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-17T19:47:16.771165] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T19:47:17.558018] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-17T19:47:17.825618] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:47:18.358044] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-17T19:47:19.158031] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-17T19:47:19.588100] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T19:47:19.958077] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-17T19:47:20.157383] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:47:20.341438] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T19:47:20.758124] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-17T19:47:21.558008] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-17T19:47:21.921803] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T19:47:22.185597] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T19:47:22.358084] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-17T19:47:22.484673] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:47:23.158007] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-17T19:47:23.482367] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T19:47:23.958077] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-17T19:47:24.521880] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T19:47:24.758027] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-17T19:47:25.089869] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T19:47:25.515070] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:47:25.558019] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-17T19:47:26.321986] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:47:26.358020] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-17T19:47:27.158084] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-17T19:47:27.356047] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T19:47:27.958060] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-17T19:47:28.758027] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-17T19:47:28.994892] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T19:47:29.163688] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T19:47:29.167605] [INFO ] [REMOTE ] KIO: Full fetch complete (32127 records). [2025-10-17T19:47:29.167759] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-17T19:47:29.533838] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-17T19:47:29.533923] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-17T19:47:29.534544] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-17T19:47:29.534587] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-17T19:47:29.535322] [DEBUG] [LOCAL ] KIO: Trimmed 32127 records to 22090 (keeping 200 days of data) [2025-10-17T19:47:29.586319] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-17T19:47:29.669445] [DEBUG] [LOCAL ] KIO: Primary data saved (22090 records). [2025-10-17T19:47:29.669568] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-17T19:47:29.669676] [INFO ] [MAIN ] Update Progress: 1191/2368 symbols completed. KIO took 30.2s. Estimated remaining: 2h 45m 28s. Rate: 7.1 symbols/min [2025-10-17T19:47:29.839435] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:29.839628] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-17T19:47:29.839704] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-17T19:47:29.839829] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-17T19:47:29.839895] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-17T19:47:29.839966] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-17T19:47:29.840021] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-17T19:47:30.197349] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:30.219543] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T19:47:30.358012] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-17T19:47:30.554476] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:47:30.575846] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:47:30.576148] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-17T19:47:30.576237] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:47:30.576287] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-17T19:47:30.576346] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:47:30.576418] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-17T19:47:30.576510] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-17T19:47:30.576549] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-17T19:47:30.576589] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-17T19:47:30.576633] [INFO ] [MAIN ] Update Progress: 1192/2368 symbols completed. KKRT took 0.9s. Estimated remaining: 2h 45m 12s. Rate: 7.1 symbols/min [2025-10-17T19:47:30.739731] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:30.739913] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-17T19:47:30.739950] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-17T19:47:30.740060] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-17T19:47:30.740102] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-17T19:47:30.740142] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-17T19:47:30.740174] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-17T19:47:31.097383] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:31.158015] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-17T19:47:31.369029] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:47:31.369339] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-17T19:47:31.369432] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:47:31.369505] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-17T19:47:31.369582] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:47:31.369703] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-17T19:47:31.369802] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-17T19:47:31.369912] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-17T19:47:31.370004] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-17T19:47:31.370095] [INFO ] [MAIN ] Update Progress: 1193/2368 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 44m 56s. Rate: 7.1 symbols/min [2025-10-17T19:47:31.540734] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:31.574409] [DEBUG] [LOCAL ] KLC: Loaded 36757 existing records from primary storage. [2025-10-17T19:47:31.574742] [INFO ] [MAIN ] KLC: Loaded 36757 existing records. [2025-10-17T19:47:31.746949] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:31.747142] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-17T19:47:31.747188] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-17T19:47:31.747791] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-17T19:47:31.747848] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-17T19:47:31.963234] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-17T19:47:32.102322] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:32.758024] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-17T19:47:33.329740] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:47:33.558002] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-17T19:47:33.835028] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:47:33.842702] [INFO ] [REMOTE ] KIM: Full fetch complete (76972 records). [2025-10-17T19:47:33.842891] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-17T19:47:34.267037] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-17T19:47:34.267165] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-17T19:47:34.268485] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-17T19:47:34.268594] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-17T19:47:34.270296] [DEBUG] [LOCAL ] KIM: Trimmed 76972 records to 53783 (keeping 200 days of data) [2025-10-17T19:47:34.363111] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-17T19:47:34.615505] [DEBUG] [LOCAL ] KIM: Primary data saved (53783 records). [2025-10-17T19:47:34.615675] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-17T19:47:34.615793] [INFO ] [MAIN ] Update Progress: 1194/2368 symbols completed. KIM took 43.0s. Estimated remaining: 2h 44m 42s. Rate: 7.1 symbols/min [2025-10-17T19:47:34.800464] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:34.850664] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-17T19:47:34.851034] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-10-17T19:47:35.041890] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:35.042119] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-17T19:47:35.042168] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-17T19:47:35.043228] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-17T19:47:35.043311] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-17T19:47:35.163159] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-17T19:47:35.437436] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:35.508844] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:47:35.823583] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T19:47:35.870434] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:47:35.958045] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-17T19:47:36.502924] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T19:47:36.758048] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-17T19:47:37.558031] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-17T19:47:37.977118] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T19:47:38.358067] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-17T19:47:39.158007] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-17T19:47:39.454601] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T19:47:39.708826] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T19:47:39.710045] [INFO ] [REMOTE ] KKRS: Full fetch complete (7632 records). [2025-10-17T19:47:39.710127] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-17T19:47:39.963112] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-17T19:47:40.067235] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-17T19:47:40.067388] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-17T19:47:40.067616] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-17T19:47:40.067756] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-17T19:47:40.068168] [DEBUG] [LOCAL ] KKRS: Trimmed 7632 records to 5669 (keeping 200 days of data) [2025-10-17T19:47:40.101417] [DEBUG] [LOCAL ] KKRS: Primary data saved (5669 records). [2025-10-17T19:47:40.101497] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-17T19:47:40.101582] [INFO ] [MAIN ] Update Progress: 1195/2368 symbols completed. KKRS took 26.5s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-17T19:47:40.274626] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:40.282275] [DEBUG] [LOCAL ] KMPB: Loaded 3667 existing records from primary storage. [2025-10-17T19:47:40.282484] [INFO ] [MAIN ] KMPB: Loaded 3667 existing records. [2025-10-17T19:47:40.460675] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:40.460978] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-17T19:47:40.461037] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-17T19:47:40.471365] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-17T19:47:40.485333] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-17T19:47:40.564564] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T19:47:40.765722] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-17T19:47:40.854709] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:41.558002] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-17T19:47:41.928425] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T19:47:42.357994] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-17T19:47:42.679226] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:47:43.158021] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-17T19:47:43.198472] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-17T19:47:43.957997] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-17T19:47:44.290124] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T19:47:44.297423] [INFO ] [REMOTE ] KKR: Full fetch complete (77638 records). [2025-10-17T19:47:44.297542] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-17T19:47:44.437870] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T19:47:44.733005] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:47:44.731793] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-17T19:47:44.740500] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-17T19:47:44.741896] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-17T19:47:44.741959] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-17T19:47:44.743253] [DEBUG] [LOCAL ] KKR: Trimmed 77638 records to 54283 (keeping 200 days of data) [2025-10-17T19:47:44.797765] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-17T19:47:45.073278] [DEBUG] [LOCAL ] KKR: Primary data saved (54283 records). [2025-10-17T19:47:45.073407] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-17T19:47:45.074091] [INFO ] [MAIN ] Update Progress: 1196/2368 symbols completed. KKR took 37.2s. Estimated remaining: 2h 44m 19s. Rate: 7.1 symbols/min [2025-10-17T19:47:45.250540] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:45.275203] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T19:47:45.291341] [DEBUG] [LOCAL ] KMPR: Loaded 40369 existing records from primary storage. [2025-10-17T19:47:45.291674] [INFO ] [MAIN ] KMPR: Loaded 40369 existing records. [2025-10-17T19:47:45.463266] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:45.463514] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-17T19:47:45.463572] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-17T19:47:45.464280] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-17T19:47:45.464337] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-17T19:47:45.561457] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-17T19:47:45.808202] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:46.358088] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-17T19:47:47.061980] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:47:47.157998] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-17T19:47:47.958022] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-17T19:47:48.323703] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-17T19:47:48.393599] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T19:47:48.557150] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:47:48.758093] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-17T19:47:49.558031] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-17T19:47:50.358075] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-17T19:47:50.699165] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T19:47:50.790583] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T19:47:51.158054] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-17T19:47:51.686269] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:47:51.710760] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T19:47:51.958086] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-17T19:47:52.758104] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-17T19:47:53.252245] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:47:53.558044] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-17T19:47:53.903972] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T19:47:54.085565] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-17T19:47:54.358063] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-17T19:47:55.158066] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-17T19:47:55.958008] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-17T19:47:56.341222] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T19:47:56.614064] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:47:56.749983] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T19:47:56.757993] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-17T19:47:57.558064] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-17T19:47:58.014323] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T19:47:58.083806] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T19:47:58.358039] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-17T19:47:59.158050] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-17T19:47:59.845147] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T19:47:59.958075] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-17T19:48:00.758085] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-17T19:48:01.438059] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:48:01.499957] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T19:48:01.558070] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-17T19:48:02.358078] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-17T19:48:03.158079] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-17T19:48:04.108401] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:48:04.119538] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-17T19:48:04.681087] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:48:04.758031] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-17T19:48:05.625027] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (4.07 seconds). [2025-10-17T19:48:05.629042] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (4.87 seconds). [2025-10-17T19:48:05.630517] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-17T19:48:06.139147] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T19:48:06.144409] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T19:48:06.285396] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:48:06.357992] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-17T19:48:07.158083] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-17T19:48:07.935385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T19:48:07.958004] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-17T19:48:08.641340] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:48:08.647167] [INFO ] [REMOTE ] KLC: Full fetch complete (50568 records). [2025-10-17T19:48:08.647358] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-17T19:48:08.763212] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-17T19:48:09.044036] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-17T19:48:09.044135] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-17T19:48:09.045073] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-17T19:48:09.045137] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-17T19:48:09.046167] [DEBUG] [LOCAL ] KLC: Trimmed 50568 records to 37016 (keeping 200 days of data) [2025-10-17T19:48:09.259509] [DEBUG] [LOCAL ] KLC: Primary data saved (37016 records). [2025-10-17T19:48:09.259682] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-17T19:48:09.259783] [INFO ] [MAIN ] Update Progress: 1197/2368 symbols completed. KLC took 37.9s. Estimated remaining: 2h 44m 26s. Rate: 7.1 symbols/min [2025-10-17T19:48:09.471241] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:48:09.558020] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-17T19:48:10.358043] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-17T19:48:10.764058] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T19:48:10.859578] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-17T19:48:11.158085] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-17T19:48:11.183220] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T19:48:11.189516] [INFO ] [REMOTE ] KMPR: Full fetch complete (53208 records). [2025-10-17T19:48:11.189690] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-17T19:48:11.564361] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-17T19:48:11.564446] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-17T19:48:11.565312] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-17T19:48:11.565375] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-17T19:48:11.566554] [DEBUG] [LOCAL ] KMPR: Trimmed 53208 records to 40730 (keeping 200 days of data) [2025-10-17T19:48:11.785308] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T19:48:11.827163] [DEBUG] [LOCAL ] KMPR: Primary data saved (40730 records). [2025-10-17T19:48:11.827290] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-17T19:48:11.828035] [INFO ] [MAIN ] Update Progress: 1198/2368 symbols completed. KMPR took 26.8s. Estimated remaining: 2h 44m 12s. Rate: 7.1 symbols/min [2025-10-17T19:48:11.958149] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-17T19:48:12.541461] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T19:48:12.542437] [INFO ] [REMOTE ] KMPB: Full fetch complete (4975 records). [2025-10-17T19:48:12.542508] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-17T19:48:12.779632] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-17T19:48:12.896097] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-17T19:48:12.896175] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-17T19:48:12.896318] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-17T19:48:12.896355] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-17T19:48:12.896809] [DEBUG] [LOCAL ] KMPB: Trimmed 4975 records to 3680 (keeping 200 days of data) [2025-10-17T19:48:12.919121] [DEBUG] [LOCAL ] KMPB: Primary data saved (3680 records). [2025-10-17T19:48:12.919250] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-17T19:48:12.919346] [INFO ] [MAIN ] Update Progress: 1199/2368 symbols completed. KMPB took 32.8s. Estimated remaining: 2h 43m 57s. Rate: 7.1 symbols/min [2025-10-17T19:48:14.771392] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T19:48:14.784953] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-17T19:48:16.864441] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T19:48:16.872509] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-17T19:48:16.872696] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-17T19:48:17.255386] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-17T19:48:17.255465] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-17T19:48:17.256511] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-17T19:48:17.256577] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-17T19:48:17.258113] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54473 (keeping 200 days of data) [2025-10-17T19:48:17.584522] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-10-17T19:48:17.584679] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-17T19:48:17.584791] [INFO ] [MAIN ] Update Progress: 1200/2368 symbols completed. KMI took 43.0s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-17T19:48:18.142959] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.295466] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.343887] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.346578] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.381718] [DEBUG] [LOCAL ] KNF: Loaded 36840 existing records from primary storage. [2025-10-17T19:48:18.382116] [INFO ] [MAIN ] KNF: Loaded 36840 existing records. [2025-10-17T19:48:18.578556] [DEBUG] [LOCAL ] KMT: Loaded 43226 existing records from primary storage. [2025-10-17T19:48:18.610519] [DEBUG] [LOCAL ] KN: Loaded 38866 existing records from primary storage. [2025-10-17T19:48:18.632070] [INFO ] [MAIN ] KMT: Loaded 43226 existing records. [2025-10-17T19:48:18.635183] [INFO ] [MAIN ] KN: Loaded 38866 existing records. [2025-10-17T19:48:18.783040] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:18.754337] [DEBUG] [LOCAL ] KMX: Loaded 53667 existing records from primary storage. [2025-10-17T19:48:18.813728] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-17T19:48:18.826198] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-17T19:48:18.873248] [INFO ] [MAIN ] KMX: Loaded 53667 existing records. [2025-10-17T19:48:18.873402] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-17T19:48:18.937025] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-17T19:48:19.361545] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:19.365699] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:19.406595] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-17T19:48:19.382139] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-17T19:48:19.418979] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-17T19:48:19.445786] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-17T19:48:19.418869] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-17T19:48:19.446008] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-17T19:48:19.522921] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-17T19:48:19.523096] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-17T19:48:19.527726] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:19.701741] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-17T19:48:19.752931] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-17T19:48:19.840511] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-17T19:48:19.902408] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-17T19:48:20.258267] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.319564] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-17T19:48:20.624383] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.648917] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-17T19:48:20.758759] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.820430] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-17T19:48:20.940767] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.941090] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-17T19:48:21.841854] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:48:21.848509] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-17T19:48:22.154843] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:48:22.162765] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-17T19:48:22.325222] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:48:22.347194] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-17T19:48:22.350634] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:48:22.361886] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-17T19:48:22.827373] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T19:48:22.834322] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-17T19:48:23.603055] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:48:23.611989] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-17T19:48:23.696148] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T19:48:23.708039] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-17T19:48:23.806403] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T19:48:23.815046] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-17T19:48:24.028984] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T19:48:24.035333] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-17T19:48:25.006496] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:48:25.015997] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-17T19:48:25.068772] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T19:48:25.144445] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:48:25.343977] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:48:25.558024] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-17T19:48:26.357990] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-17T19:48:26.835346] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T19:48:27.030285] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T19:48:27.158017] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-17T19:48:27.725537] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T19:48:27.958041] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-17T19:48:28.758018] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-17T19:48:28.785252] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:48:29.559490] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-17T19:48:29.564934] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:48:30.358032] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-17T19:48:30.720535] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T19:48:30.785142] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T19:48:31.158091] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-17T19:48:31.704058] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:48:31.958068] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-17T19:48:32.642002] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:48:32.758021] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-17T19:48:33.558042] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-17T19:48:33.821350] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:48:34.358002] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-17T19:48:34.437780] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:48:35.124031] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:48:35.157988] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-17T19:48:35.756975] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T19:48:35.958022] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-17T19:48:36.758042] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-17T19:48:36.800550] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:48:37.467694] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T19:48:37.558039] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-17T19:48:38.357995] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-17T19:48:38.766526] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:48:39.042137] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:48:39.157998] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-17T19:48:39.745891] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:48:39.958044] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-17T19:48:40.466514] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T19:48:40.758111] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-17T19:48:41.558034] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-17T19:48:41.590776] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:48:42.358038] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-17T19:48:42.552205] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T19:48:43.047858] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T19:48:43.158057] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-17T19:48:43.898120] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T19:48:43.903753] [INFO ] [REMOTE ] KMT: Full fetch complete (61904 records). [2025-10-17T19:48:43.903857] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-17T19:48:43.970014] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-17T19:48:44.290034] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-17T19:48:44.290108] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-17T19:48:44.290977] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-17T19:48:44.291040] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-17T19:48:44.292212] [DEBUG] [LOCAL ] KMT: Trimmed 61904 records to 43532 (keeping 200 days of data) [2025-10-17T19:48:44.546743] [DEBUG] [LOCAL ] KMT: Primary data saved (43532 records). [2025-10-17T19:48:44.546864] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-17T19:48:44.546945] [INFO ] [MAIN ] Update Progress: 1201/2368 symbols completed. KMT took 27.0s. Estimated remaining: 2h 43m 54s. Rate: 7.1 symbols/min [2025-10-17T19:48:44.718435] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:44.729750] [DEBUG] [LOCAL ] KNOP: Loaded 10555 existing records from primary storage. [2025-10-17T19:48:44.729954] [INFO ] [MAIN ] KNOP: Loaded 10555 existing records. [2025-10-17T19:48:44.770955] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-17T19:48:44.909229] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:44.909593] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-17T19:48:44.909756] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-17T19:48:44.910038] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-17T19:48:44.910094] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-17T19:48:45.267727] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:45.314145] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-17T19:48:45.458068] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:48:45.557983] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-17T19:48:46.254824] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:48:46.358033] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-17T19:48:47.033032] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:48:47.039118] [INFO ] [REMOTE ] KNF: Full fetch complete (51386 records). [2025-10-17T19:48:47.039261] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-17T19:48:47.163227] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-17T19:48:47.462790] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-17T19:48:47.462876] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-17T19:48:47.463920] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-17T19:48:47.463987] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-17T19:48:47.465677] [DEBUG] [LOCAL ] KNF: Trimmed 51386 records to 37116 (keeping 200 days of data) [2025-10-17T19:48:47.698702] [DEBUG] [LOCAL ] KNF: Primary data saved (37116 records). [2025-10-17T19:48:47.698851] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-17T19:48:47.698938] [INFO ] [MAIN ] Update Progress: 1202/2368 symbols completed. KNF took 30.1s. Estimated remaining: 2h 43m 41s. Rate: 7.1 symbols/min [2025-10-17T19:48:47.867083] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:47.890238] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:48:47.912975] [DEBUG] [LOCAL ] KNSL: Loaded 18656 existing records from primary storage. [2025-10-17T19:48:47.913216] [INFO ] [MAIN ] KNSL: Loaded 18656 existing records. [2025-10-17T19:48:47.965882] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-17T19:48:48.091983] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:48.092197] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-17T19:48:48.092245] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-17T19:48:48.092408] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-17T19:48:48.092447] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-17T19:48:48.382710] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T19:48:48.456990] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:48.758079] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-17T19:48:48.826504] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T19:48:48.834675] [INFO ] [REMOTE ] KMX: Full fetch complete (76363 records). [2025-10-17T19:48:48.834841] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-17T19:48:49.226500] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-17T19:48:49.226589] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-17T19:48:49.227754] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-17T19:48:49.227866] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-17T19:48:49.229386] [DEBUG] [LOCAL ] KMX: Trimmed 76363 records to 54057 (keeping 200 days of data) [2025-10-17T19:48:49.541421] [DEBUG] [LOCAL ] KMX: Primary data saved (54057 records). [2025-10-17T19:48:49.541546] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-17T19:48:49.542115] [INFO ] [MAIN ] Update Progress: 1203/2368 symbols completed. KMX took 32.0s. Estimated remaining: 2h 43m 26s. Rate: 7.1 symbols/min [2025-10-17T19:48:49.563329] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-17T19:48:49.715311] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:49.759674] [DEBUG] [LOCAL ] KNTK: Loaded 47433 existing records from primary storage. [2025-10-17T19:48:49.760005] [INFO ] [MAIN ] KNTK: Loaded 47433 existing records. [2025-10-17T19:48:49.879877] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:48:49.948819] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:49.949053] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-17T19:48:49.949100] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-17T19:48:49.949785] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-17T19:48:49.949841] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-17T19:48:50.294784] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:50.358019] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-17T19:48:51.076419] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:48:51.157998] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-17T19:48:51.958025] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-17T19:48:51.972810] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T19:48:52.047401] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T19:48:52.758091] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-17T19:48:53.407945] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T19:48:53.413257] [INFO ] [REMOTE ] KN: Full fetch complete (56533 records). [2025-10-17T19:48:53.413368] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-17T19:48:53.560292] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-17T19:48:53.794792] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-17T19:48:53.794926] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-17T19:48:53.795849] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-17T19:48:53.795911] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-17T19:48:53.797027] [DEBUG] [LOCAL ] KN: Trimmed 56533 records to 39111 (keeping 200 days of data) [2025-10-17T19:48:53.915552] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:48:54.046433] [DEBUG] [LOCAL ] KN: Primary data saved (39111 records). [2025-10-17T19:48:54.046576] [INFO ] [MAIN ] KN: Full history saved. [2025-10-17T19:48:54.046684] [INFO ] [MAIN ] Update Progress: 1204/2368 symbols completed. KN took 36.4s. Estimated remaining: 2h 43m 14s. Rate: 7.1 symbols/min [2025-10-17T19:48:54.239215] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:54.290933] [DEBUG] [LOCAL ] KNX: Loaded 53005 existing records from primary storage. [2025-10-17T19:48:54.291263] [INFO ] [MAIN ] KNX: Loaded 53005 existing records. [2025-10-17T19:48:54.363737] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-17T19:48:54.370579] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T19:48:54.509499] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:54.509736] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-17T19:48:54.509823] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-17T19:48:54.510771] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-17T19:48:54.510831] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-17T19:48:54.918638] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:55.157999] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-17T19:48:55.501131] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:48:55.958076] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-17T19:48:56.758098] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-17T19:48:56.775933] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T19:48:56.814328] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T19:48:57.558066] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-17T19:48:58.213816] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T19:48:58.358070] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-17T19:48:59.158011] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-17T19:48:59.193745] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T19:48:59.379119] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T19:48:59.958027] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-17T19:49:00.540952] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T19:49:00.758048] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-17T19:49:00.845268] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T19:49:01.558038] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-17T19:49:02.333330] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T19:49:02.358019] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-17T19:49:02.917970] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-17T19:49:03.158032] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-17T19:49:03.877543] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:49:03.925130] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T19:49:03.957986] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-17T19:49:04.758122] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:49:04.758195] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-17T19:49:05.558032] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-17T19:49:05.779057] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T19:49:06.358014] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-17T19:49:06.461943] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T19:49:07.158028] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-17T19:49:07.958052] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-17T19:49:08.075907] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:49:08.215486] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T19:49:08.218331] [INFO ] [REMOTE ] KNOP: Full fetch complete (14668 records). [2025-10-17T19:49:08.218598] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-17T19:49:08.624901] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-17T19:49:08.624980] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-17T19:49:08.625323] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-17T19:49:08.625363] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-17T19:49:08.625884] [DEBUG] [LOCAL ] KNOP: Trimmed 14668 records to 10627 (keeping 200 days of data) [2025-10-17T19:49:08.686363] [DEBUG] [LOCAL ] KNOP: Primary data saved (10627 records). [2025-10-17T19:49:08.686510] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-17T19:49:08.686593] [INFO ] [MAIN ] Update Progress: 1205/2368 symbols completed. KNOP took 24.1s. Estimated remaining: 2h 43m 11s. Rate: 7.1 symbols/min [2025-10-17T19:49:08.763837] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-17T19:49:08.864123] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:08.864309] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-17T19:49:08.864347] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-17T19:49:08.864463] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-17T19:49:08.864505] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-17T19:49:08.864545] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-17T19:49:08.864577] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-17T19:49:09.240030] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:09.254089] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:49:09.558032] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-17T19:49:10.358012] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-17T19:49:10.479763] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:49:10.599481] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T19:49:11.158044] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-17T19:49:11.958051] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-17T19:49:12.245189] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T19:49:12.758020] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-17T19:49:13.067451] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-17T19:49:13.542005] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T19:49:13.557985] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-17T19:49:13.930221] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T19:49:14.358053] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-17T19:49:15.158031] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-17T19:49:15.368617] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:49:15.958082] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-17T19:49:16.198265] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-17T19:49:16.758057] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-17T19:49:16.789405] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T19:49:16.837187] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T19:49:17.558046] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-17T19:49:18.358055] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-17T19:49:18.488590] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:49:19.092150] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:49:19.158025] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-17T19:49:19.958074] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-17T19:49:20.536299] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T19:49:20.758004] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-17T19:49:20.859363] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:49:21.424580] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:49:21.558016] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-17T19:49:22.358066] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-17T19:49:23.158004] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-17T19:49:23.330811] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:49:23.395337] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-17T19:49:23.480227] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T19:49:23.483939] [INFO ] [REMOTE ] KNSL: Full fetch complete (27159 records). [2025-10-17T19:49:23.484050] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-17T19:49:23.875345] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-17T19:49:23.875436] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-17T19:49:23.876006] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-17T19:49:23.876067] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-17T19:49:23.876811] [DEBUG] [LOCAL ] KNSL: Trimmed 27159 records to 18750 (keeping 200 days of data) [2025-10-17T19:49:23.959225] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-17T19:49:24.000142] [DEBUG] [LOCAL ] KNSL: Primary data saved (18750 records). [2025-10-17T19:49:24.000327] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-17T19:49:24.000468] [INFO ] [MAIN ] Update Progress: 1206/2368 symbols completed. KNSL took 36.3s. Estimated remaining: 2h 43m 9s. Rate: 7.1 symbols/min [2025-10-17T19:49:24.187906] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:24.233517] [DEBUG] [LOCAL ] KODK: Loaded 44120 existing records from primary storage. [2025-10-17T19:49:24.233844] [INFO ] [MAIN ] KODK: Loaded 44120 existing records. [2025-10-17T19:49:24.447737] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:24.448091] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-17T19:49:24.448157] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-17T19:49:24.448595] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-17T19:49:24.448704] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-17T19:49:24.771765] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-17T19:49:24.854635] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:24.886374] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:49:25.558084] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-17T19:49:25.665592] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:49:26.358121] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-17T19:49:27.158089] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-17T19:49:27.370251] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T19:49:27.537542] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-17T19:49:27.958006] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-17T19:49:28.060204] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:49:28.758031] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-17T19:49:28.795800] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:49:29.558043] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-17T19:49:29.579557] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T19:49:29.587524] [INFO ] [REMOTE ] KNX: Full fetch complete (76244 records). [2025-10-17T19:49:29.587729] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-17T19:49:29.988025] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-17T19:49:29.988134] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-17T19:49:29.989293] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-17T19:49:29.989384] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-17T19:49:29.991222] [DEBUG] [LOCAL ] KNX: Trimmed 76244 records to 53395 (keeping 200 days of data) [2025-10-17T19:49:30.260407] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-17T19:49:30.357470] [DEBUG] [LOCAL ] KNX: Primary data saved (53395 records). [2025-10-17T19:49:30.357594] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-17T19:49:30.357714] [INFO ] [MAIN ] Update Progress: 1207/2368 symbols completed. KNX took 36.3s. Estimated remaining: 2h 42m 59s. Rate: 7.1 symbols/min [2025-10-17T19:49:30.369259] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-17T19:49:30.532630] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:30.557524] [DEBUG] [LOCAL ] KOF: Loaded 26812 existing records from primary storage. [2025-10-17T19:49:30.557819] [INFO ] [MAIN ] KOF: Loaded 26812 existing records. [2025-10-17T19:49:30.743117] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:30.743348] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-17T19:49:30.743426] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-17T19:49:30.743996] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-17T19:49:30.744066] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-17T19:49:31.097432] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:31.123078] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:49:31.157985] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-17T19:49:31.958013] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-17T19:49:32.188553] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T19:49:32.195431] [INFO ] [REMOTE ] KNTK: Full fetch complete (65652 records). [2025-10-17T19:49:32.195557] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-17T19:49:32.578357] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T19:49:32.622555] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-17T19:49:32.622728] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-17T19:49:32.623732] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-17T19:49:32.623796] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-17T19:49:32.625281] [DEBUG] [LOCAL ] KNTK: Trimmed 65652 records to 47788 (keeping 200 days of data) [2025-10-17T19:49:32.798718] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-17T19:49:32.916768] [DEBUG] [LOCAL ] KNTK: Primary data saved (47788 records). [2025-10-17T19:49:32.916938] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-17T19:49:32.917513] [INFO ] [MAIN ] Update Progress: 1208/2368 symbols completed. KNTK took 43.4s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-17T19:49:33.098531] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T19:49:33.100899] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:33.124230] [DEBUG] [LOCAL ] KOP: Loaded 17544 existing records from primary storage. [2025-10-17T19:49:33.124487] [INFO ] [MAIN ] KOP: Loaded 17544 existing records. [2025-10-17T19:49:33.298546] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:33.298773] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-17T19:49:33.298821] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-17T19:49:33.299233] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-17T19:49:33.299290] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-17T19:49:33.563109] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-17T19:49:33.650875] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:34.357994] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-17T19:49:34.393889] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T19:49:34.818281] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:49:35.158025] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-17T19:49:35.958038] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-17T19:49:36.207774] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:49:36.758038] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-17T19:49:36.860514] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-17T19:49:37.554346] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T19:49:37.563246] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-17T19:49:37.619183] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T19:49:38.358065] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-17T19:49:39.158030] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-17T19:49:39.397049] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:49:39.958095] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-17T19:49:40.338073] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-17T19:49:40.758009] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-17T19:49:40.806314] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T19:49:41.224575] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:49:41.558031] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-17T19:49:42.358074] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-17T19:49:42.856301] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T19:49:43.158057] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-17T19:49:43.319932] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T19:49:43.393171] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-17T19:49:43.958038] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-17T19:49:44.458465] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T19:49:44.758042] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-17T19:49:45.558045] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-17T19:49:45.978903] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T19:49:46.358077] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-17T19:49:46.710435] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-17T19:49:47.158055] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-17T19:49:47.393176] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T19:49:47.668721] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:49:47.958105] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-17T19:49:48.606700] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T19:49:48.758045] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-17T19:49:49.097910] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:49:49.249945] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T19:49:49.257561] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-17T19:49:49.257738] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-17T19:49:49.452925] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T19:49:49.453706] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:49:49.453782] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:49:49.453832] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-17T19:49:49.453910] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-17T19:49:49.453966] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-17T19:49:49.454009] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-17T19:49:49.454089] [INFO ] [MAIN ] Update Progress: 1209/2368 symbols completed. KO took 40.8s. Estimated remaining: 2h 42m 44s. Rate: 7.1 symbols/min [2025-10-17T19:49:49.558114] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-17T19:49:49.649096] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:49.653145] [DEBUG] [LOCAL ] KORE: Loaded 2182 existing records from primary storage. [2025-10-17T19:49:49.653312] [INFO ] [MAIN ] KORE: Loaded 2182 existing records. [2025-10-17T19:49:49.829060] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:49.829285] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-17T19:49:49.829333] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-17T19:49:49.829506] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-17T19:49:49.829584] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-17T19:49:50.207551] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:50.358111] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-17T19:49:50.911572] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:49:51.158289] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-17T19:49:51.678711] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T19:49:51.958025] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-17T19:49:52.532288] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T19:49:52.536843] [INFO ] [REMOTE ] KOF: Full fetch complete (38008 records). [2025-10-17T19:49:52.536964] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-17T19:49:52.763417] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-17T19:49:52.888296] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T19:49:52.985924] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-17T19:49:52.986050] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-17T19:49:52.987210] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-17T19:49:52.987277] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-17T19:49:52.988738] [DEBUG] [LOCAL ] KOF: Trimmed 38008 records to 26961 (keeping 200 days of data) [2025-10-17T19:49:53.158513] [DEBUG] [LOCAL ] KOF: Primary data saved (26961 records). [2025-10-17T19:49:53.158735] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-17T19:49:53.158918] [INFO ] [MAIN ] Update Progress: 1210/2368 symbols completed. KOF took 22.8s. Estimated remaining: 2h 42m 31s. Rate: 7.1 symbols/min [2025-10-17T19:49:53.331411] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:53.384799] [DEBUG] [LOCAL ] KOS: Loaded 53487 existing records from primary storage. [2025-10-17T19:49:53.385272] [INFO ] [MAIN ] KOS: Loaded 53487 existing records. [2025-10-17T19:49:53.564847] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-17T19:49:53.573260] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:53.574661] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-17T19:49:53.574744] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-17T19:49:53.575764] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-17T19:49:53.575828] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-17T19:49:53.910432] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T19:49:53.997118] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:54.358054] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-17T19:49:54.585358] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T19:49:54.842122] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T19:49:55.158070] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-17T19:49:55.958088] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-17T19:49:56.059708] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T19:49:56.332979] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-17T19:49:56.758091] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-17T19:49:57.558035] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-17T19:49:57.707458] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T19:49:57.980704] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T19:49:58.358096] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-17T19:49:58.789219] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T19:49:59.158068] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-17T19:49:59.958050] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-17T19:50:00.758031] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-17T19:50:01.492806] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:50:01.558084] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-17T19:50:01.856834] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-17T19:50:02.358049] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-17T19:50:03.158069] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-17T19:50:03.298946] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T19:50:03.626856] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:50:03.670276] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T19:50:03.958005] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-17T19:50:04.086371] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T19:50:04.401371] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:50:04.758038] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-17T19:50:05.558042] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-17T19:50:05.800829] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:50:05.803682] [INFO ] [REMOTE ] KOP: Full fetch complete (25427 records). [2025-10-17T19:50:05.803776] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-17T19:50:06.163819] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-17T19:50:06.163902] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-17T19:50:06.164418] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-17T19:50:06.164459] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-17T19:50:06.165142] [DEBUG] [LOCAL ] KOP: Trimmed 25427 records to 17674 (keeping 200 days of data) [2025-10-17T19:50:06.270896] [DEBUG] [LOCAL ] KOP: Primary data saved (17674 records). [2025-10-17T19:50:06.271041] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-17T19:50:06.271125] [INFO ] [MAIN ] Update Progress: 1211/2368 symbols completed. KOP took 33.4s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-17T19:50:06.366391] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-17T19:50:06.448320] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:06.498224] [DEBUG] [LOCAL ] KR: Loaded 54070 existing records from primary storage. [2025-10-17T19:50:06.498565] [INFO ] [MAIN ] KR: Loaded 54070 existing records. [2025-10-17T19:50:06.672111] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:06.672311] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-17T19:50:06.672358] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-17T19:50:06.672629] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-17T19:50:06.672714] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-17T19:50:06.931668] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:50:07.025119] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:07.157999] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-17T19:50:07.224865] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:50:07.958049] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-17T19:50:08.400506] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:50:08.758062] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-17T19:50:08.946514] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T19:50:09.558067] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-17T19:50:10.358036] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-17T19:50:10.509876] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:50:10.722943] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T19:50:10.952620] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T19:50:11.158041] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-17T19:50:11.958076] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-17T19:50:12.758029] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-17T19:50:13.090830] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T19:50:13.558071] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-17T19:50:13.832811] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:50:13.839562] [INFO ] [REMOTE ] KODK: Full fetch complete (63422 records). [2025-10-17T19:50:13.839756] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-17T19:50:14.227176] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-17T19:50:14.227299] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-17T19:50:14.228417] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-17T19:50:14.228503] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-17T19:50:14.230076] [DEBUG] [LOCAL ] KODK: Trimmed 63422 records to 44414 (keeping 200 days of data) [2025-10-17T19:50:14.392908] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-17T19:50:14.489304] [DEBUG] [LOCAL ] KODK: Primary data saved (44414 records). [2025-10-17T19:50:14.489519] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-17T19:50:14.489682] [INFO ] [MAIN ] Update Progress: 1212/2368 symbols completed. KODK took 50.5s. Estimated remaining: 2h 42m 19s. Rate: 7.1 symbols/min [2025-10-17T19:50:14.725309] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T19:50:14.729177] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:14.792705] [DEBUG] [LOCAL ] KRC: Loaded 48625 existing records from primary storage. [2025-10-17T19:50:14.793083] [INFO ] [MAIN ] KRC: Loaded 48625 existing records. [2025-10-17T19:50:14.981424] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:14.981690] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-17T19:50:14.981751] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-17T19:50:14.982356] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-17T19:50:14.982443] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-17T19:50:15.086842] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T19:50:15.088773] [INFO ] [REMOTE ] KORE: Full fetch complete (4747 records). [2025-10-17T19:50:15.089227] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-17T19:50:15.190690] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-17T19:50:15.702368] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:15.766227] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-17T19:50:15.766432] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-17T19:50:15.766723] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-17T19:50:15.766826] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-17T19:50:15.767412] [DEBUG] [LOCAL ] KORE: Trimmed 4747 records to 2191 (keeping 200 days of data) [2025-10-17T19:50:15.808468] [DEBUG] [LOCAL ] KORE: Primary data saved (2191 records). [2025-10-17T19:50:15.808683] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-17T19:50:15.808993] [INFO ] [MAIN ] Update Progress: 1213/2368 symbols completed. KORE took 26.4s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-17T19:50:15.842051] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-17T19:50:15.967084] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-17T19:50:15.993295] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:16.027433] [DEBUG] [LOCAL ] KREF: Loaded 38221 existing records from primary storage. [2025-10-17T19:50:16.027758] [INFO ] [MAIN ] KREF: Loaded 38221 existing records. [2025-10-17T19:50:16.203003] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:16.203188] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-17T19:50:16.203237] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-17T19:50:16.204016] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-17T19:50:16.204077] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-17T19:50:16.551460] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:16.757986] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-17T19:50:17.206723] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T19:50:17.558022] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-17T19:50:17.999826] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T19:50:18.070628] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:50:18.358017] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-17T19:50:19.082530] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:50:19.157985] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-17T19:50:19.913859] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:50:19.957980] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-17T19:50:20.284038] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:50:20.758022] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-17T19:50:21.558026] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-17T19:50:21.806613] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T19:50:22.135348] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T19:50:22.358101] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-17T19:50:23.158065] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-17T19:50:23.225088] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T19:50:23.863533] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:50:23.958022] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-17T19:50:24.758008] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-17T19:50:25.006866] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:50:25.558017] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-17T19:50:25.664931] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T19:50:26.358096] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-17T19:50:26.570560] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:50:26.879521] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:50:27.158139] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-17T19:50:27.958019] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-17T19:50:28.192432] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T19:50:28.758036] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-17T19:50:29.021356] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T19:50:29.558032] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-17T19:50:29.598202] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:50:30.358021] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-17T19:50:30.714864] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T19:50:31.158003] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-17T19:50:31.257566] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:50:31.958038] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-17T19:50:32.188426] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T19:50:32.264211] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:50:32.271610] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-17T19:50:32.271786] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-17T19:50:32.693232] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-17T19:50:32.693307] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-17T19:50:32.694322] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-17T19:50:32.694385] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-17T19:50:32.695766] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 54460 (keeping 200 days of data) [2025-10-17T19:50:32.759701] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-17T19:50:33.031522] [DEBUG] [LOCAL ] KR: Primary data saved (54460 records). [2025-10-17T19:50:33.031677] [INFO ] [MAIN ] KR: Full history saved. [2025-10-17T19:50:33.032352] [INFO ] [MAIN ] Update Progress: 1214/2368 symbols completed. KR took 26.8s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-17T19:50:33.206871] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:33.250140] [DEBUG] [LOCAL ] KRG: Loaded 49661 existing records from primary storage. [2025-10-17T19:50:33.250432] [INFO ] [MAIN ] KRG: Loaded 49661 existing records. [2025-10-17T19:50:33.420462] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:50:33.457516] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:33.457956] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-17T19:50:33.458012] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-17T19:50:33.458892] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-17T19:50:33.458951] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-17T19:50:33.561713] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-17T19:50:33.814825] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:34.358010] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-17T19:50:34.541242] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:50:34.711360] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:50:35.158036] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-17T19:50:35.810514] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:50:35.958003] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-17T19:50:36.758018] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-17T19:50:36.908576] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:50:37.365732] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:50:37.558001] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-17T19:50:38.358032] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-17T19:50:38.624298] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:50:38.631725] [INFO ] [REMOTE ] KOS: Full fetch complete (77038 records). [2025-10-17T19:50:38.631864] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-17T19:50:39.017917] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-17T19:50:39.018025] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-17T19:50:39.019181] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-17T19:50:39.019269] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-17T19:50:39.020956] [DEBUG] [LOCAL ] KOS: Trimmed 77038 records to 53875 (keeping 200 days of data) [2025-10-17T19:50:39.182552] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-17T19:50:39.357041] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T19:50:39.387315] [DEBUG] [LOCAL ] KOS: Primary data saved (53875 records). [2025-10-17T19:50:39.387484] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-17T19:50:39.387567] [INFO ] [MAIN ] Update Progress: 1215/2368 symbols completed. KOS took 46.2s. Estimated remaining: 2h 41m 53s. Rate: 7.1 symbols/min [2025-10-17T19:50:39.553325] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:39.553579] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-17T19:50:39.553669] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-17T19:50:39.553871] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-17T19:50:39.553920] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-17T19:50:39.553965] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-17T19:50:39.553997] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-17T19:50:39.860245] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:50:39.935516] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:39.958002] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-17T19:50:40.157148] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:50:40.157405] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-17T19:50:40.157497] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:50:40.157543] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-17T19:50:40.157576] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:50:40.157612] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-17T19:50:40.157698] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-17T19:50:40.157754] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-17T19:50:40.157796] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-17T19:50:40.157842] [INFO ] [MAIN ] Update Progress: 1216/2368 symbols completed. KRMN took 0.8s. Estimated remaining: 2h 41m 37s. Rate: 7.1 symbols/min [2025-10-17T19:50:40.332637] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:40.357753] [DEBUG] [LOCAL ] KRO: Loaded 26679 existing records from primary storage. [2025-10-17T19:50:40.358036] [INFO ] [MAIN ] KRO: Loaded 26679 existing records. [2025-10-17T19:50:40.534487] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:40.534741] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-17T19:50:40.534795] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-17T19:50:40.535265] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-17T19:50:40.535322] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-17T19:50:40.773056] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-17T19:50:40.909541] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:40.942552] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:50:41.558048] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-17T19:50:42.320157] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T19:50:42.358057] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-17T19:50:42.387038] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T19:50:43.158107] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-17T19:50:43.939111] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:50:43.958015] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-17T19:50:44.000996] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T19:50:44.758065] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-17T19:50:45.509273] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T19:50:45.557994] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-17T19:50:46.358030] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-17T19:50:46.390168] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:50:47.158059] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-17T19:50:47.270008] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T19:50:47.295379] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:50:47.958084] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-17T19:50:48.758072] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-17T19:50:48.796125] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T19:50:48.803343] [INFO ] [REMOTE ] KRC: Full fetch complete (70075 records). [2025-10-17T19:50:48.803511] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-17T19:50:49.202877] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-17T19:50:49.203011] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-17T19:50:49.204026] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-17T19:50:49.204178] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-17T19:50:49.205684] [DEBUG] [LOCAL ] KRC: Trimmed 70075 records to 48982 (keeping 200 days of data) [2025-10-17T19:50:49.334839] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:50:49.534805] [DEBUG] [LOCAL ] KRC: Primary data saved (48982 records). [2025-10-17T19:50:49.534940] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-17T19:50:49.535022] [INFO ] [MAIN ] Update Progress: 1217/2368 symbols completed. KRC took 35.0s. Estimated remaining: 2h 41m 30s. Rate: 7.1 symbols/min [2025-10-17T19:50:49.564078] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-17T19:50:49.706291] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:49.740356] [DEBUG] [LOCAL ] KRP: Loaded 36597 existing records from primary storage. [2025-10-17T19:50:49.740625] [INFO ] [MAIN ] KRP: Loaded 36597 existing records. [2025-10-17T19:50:49.914917] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:49.915116] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-17T19:50:49.915162] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-17T19:50:49.915835] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-17T19:50:49.915893] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-17T19:50:50.273716] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:50.357985] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-17T19:50:50.481678] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:50:50.612467] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T19:50:51.158041] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-17T19:50:51.663846] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:50:51.958012] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-17T19:50:52.336352] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T19:50:52.342167] [INFO ] [REMOTE ] KREF: Full fetch complete (52837 records). [2025-10-17T19:50:52.342263] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-17T19:50:52.713150] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-17T19:50:52.713227] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-17T19:50:52.714074] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-17T19:50:52.714135] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-17T19:50:52.715214] [DEBUG] [LOCAL ] KREF: Trimmed 52837 records to 38479 (keeping 200 days of data) [2025-10-17T19:50:52.765214] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-17T19:50:52.948917] [DEBUG] [LOCAL ] KREF: Primary data saved (38479 records). [2025-10-17T19:50:52.949045] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-17T19:50:52.949128] [INFO ] [MAIN ] Update Progress: 1218/2368 symbols completed. KREF took 37.1s. Estimated remaining: 2h 41m 17s. Rate: 7.1 symbols/min [2025-10-17T19:50:53.120045] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:53.133203] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T19:50:53.183737] [DEBUG] [LOCAL ] KSS: Loaded 53983 existing records from primary storage. [2025-10-17T19:50:53.184069] [INFO ] [MAIN ] KSS: Loaded 53983 existing records. [2025-10-17T19:50:53.357285] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:53.357536] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-17T19:50:53.357594] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-17T19:50:53.358407] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-17T19:50:53.358464] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-17T19:50:53.564416] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-17T19:50:53.712255] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:54.183468] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:50:54.358020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-17T19:50:54.773880] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T19:50:55.158022] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-17T19:50:55.508755] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T19:50:55.958026] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-17T19:50:56.759032] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-17T19:50:56.764768] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:50:57.558045] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-17T19:50:57.602033] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:50:57.997948] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T19:50:58.357999] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-17T19:50:59.158024] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-17T19:50:59.391922] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T19:50:59.958021] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-17T19:51:00.056986] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:51:00.330830] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T19:51:00.758079] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-17T19:51:01.558043] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-17T19:51:01.996604] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T19:51:02.358034] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-17T19:51:02.543463] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T19:51:03.007384] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-17T19:51:03.158068] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-17T19:51:03.855083] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T19:51:03.958003] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-17T19:51:04.757995] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-17T19:51:05.226953] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T19:51:05.389390] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:51:05.558026] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-17T19:51:06.370434] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-17T19:51:06.373392] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:51:07.158001] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-17T19:51:07.246689] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:51:07.253800] [INFO ] [REMOTE ] KRG: Full fetch complete (71325 records). [2025-10-17T19:51:07.253923] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-17T19:51:07.660385] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-17T19:51:07.660493] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-17T19:51:07.661707] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-17T19:51:07.661796] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-17T19:51:07.663345] [DEBUG] [LOCAL ] KRG: Trimmed 71325 records to 50023 (keeping 200 days of data) [2025-10-17T19:51:07.775182] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T19:51:07.969158] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-17T19:51:08.008299] [DEBUG] [LOCAL ] KRG: Primary data saved (50023 records). [2025-10-17T19:51:08.008487] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-17T19:51:08.009206] [INFO ] [MAIN ] Update Progress: 1219/2368 symbols completed. KRG took 35.0s. Estimated remaining: 2h 41m 15s. Rate: 7.1 symbols/min [2025-10-17T19:51:08.183084] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:08.227860] [DEBUG] [LOCAL ] KT: Loaded 45863 existing records from primary storage. [2025-10-17T19:51:08.228208] [INFO ] [MAIN ] KT: Loaded 45863 existing records. [2025-10-17T19:51:08.408501] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:08.408748] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-17T19:51:08.408801] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-17T19:51:08.409509] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-17T19:51:08.409567] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-17T19:51:08.758966] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-17T19:51:08.772900] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:09.222257] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T19:51:09.489849] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:51:09.557997] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-17T19:51:09.958362] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:51:10.358011] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-17T19:51:10.772315] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:51:11.158029] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-17T19:51:11.570577] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T19:51:11.574497] [INFO ] [REMOTE ] KRO: Full fetch complete (35304 records). [2025-10-17T19:51:11.574577] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-17T19:51:11.947957] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-17T19:51:11.948266] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-17T19:51:11.948962] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-17T19:51:11.949023] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-17T19:51:11.949868] [DEBUG] [LOCAL ] KRO: Trimmed 35304 records to 26887 (keeping 200 days of data) [2025-10-17T19:51:11.997546] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-17T19:51:12.109906] [DEBUG] [LOCAL ] KRO: Primary data saved (26887 records). [2025-10-17T19:51:12.110047] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-17T19:51:12.110134] [INFO ] [MAIN ] Update Progress: 1220/2368 symbols completed. KRO took 32.0s. Estimated remaining: 2h 41m 2s. Rate: 7.1 symbols/min [2025-10-17T19:51:12.303528] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:12.341414] [DEBUG] [LOCAL ] KTB: Loaded 40757 existing records from primary storage. [2025-10-17T19:51:12.341739] [INFO ] [MAIN ] KTB: Loaded 40757 existing records. [2025-10-17T19:51:12.531927] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:12.532202] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-17T19:51:12.532250] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-17T19:51:12.533186] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-17T19:51:12.533247] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-17T19:51:12.779294] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-17T19:51:12.901528] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:13.044559] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T19:51:13.491520] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:51:13.558010] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-17T19:51:14.033475] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:51:14.358033] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-17T19:51:15.158027] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-17T19:51:15.456900] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T19:51:15.963739] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-17T19:51:15.981034] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:51:16.244235] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:51:16.758045] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-17T19:51:17.273538] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:51:17.558046] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-17T19:51:18.154983] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T19:51:18.358020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-17T19:51:18.756311] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T19:51:19.158006] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-17T19:51:19.683045] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:51:19.958069] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-17T19:51:20.170002] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:51:20.758138] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-17T19:51:21.295527] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T19:51:21.300462] [INFO ] [REMOTE ] KRP: Full fetch complete (55054 records). [2025-10-17T19:51:21.300590] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-17T19:51:21.567201] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-17T19:51:21.687038] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-17T19:51:21.687136] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-17T19:51:21.688158] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-17T19:51:21.688226] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-17T19:51:21.689618] [DEBUG] [LOCAL ] KRP: Trimmed 55054 records to 36833 (keeping 200 days of data) [2025-10-17T19:51:21.917135] [DEBUG] [LOCAL ] KRP: Primary data saved (36833 records). [2025-10-17T19:51:21.917310] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-17T19:51:21.917490] [INFO ] [MAIN ] Update Progress: 1221/2368 symbols completed. KRP took 32.4s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-17T19:51:22.114708] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:22.129602] [DEBUG] [LOCAL ] KTF: Loaded 11841 existing records from primary storage. [2025-10-17T19:51:22.129920] [INFO ] [MAIN ] KTF: Loaded 11841 existing records. [2025-10-17T19:51:22.335812] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:22.336212] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-17T19:51:22.336340] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-17T19:51:22.336784] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-17T19:51:22.336936] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-17T19:51:22.368934] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-17T19:51:22.477047] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:51:22.741387] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:23.099806] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:51:23.157985] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-17T19:51:23.957998] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-17T19:51:24.145876] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:51:24.276172] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T19:51:24.488775] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T19:51:24.758157] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-17T19:51:25.558023] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-17T19:51:26.358781] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-17T19:51:26.364250] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:51:26.390904] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:51:27.158143] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-17T19:51:27.958061] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-17T19:51:28.453217] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T19:51:28.519903] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:51:28.758134] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-17T19:51:29.563093] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-17T19:51:29.577992] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:51:29.964973] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:51:30.317926] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T19:51:30.357989] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-17T19:51:31.158034] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-17T19:51:31.307327] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T19:51:31.958064] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-17T19:51:32.758092] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-17T19:51:32.818500] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T19:51:33.540900] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:51:33.557974] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-17T19:51:34.358022] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-17T19:51:34.687180] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T19:51:35.067845] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T19:51:35.158044] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-17T19:51:35.713302] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T19:51:35.958067] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-17T19:51:36.758054] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-17T19:51:36.876999] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T19:51:36.924135] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T19:51:37.558027] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-17T19:51:38.358031] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-17T19:51:38.453577] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T19:51:38.513344] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T19:51:38.520733] [INFO ] [REMOTE ] KSS: Full fetch complete (77754 records). [2025-10-17T19:51:38.520912] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-17T19:51:38.966727] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-17T19:51:38.966819] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-17T19:51:38.967880] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-17T19:51:38.967947] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-17T19:51:38.969449] [DEBUG] [LOCAL ] KSS: Trimmed 77754 records to 54372 (keeping 200 days of data) [2025-10-17T19:51:39.179324] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-17T19:51:39.298741] [DEBUG] [LOCAL ] KSS: Primary data saved (54372 records). [2025-10-17T19:51:39.298874] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-17T19:51:39.298953] [INFO ] [MAIN ] Update Progress: 1222/2368 symbols completed. KSS took 46.3s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-17T19:51:39.468779] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:39.468977] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-17T19:51:39.469028] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-17T19:51:39.469158] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-17T19:51:39.469228] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-17T19:51:39.469297] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-17T19:51:39.469341] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-17T19:51:39.845572] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:39.942558] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:51:39.957974] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-17T19:51:40.758030] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-17T19:51:41.137872] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T19:51:41.144029] [INFO ] [REMOTE ] KT: Full fetch complete (66872 records). [2025-10-17T19:51:41.144152] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-17T19:51:41.538579] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-17T19:51:41.538841] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T19:51:41.538939] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-17T19:51:41.540002] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-17T19:51:41.542023] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-17T19:51:41.543576] [DEBUG] [LOCAL ] KT: Trimmed 66872 records to 46205 (keeping 200 days of data) [2025-10-17T19:51:41.620858] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-17T19:51:41.663056] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:51:41.864395] [DEBUG] [LOCAL ] KT: Primary data saved (46205 records). [2025-10-17T19:51:41.864532] [INFO ] [MAIN ] KT: Full history saved. [2025-10-17T19:51:41.865257] [INFO ] [MAIN ] Update Progress: 1223/2368 symbols completed. KT took 33.9s. Estimated remaining: 2h 40m 41s. Rate: 7.1 symbols/min [2025-10-17T19:51:42.031754] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:42.087537] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-17T19:51:42.087926] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-10-17T19:51:42.298747] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:42.298966] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-17T19:51:42.299015] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-17T19:51:42.300268] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-17T19:51:42.300328] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-17T19:51:42.363366] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-17T19:51:42.619139] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:51:42.702095] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:43.158078] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-17T19:51:43.965869] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-17T19:51:43.971591] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T19:51:43.996124] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T19:51:44.758052] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-17T19:51:45.557998] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-17T19:51:45.667756] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T19:51:46.247948] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T19:51:46.253096] [INFO ] [REMOTE ] KTB: Full fetch complete (58271 records). [2025-10-17T19:51:46.253250] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-17T19:51:46.359208] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-17T19:51:46.656529] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T19:51:46.679715] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-17T19:51:46.679790] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-17T19:51:46.680845] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-17T19:51:46.680911] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-17T19:51:46.682284] [DEBUG] [LOCAL ] KTB: Trimmed 58271 records to 41064 (keeping 200 days of data) [2025-10-17T19:51:46.931314] [DEBUG] [LOCAL ] KTB: Primary data saved (41064 records). [2025-10-17T19:51:46.931444] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-17T19:51:46.931528] [INFO ] [MAIN ] Update Progress: 1224/2368 symbols completed. KTB took 34.8s. Estimated remaining: 2h 40m 30s. Rate: 7.1 symbols/min [2025-10-17T19:51:47.101788] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:47.156743] [DEBUG] [LOCAL ] KVYO: Loaded 51171 existing records from primary storage. [2025-10-17T19:51:47.157187] [INFO ] [MAIN ] KVYO: Loaded 51171 existing records. [2025-10-17T19:51:47.168506] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-17T19:51:47.345239] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:47.345511] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-17T19:51:47.345580] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-17T19:51:47.346393] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-17T19:51:47.346454] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-17T19:51:47.695892] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:47.958002] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-17T19:51:48.075735] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T19:51:48.134694] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:51:48.758094] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-17T19:51:49.534558] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:51:49.557981] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-17T19:51:50.097365] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T19:51:50.358041] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-17T19:51:51.149100] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T19:51:51.158034] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-17T19:51:51.958023] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-17T19:51:51.983225] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T19:51:52.176935] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T19:51:52.583026] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T19:51:52.758014] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-17T19:51:53.483715] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T19:51:53.485423] [INFO ] [REMOTE ] KTF: Full fetch complete (17366 records). [2025-10-17T19:51:53.485495] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-17T19:51:53.563150] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-17T19:51:53.864705] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-17T19:51:53.864790] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-17T19:51:53.865221] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-17T19:51:53.865295] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-17T19:51:53.865935] [DEBUG] [LOCAL ] KTF: Trimmed 17366 records to 11900 (keeping 200 days of data) [2025-10-17T19:51:53.936724] [DEBUG] [LOCAL ] KTF: Primary data saved (11900 records). [2025-10-17T19:51:53.936850] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-17T19:51:53.936940] [INFO ] [MAIN ] Update Progress: 1225/2368 symbols completed. KTF took 32.0s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-17T19:51:54.108001] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:54.146727] [DEBUG] [LOCAL ] KW: Loaded 40783 existing records from primary storage. [2025-10-17T19:51:54.147215] [INFO ] [MAIN ] KW: Loaded 40783 existing records. [2025-10-17T19:51:54.321887] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:54.322091] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-17T19:51:54.322138] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-17T19:51:54.322796] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-17T19:51:54.322853] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-17T19:51:54.365313] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-17T19:51:54.700750] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:55.158040] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-17T19:51:55.418289] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:51:55.694171] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T19:51:55.958026] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-17T19:51:56.766159] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-17T19:51:56.768769] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T19:51:57.279055] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T19:51:57.342553] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T19:51:57.558052] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-17T19:51:57.998340] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T19:51:58.358042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-17T19:51:59.158087] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-17T19:51:59.826799] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:51:59.958042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-17T19:52:00.758067] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-17T19:52:00.936174] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:52:01.558075] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-17T19:52:01.635324] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:52:02.358167] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-17T19:52:02.724242] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:52:03.158014] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-17T19:52:03.466573] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T19:52:03.582529] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T19:52:03.818294] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:52:03.958002] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-17T19:52:04.758044] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-17T19:52:05.186300] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-17T19:52:05.544814] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T19:52:05.557986] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-17T19:52:06.358056] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-17T19:52:07.021870] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T19:52:07.158050] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-17T19:52:07.363595] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:52:07.958047] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-17T19:52:08.001328] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T19:52:08.758042] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-17T19:52:09.558005] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-17T19:52:09.764362] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:52:09.823858] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T19:52:09.825903] [INFO ] [REMOTE ] KUKE: Full fetch complete (9008 records). [2025-10-17T19:52:09.826013] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-17T19:52:10.004500] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T19:52:10.004774] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:52:10.004846] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:52:10.004920] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-17T19:52:10.004986] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-17T19:52:10.005025] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-17T19:52:10.005066] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-17T19:52:10.005126] [INFO ] [MAIN ] Update Progress: 1226/2368 symbols completed. KUKE took 30.7s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-17T19:52:10.174723] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:10.191394] [DEBUG] [LOCAL ] KWR: Loaded 16172 existing records from primary storage. [2025-10-17T19:52:10.191625] [INFO ] [MAIN ] KWR: Loaded 16172 existing records. [2025-10-17T19:52:10.370671] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-17T19:52:10.376451] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:10.377284] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-17T19:52:10.377367] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-17T19:52:10.377802] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-17T19:52:10.377860] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-17T19:52:10.734990] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:11.158011] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-17T19:52:11.326324] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:52:11.958024] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-17T19:52:12.225484] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T19:52:12.758024] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-17T19:52:13.040795] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T19:52:13.558032] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-17T19:52:13.596232] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:52:14.124696] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:52:14.358017] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-17T19:52:14.571833] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T19:52:15.158027] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-17T19:52:15.869313] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T19:52:15.957991] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-17T19:52:16.144022] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T19:52:16.758019] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-17T19:52:17.558003] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-17T19:52:17.722484] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:52:18.229713] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:52:18.259416] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T19:52:18.358028] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-17T19:52:19.158075] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-17T19:52:19.958041] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-17T19:52:20.613472] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T19:52:20.758042] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-17T19:52:20.910744] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T19:52:20.972812] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:52:21.558050] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-17T19:52:22.358041] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-17T19:52:22.918764] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:52:23.158043] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-17T19:52:23.201561] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-17T19:52:23.209096] [INFO ] [REMOTE ] KVUE: Full fetch complete (77842 records). [2025-10-17T19:52:23.209254] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-17T19:52:23.612213] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-17T19:52:23.612354] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-17T19:52:23.613418] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-17T19:52:23.613482] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-17T19:52:23.615010] [DEBUG] [LOCAL ] KVUE: Trimmed 77842 records to 54447 (keeping 200 days of data) [2025-10-17T19:52:23.959383] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-17T19:52:23.991933] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-17T19:52:23.992185] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-17T19:52:23.992919] [INFO ] [MAIN ] Update Progress: 1227/2368 symbols completed. KVUE took 42.1s. Estimated remaining: 2h 40m 15s. Rate: 7.1 symbols/min [2025-10-17T19:52:24.180194] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:24.214250] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T19:52:24.252721] [DEBUG] [LOCAL ] KYN: Loaded 30494 existing records from primary storage. [2025-10-17T19:52:24.253051] [INFO ] [MAIN ] KYN: Loaded 30494 existing records. [2025-10-17T19:52:24.453806] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:24.454008] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-17T19:52:24.454054] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-17T19:52:24.454693] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-17T19:52:24.454750] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-17T19:52:24.635688] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:52:24.722781] [INFO ] [REMOTE ] KW: Full fetch complete (57334 records). [2025-10-17T19:52:24.733681] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-17T19:52:24.772673] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-17T19:52:24.907432] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:25.227204] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:52:25.250690] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-17T19:52:25.251029] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-17T19:52:25.251943] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-17T19:52:25.252004] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-17T19:52:25.253059] [DEBUG] [LOCAL ] KW: Trimmed 57334 records to 41091 (keeping 200 days of data) [2025-10-17T19:52:25.490986] [DEBUG] [LOCAL ] KW: Primary data saved (41091 records). [2025-10-17T19:52:25.491106] [INFO ] [MAIN ] KW: Full history saved. [2025-10-17T19:52:25.491183] [INFO ] [MAIN ] Update Progress: 1228/2368 symbols completed. KW took 31.6s. Estimated remaining: 2h 40m 0s. Rate: 7.1 symbols/min [2025-10-17T19:52:25.566972] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-17T19:52:25.666699] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:25.704370] [DEBUG] [LOCAL ] L: Loaded 41525 existing records from primary storage. [2025-10-17T19:52:25.704674] [INFO ] [MAIN ] L: Loaded 41525 existing records. [2025-10-17T19:52:25.882039] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:25.882232] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-17T19:52:25.882279] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-17T19:52:25.882813] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-17T19:52:25.882871] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-17T19:52:26.240250] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:26.358054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-17T19:52:26.785601] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T19:52:26.792834] [INFO ] [REMOTE ] KVYO: Full fetch complete (72101 records). [2025-10-17T19:52:26.792960] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-17T19:52:27.072102] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:52:27.164927] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-17T19:52:27.211716] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-17T19:52:27.211872] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-17T19:52:27.212928] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-17T19:52:27.212992] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-17T19:52:27.214356] [DEBUG] [LOCAL ] KVYO: Trimmed 72101 records to 51549 (keeping 200 days of data) [2025-10-17T19:52:27.435264] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:52:27.529337] [DEBUG] [LOCAL ] KVYO: Primary data saved (51549 records). [2025-10-17T19:52:27.529486] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-17T19:52:27.530028] [INFO ] [MAIN ] Update Progress: 1229/2368 symbols completed. KVYO took 40.6s. Estimated remaining: 2h 39m 46s. Rate: 7.1 symbols/min [2025-10-17T19:52:27.696502] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:27.746250] [DEBUG] [LOCAL ] LAC: Loaded 52900 existing records from primary storage. [2025-10-17T19:52:27.746625] [INFO ] [MAIN ] LAC: Loaded 52900 existing records. [2025-10-17T19:52:27.922896] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:27.923147] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-17T19:52:27.923194] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-17T19:52:27.923465] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-17T19:52:27.923502] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-17T19:52:27.966027] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-17T19:52:28.283427] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:28.731740] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:52:28.758007] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-17T19:52:28.997303] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:52:29.558043] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-17T19:52:29.893810] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:52:30.358085] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-17T19:52:31.157996] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-17T19:52:31.221787] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T19:52:31.589937] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T19:52:31.958012] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-17T19:52:32.758046] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-17T19:52:33.215611] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T19:52:33.254370] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T19:52:33.558019] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-17T19:52:33.799865] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T19:52:34.358045] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-17T19:52:35.158000] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-17T19:52:35.315994] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T19:52:35.479817] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T19:52:35.958024] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-17T19:52:36.397360] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:52:36.758037] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-17T19:52:37.371446] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:52:37.558029] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-17T19:52:38.190410] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:52:38.358000] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-17T19:52:38.751814] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T19:52:39.158011] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-17T19:52:39.183598] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T19:52:39.958084] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-17T19:52:40.708566] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T19:52:40.757999] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-17T19:52:41.374072] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:52:41.558028] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-17T19:52:42.298142] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T19:52:42.357994] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-17T19:52:43.158040] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-17T19:52:43.226170] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:52:43.228230] [INFO ] [REMOTE ] KWR: Full fetch complete (23366 records). [2025-10-17T19:52:43.228300] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-17T19:52:43.628985] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-17T19:52:43.649677] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-17T19:52:43.650030] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-17T19:52:43.650882] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-17T19:52:43.650950] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-17T19:52:43.651613] [DEBUG] [LOCAL ] KWR: Trimmed 23366 records to 16242 (keeping 200 days of data) [2025-10-17T19:52:43.752846] [DEBUG] [LOCAL ] KWR: Primary data saved (16242 records). [2025-10-17T19:52:43.752960] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-17T19:52:43.753042] [INFO ] [MAIN ] Update Progress: 1230/2368 symbols completed. KWR took 33.7s. Estimated remaining: 2h 39m 45s. Rate: 7.1 symbols/min [2025-10-17T19:52:43.931125] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:43.957100] [DEBUG] [LOCAL ] LAD: Loaded 23491 existing records from primary storage. [2025-10-17T19:52:43.957621] [INFO ] [MAIN ] LAD: Loaded 23491 existing records. [2025-10-17T19:52:43.969396] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-17T19:52:44.199960] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:44.200229] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-17T19:52:44.200305] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-17T19:52:44.200618] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-17T19:52:44.200720] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-17T19:52:44.705900] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:44.747243] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:52:44.758064] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-17T19:52:45.299947] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T19:52:45.558025] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-17T19:52:46.358130] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-17T19:52:46.698259] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T19:52:46.755682] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:52:47.125539] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T19:52:47.158040] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-17T19:52:47.958068] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-17T19:52:48.464254] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T19:52:48.758044] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-17T19:52:49.193803] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:52:49.200400] [INFO ] [REMOTE ] KYN: Full fetch complete (44569 records). [2025-10-17T19:52:49.200542] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-17T19:52:49.563176] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-17T19:52:49.606027] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-17T19:52:49.606115] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-17T19:52:49.606947] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-17T19:52:49.607012] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-17T19:52:49.608133] [DEBUG] [LOCAL ] KYN: Trimmed 44569 records to 30763 (keeping 200 days of data) [2025-10-17T19:52:49.798948] [DEBUG] [LOCAL ] KYN: Primary data saved (30763 records). [2025-10-17T19:52:49.799092] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-17T19:52:49.799626] [INFO ] [MAIN ] Update Progress: 1231/2368 symbols completed. KYN took 25.8s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-17T19:52:49.966252] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:50.003105] [DEBUG] [LOCAL ] LADR: Loaded 39688 existing records from primary storage. [2025-10-17T19:52:50.003425] [INFO ] [MAIN ] LADR: Loaded 39688 existing records. [2025-10-17T19:52:50.179946] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:50.180610] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-17T19:52:50.180765] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-17T19:52:50.181581] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-17T19:52:50.181670] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-17T19:52:50.361546] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-17T19:52:50.489436] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:52:50.582911] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:50.598689] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:52:51.158043] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-17T19:52:51.958080] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-17T19:52:52.496170] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T19:52:52.748701] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:52:52.758000] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-17T19:52:53.071766] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:52:53.558041] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-17T19:52:54.358079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-17T19:52:54.761727] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T19:52:54.857103] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T19:52:55.158062] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-17T19:52:55.881500] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T19:52:55.958044] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-17T19:52:56.522154] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:52:56.758090] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-17T19:52:57.558100] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-17T19:52:57.714396] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:52:58.046508] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T19:52:58.358064] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-17T19:52:58.890961] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T19:52:59.158107] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-17T19:52:59.958060] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-17T19:53:00.104372] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T19:53:00.271169] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:53:00.758071] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-17T19:53:01.558045] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-17T19:53:01.844556] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:53:02.358094] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-17T19:53:02.703630] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:53:03.158052] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-17T19:53:03.678819] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T19:53:03.684691] [INFO ] [REMOTE ] L: Full fetch complete (59466 records). [2025-10-17T19:53:03.684844] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-17T19:53:03.961506] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-17T19:53:04.085794] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-17T19:53:04.085985] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-17T19:53:04.086957] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-17T19:53:04.087102] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-17T19:53:04.116090] [DEBUG] [LOCAL ] L: Trimmed 59466 records to 41844 (keeping 200 days of data) [2025-10-17T19:53:04.118191] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-17T19:53:04.377546] [DEBUG] [LOCAL ] L: Primary data saved (41844 records). [2025-10-17T19:53:04.377698] [INFO ] [MAIN ] L: Full history saved. [2025-10-17T19:53:04.377789] [INFO ] [MAIN ] Update Progress: 1232/2368 symbols completed. L took 38.9s. Estimated remaining: 2h 39m 32s. Rate: 7.1 symbols/min [2025-10-17T19:53:04.546091] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:04.573807] [DEBUG] [LOCAL ] LANV: Loaded 2789 existing records from primary storage. [2025-10-17T19:53:04.574723] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T19:53:04.583795] [INFO ] [MAIN ] LANV: Loaded 2789 existing records. [2025-10-17T19:53:04.756243] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:04.756453] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-17T19:53:04.756500] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-17T19:53:04.756675] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-17T19:53:04.756748] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-17T19:53:04.767567] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-17T19:53:05.121086] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:05.240730] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T19:53:05.558039] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-17T19:53:06.141201] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T19:53:06.358021] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-17T19:53:06.886202] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T19:53:06.935853] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T19:53:07.158101] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-17T19:53:07.958053] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-17T19:53:08.500876] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T19:53:08.758073] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-17T19:53:09.558032] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-17T19:53:09.823200] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T19:53:10.216366] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T19:53:10.358012] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-17T19:53:10.925148] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:53:11.158038] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-17T19:53:11.958028] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-17T19:53:12.415272] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T19:53:12.741380] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:53:12.757984] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-17T19:53:13.284281] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-17T19:53:13.292746] [INFO ] [REMOTE ] LAC: Full fetch complete (76135 records). [2025-10-17T19:53:13.292929] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-17T19:53:13.563733] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-17T19:53:13.718995] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-17T19:53:13.719139] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-17T19:53:13.720612] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-17T19:53:13.720719] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-17T19:53:13.722824] [DEBUG] [LOCAL ] LAC: Trimmed 76135 records to 53290 (keeping 200 days of data) [2025-10-17T19:53:13.859161] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T19:53:14.091151] [DEBUG] [LOCAL ] LAC: Primary data saved (53290 records). [2025-10-17T19:53:14.091359] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-17T19:53:14.092055] [INFO ] [MAIN ] Update Progress: 1233/2368 symbols completed. LAC took 46.6s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-17T19:53:14.270459] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:14.271018] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-17T19:53:14.271076] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-17T19:53:14.271297] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-17T19:53:14.271517] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-17T19:53:14.271590] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-17T19:53:14.271637] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-17T19:53:14.365330] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-17T19:53:14.645976] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:14.685270] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T19:53:14.877855] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T19:53:15.158022] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-17T19:53:15.354162] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:53:15.354442] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-17T19:53:15.354530] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:53:15.354577] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-17T19:53:15.354625] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:53:15.354734] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-17T19:53:15.354819] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-17T19:53:15.354868] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-17T19:53:15.354970] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-17T19:53:15.355039] [INFO ] [MAIN ] Update Progress: 1234/2368 symbols completed. LAR took 1.3s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-17T19:53:15.520876] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:15.535670] [DEBUG] [LOCAL ] LAW: Loaded 14781 existing records from primary storage. [2025-10-17T19:53:15.535911] [INFO ] [MAIN ] LAW: Loaded 14781 existing records. [2025-10-17T19:53:15.709708] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:15.709918] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-17T19:53:15.709965] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-17T19:53:15.710560] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-17T19:53:15.710618] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-17T19:53:15.963203] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-17T19:53:16.058138] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:16.758035] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-17T19:53:17.217775] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T19:53:17.221582] [INFO ] [REMOTE ] LAD: Full fetch complete (35388 records). [2025-10-17T19:53:17.221757] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-17T19:53:17.436343] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-17T19:53:17.563119] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-17T19:53:17.627549] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-17T19:53:17.627628] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-17T19:53:17.628359] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-17T19:53:17.628410] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-17T19:53:17.629237] [DEBUG] [LOCAL ] LAD: Trimmed 35388 records to 23663 (keeping 200 days of data) [2025-10-17T19:53:17.775207] [DEBUG] [LOCAL ] LAD: Primary data saved (23663 records). [2025-10-17T19:53:17.775337] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-17T19:53:17.775417] [INFO ] [MAIN ] Update Progress: 1235/2368 symbols completed. LAD took 34.0s. Estimated remaining: 2h 38m 55s. Rate: 7.1 symbols/min [2025-10-17T19:53:17.942442] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:17.981588] [DEBUG] [LOCAL ] LAZ: Loaded 44986 existing records from primary storage. [2025-10-17T19:53:17.981910] [INFO ] [MAIN ] LAZ: Loaded 44986 existing records. [2025-10-17T19:53:18.153182] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:18.153433] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-17T19:53:18.153481] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-17T19:53:18.154292] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-17T19:53:18.154350] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-17T19:53:18.363186] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-17T19:53:18.513541] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:18.674320] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:53:19.158009] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-17T19:53:19.294703] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T19:53:19.958002] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-17T19:53:20.468223] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:53:20.474066] [INFO ] [REMOTE ] LADR: Full fetch complete (55676 records). [2025-10-17T19:53:20.474192] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-17T19:53:20.767063] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-17T19:53:20.869567] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T19:53:20.891782] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-17T19:53:20.891870] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-17T19:53:20.892793] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-17T19:53:20.892864] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-17T19:53:20.893977] [DEBUG] [LOCAL ] LADR: Trimmed 55676 records to 39947 (keeping 200 days of data) [2025-10-17T19:53:21.131491] [DEBUG] [LOCAL ] LADR: Primary data saved (39947 records). [2025-10-17T19:53:21.131638] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-17T19:53:21.132265] [INFO ] [MAIN ] Update Progress: 1236/2368 symbols completed. LADR took 31.3s. Estimated remaining: 2h 38m 42s. Rate: 7.1 symbols/min [2025-10-17T19:53:21.285097] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T19:53:21.306036] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:21.344460] [DEBUG] [LOCAL ] LB: Loaded 37609 existing records from primary storage. [2025-10-17T19:53:21.344807] [INFO ] [MAIN ] LB: Loaded 37609 existing records. [2025-10-17T19:53:21.523068] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:21.523292] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-17T19:53:21.523349] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-17T19:53:21.523979] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-17T19:53:21.524061] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-17T19:53:21.563219] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-17T19:53:21.875975] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:22.358056] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-17T19:53:22.411996] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T19:53:22.690150] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-17T19:53:23.158034] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-17T19:53:23.582490] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T19:53:23.958090] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-17T19:53:24.455001] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-17T19:53:24.758094] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-17T19:53:25.307461] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T19:53:25.558035] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-17T19:53:26.358009] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-17T19:53:26.927414] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T19:53:27.025738] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:53:27.158036] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-17T19:53:27.958087] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-17T19:53:28.745597] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T19:53:28.757984] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-17T19:53:29.469372] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:53:29.558017] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-17T19:53:29.746601] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T19:53:30.102743] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T19:53:30.103922] [INFO ] [REMOTE ] LANV: Full fetch complete (4253 records). [2025-10-17T19:53:30.104025] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-17T19:53:30.363281] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-17T19:53:30.479150] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-17T19:53:30.479242] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-17T19:53:30.479476] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-17T19:53:30.479542] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-17T19:53:30.479939] [DEBUG] [LOCAL ] LANV: Trimmed 4253 records to 2807 (keeping 200 days of data) [2025-10-17T19:53:30.496315] [DEBUG] [LOCAL ] LANV: Primary data saved (2807 records). [2025-10-17T19:53:30.496384] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-17T19:53:30.496500] [INFO ] [MAIN ] Update Progress: 1237/2368 symbols completed. LANV took 26.1s. Estimated remaining: 2h 38m 35s. Rate: 7.1 symbols/min [2025-10-17T19:53:31.158060] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-17T19:53:31.215740] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T19:53:31.958026] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-17T19:53:32.717187] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:53:32.757994] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-17T19:53:33.532401] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:53:33.557992] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-17T19:53:34.190936] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:53:34.358048] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-17T19:53:35.166090] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-17T19:53:35.184101] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:53:35.947857] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T19:53:35.957976] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-17T19:53:36.110234] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T19:53:36.758093] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-17T19:53:37.504567] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:53:37.558051] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-17T19:53:38.340516] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:53:38.357985] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-17T19:53:39.072857] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:53:39.158058] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-17T19:53:39.763010] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T19:53:39.794051] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T19:53:39.958057] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-17T19:53:40.758096] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-17T19:53:41.558551] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-17T19:53:41.558472] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T19:53:41.656819] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T19:53:42.358031] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-17T19:53:43.026615] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:53:43.158101] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-17T19:53:43.309083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:53:43.958085] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-17T19:53:44.758052] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-17T19:53:44.795406] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:53:44.949773] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T19:53:45.558071] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-17T19:53:46.132790] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:53:46.358077] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-17T19:53:46.986186] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:53:47.158023] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-17T19:53:47.845364] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:53:47.958074] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-17T19:53:48.057675] [DEBUG] [REMOTE ] LB: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T19:53:48.057894] [WARN ] [REMOTE ] LB: No data returned for month 2025-09 [2025-10-17T19:53:48.057999] [FATAL] [REMOTE ] LB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:53:48.058110] [FATAL] [MAIN ] LB: Failed to fetch primary data. [2025-10-17T19:53:48.058217] [WARN ] [MAIN ] LB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:53:48.058330] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-17T19:53:48.058409] [DEBUG] [LOCAL ] LB: No primary data file found to delete. [2025-10-17T19:53:48.058468] [INFO ] [LOCAL ] LB: Starting deletion of derivative data. [2025-10-17T19:53:48.058620] [DEBUG] [LOCAL ] LB: Deleted derivative data file. [2025-10-17T19:53:48.058770] [INFO ] [MAIN ] Update Progress: 1238/2368 symbols completed. LB took 26.9s. Estimated remaining: 2h 38m 35s. Rate: 7.1 symbols/min [2025-10-17T19:53:48.150895] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:53:48.153701] [INFO ] [REMOTE ] LAW: Full fetch complete (20903 records). [2025-10-17T19:53:48.153771] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-17T19:53:48.510778] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-17T19:53:48.510878] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-17T19:53:48.511316] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-17T19:53:48.511379] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-17T19:53:48.511965] [DEBUG] [LOCAL ] LAW: Trimmed 20903 records to 14898 (keeping 200 days of data) [2025-10-17T19:53:48.590853] [DEBUG] [LOCAL ] LAW: Primary data saved (14898 records). [2025-10-17T19:53:48.590981] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-17T19:53:48.591059] [INFO ] [MAIN ] Update Progress: 1239/2368 symbols completed. LAW took 33.2s. Estimated remaining: 2h 38m 19s. Rate: 7.1 symbols/min [2025-10-17T19:53:48.758053] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-17T19:53:50.207080] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T19:53:50.213017] [INFO ] [REMOTE ] LAZ: Full fetch complete (65551 records). [2025-10-17T19:53:50.213156] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-17T19:53:50.599567] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-17T19:53:50.599665] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-17T19:53:50.600575] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-17T19:53:50.600618] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-17T19:53:50.601845] [DEBUG] [LOCAL ] LAZ: Trimmed 65551 records to 45283 (keeping 200 days of data) [2025-10-17T19:53:50.886317] [DEBUG] [LOCAL ] LAZ: Primary data saved (45283 records). [2025-10-17T19:53:50.886504] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-17T19:53:50.886735] [INFO ] [MAIN ] Update Progress: 1240/2368 symbols completed. LAZ took 33.1s. Estimated remaining: 2h 38m 5s. Rate: 7.1 symbols/min [2025-10-17T19:53:51.549181] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.575713] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.550383] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.629050] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.672294] [DEBUG] [LOCAL ] LCII: Loaded 27611 existing records from primary storage. [2025-10-17T19:53:51.672607] [INFO ] [MAIN ] LCII: Loaded 27611 existing records. [2025-10-17T19:53:51.781852] [DEBUG] [LOCAL ] LDI: Loaded 45194 existing records from primary storage. [2025-10-17T19:53:51.800718] [INFO ] [MAIN ] LDI: Loaded 45194 existing records. [2025-10-17T19:53:52.044247] [DEBUG] [LOCAL ] LBRT: Loaded 53348 existing records from primary storage. [2025-10-17T19:53:52.043254] [DEBUG] [LOCAL ] LC: Loaded 48551 existing records from primary storage. [2025-10-17T19:53:52.059155] [INFO ] [MAIN ] LBRT: Loaded 53348 existing records. [2025-10-17T19:53:52.114260] [INFO ] [MAIN ] LC: Loaded 48551 existing records. [2025-10-17T19:53:52.157329] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.273785] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.372954] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-17T19:53:52.396480] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.421949] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-17T19:53:52.422130] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-17T19:53:52.428157] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.443843] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-17T19:53:52.529780] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-17T19:53:52.539537] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-17T19:53:52.642832] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.654210] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.716882] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.727592] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.717058] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-17T19:53:52.741842] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-17T19:53:52.753228] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-17T19:53:52.799188] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-17T19:53:52.799070] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-17T19:53:52.820165] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-17T19:53:53.735717] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:53.809999] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-17T19:53:54.031257] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:54.063523] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-17T19:53:54.101495] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:54.124462] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-17T19:53:54.171998] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:54.172345] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-17T19:53:55.026765] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T19:53:55.031326] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-17T19:53:55.698962] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:53:55.707239] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-17T19:53:55.766828] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T19:53:55.771682] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-17T19:53:55.843987] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:53:55.854101] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-17T19:53:55.893511] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T19:53:55.958051] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-17T19:53:56.939342] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T19:53:56.947124] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-17T19:53:56.988777] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T19:53:57.242318] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T19:53:57.552014] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:53:57.562052] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-17T19:53:57.895727] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T19:53:58.358044] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-17T19:53:58.868472] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:53:59.158049] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-17T19:53:59.899398] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:53:59.958056] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-17T19:54:00.758044] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-17T19:54:01.414132] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-17T19:54:01.558050] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-17T19:54:01.940797] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T19:54:02.358070] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-17T19:54:02.750168] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T19:54:03.158029] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-17T19:54:03.550541] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T19:54:03.643906] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:54:03.958059] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-17T19:54:04.766666] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-17T19:54:04.787455] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:54:05.558027] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-17T19:54:05.597145] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:54:06.358013] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-17T19:54:06.620368] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T19:54:07.157999] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-17T19:54:07.310960] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:54:07.489543] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:54:07.958029] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-17T19:54:08.575342] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:54:08.758004] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-17T19:54:09.543173] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:54:09.557979] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-17T19:54:10.055009] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T19:54:10.358026] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-17T19:54:10.948971] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:54:11.158052] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-17T19:54:11.844087] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:54:11.958043] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-17T19:54:12.758055] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-17T19:54:12.805016] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T19:54:13.557998] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-17T19:54:13.785531] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T19:54:14.358014] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-17T19:54:14.595855] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:54:14.757068] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T19:54:15.158071] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-17T19:54:15.958015] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-17T19:54:16.208520] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T19:54:16.758094] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-17T19:54:16.909043] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:54:17.558047] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-17T19:54:18.142318] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-17T19:54:18.217696] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:54:18.357993] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-17T19:54:19.158095] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-17T19:54:19.481054] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T19:54:19.703991] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T19:54:19.711813] [INFO ] [REMOTE ] LC: Full fetch complete (70694 records). [2025-10-17T19:54:19.711978] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-17T19:54:19.969018] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-17T19:54:20.107815] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-17T19:54:20.107901] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-17T19:54:20.108961] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-17T19:54:20.109029] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-17T19:54:20.110365] [DEBUG] [LOCAL ] LC: Trimmed 70694 records to 48927 (keeping 200 days of data) [2025-10-17T19:54:20.409596] [DEBUG] [LOCAL ] LC: Primary data saved (48927 records). [2025-10-17T19:54:20.410534] [INFO ] [MAIN ] LC: Full history saved. [2025-10-17T19:54:20.412476] [INFO ] [MAIN ] Update Progress: 1241/2368 symbols completed. LC took 29.5s. Estimated remaining: 2h 38m 16s. Rate: 7.1 symbols/min [2025-10-17T19:54:20.411813] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:54:20.585601] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:20.629554] [DEBUG] [LOCAL ] LDOS: Loaded 45271 existing records from primary storage. [2025-10-17T19:54:20.629866] [INFO ] [MAIN ] LDOS: Loaded 45271 existing records. [2025-10-17T19:54:20.764931] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-17T19:54:20.806117] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:20.806372] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-17T19:54:20.806438] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-17T19:54:20.806615] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-17T19:54:20.806698] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-17T19:54:21.161271] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:21.558041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-17T19:54:21.936682] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:54:22.086794] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-17T19:54:22.094180] [INFO ] [REMOTE ] LDI: Full fetch complete (61881 records). [2025-10-17T19:54:22.094316] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-17T19:54:22.363125] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-17T19:54:22.477370] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-17T19:54:22.477502] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-17T19:54:22.478707] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-17T19:54:22.478790] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-17T19:54:22.480424] [DEBUG] [LOCAL ] LDI: Trimmed 61881 records to 45582 (keeping 200 days of data) [2025-10-17T19:54:22.728019] [DEBUG] [LOCAL ] LDI: Primary data saved (45582 records). [2025-10-17T19:54:22.728197] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-17T19:54:22.728307] [INFO ] [MAIN ] Update Progress: 1242/2368 symbols completed. LDI took 31.8s. Estimated remaining: 2h 38m 2s. Rate: 7.1 symbols/min [2025-10-17T19:54:22.895313] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:22.909385] [DEBUG] [LOCAL ] LDP: Loaded 12892 existing records from primary storage. [2025-10-17T19:54:22.909690] [INFO ] [MAIN ] LDP: Loaded 12892 existing records. [2025-10-17T19:54:23.083416] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:23.083690] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-17T19:54:23.083824] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-17T19:54:23.084034] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-17T19:54:23.084090] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-17T19:54:23.161944] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-17T19:54:23.444565] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:23.473742] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T19:54:23.519818] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T19:54:23.523053] [INFO ] [REMOTE ] LCII: Full fetch complete (39126 records). [2025-10-17T19:54:23.523130] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-17T19:54:23.884745] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-17T19:54:23.884829] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-17T19:54:23.885553] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-17T19:54:23.885594] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-17T19:54:23.886451] [DEBUG] [LOCAL ] LCII: Trimmed 39126 records to 27730 (keeping 200 days of data) [2025-10-17T19:54:23.974731] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-17T19:54:24.058693] [DEBUG] [LOCAL ] LCII: Primary data saved (27730 records). [2025-10-17T19:54:24.058841] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-17T19:54:24.058926] [INFO ] [MAIN ] Update Progress: 1243/2368 symbols completed. LCII took 33.2s. Estimated remaining: 2h 37m 47s. Rate: 7.1 symbols/min [2025-10-17T19:54:24.221182] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:24.259710] [DEBUG] [LOCAL ] LEA: Loaded 41612 existing records from primary storage. [2025-10-17T19:54:24.260005] [INFO ] [MAIN ] LEA: Loaded 41612 existing records. [2025-10-17T19:54:24.434132] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:24.434380] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-17T19:54:24.434433] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-17T19:54:24.434724] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-17T19:54:24.434782] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-17T19:54:24.765525] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-17T19:54:24.796910] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:24.895807] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:54:24.915929] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T19:54:25.558021] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-17T19:54:26.185674] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:54:26.358074] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-17T19:54:27.158546] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T19:54:27.158620] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-17T19:54:27.697455] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T19:54:27.958060] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-17T19:54:28.056746] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:54:28.758036] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-17T19:54:29.558060] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-17T19:54:29.667228] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T19:54:30.306628] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T19:54:30.358080] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-17T19:54:30.501090] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:54:31.158050] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-17T19:54:31.917392] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:54:31.957986] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-17T19:54:32.012940] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T19:54:32.758015] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-17T19:54:33.446568] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:54:33.557994] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-17T19:54:34.358005] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-17T19:54:34.478362] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:54:35.016634] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T19:54:35.025606] [INFO ] [REMOTE ] LBRT: Full fetch complete (76908 records). [2025-10-17T19:54:35.025893] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-17T19:54:35.170732] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-17T19:54:35.436531] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-17T19:54:35.436637] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-17T19:54:35.438180] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-17T19:54:35.438272] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-17T19:54:35.440044] [DEBUG] [LOCAL ] LBRT: Trimmed 76908 records to 53738 (keeping 200 days of data) [2025-10-17T19:54:35.782033] [DEBUG] [LOCAL ] LBRT: Primary data saved (53738 records). [2025-10-17T19:54:35.782185] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-17T19:54:35.782292] [INFO ] [MAIN ] Update Progress: 1244/2368 symbols completed. LBRT took 44.9s. Estimated remaining: 2h 37m 42s. Rate: 7.1 symbols/min [2025-10-17T19:54:35.955680] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:35.958011] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-17T19:54:35.986106] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:54:36.037017] [DEBUG] [LOCAL ] LEG: Loaded 50533 existing records from primary storage. [2025-10-17T19:54:36.037334] [INFO ] [MAIN ] LEG: Loaded 50533 existing records. [2025-10-17T19:54:36.215873] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:36.216076] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-17T19:54:36.216125] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-17T19:54:36.216367] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-17T19:54:36.216427] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-17T19:54:36.566728] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:36.758006] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-17T19:54:36.914100] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T19:54:37.012867] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:54:37.558036] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-17T19:54:38.288887] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:54:38.358017] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-17T19:54:39.165576] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-17T19:54:39.188836] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:54:39.958320] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-17T19:54:39.961777] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T19:54:40.758039] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-17T19:54:40.855331] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T19:54:40.931448] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T19:54:41.558049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-17T19:54:42.192046] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:54:42.358162] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-17T19:54:43.075557] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:54:43.157995] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-17T19:54:43.207058] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T19:54:43.958049] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-17T19:54:44.758035] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-17T19:54:44.819440] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:54:45.520138] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T19:54:45.558006] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-17T19:54:45.679732] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T19:54:46.358100] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-17T19:54:46.922977] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T19:54:47.158071] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-17T19:54:47.957998] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-17T19:54:48.071282] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T19:54:48.735160] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T19:54:48.757986] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-17T19:54:48.832734] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T19:54:48.864395] [DEBUG] [REMOTE ] LEA: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T19:54:48.864770] [WARN ] [REMOTE ] LEA: No data returned for month 2025-09 [2025-10-17T19:54:48.864861] [FATAL] [REMOTE ] LEA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:54:48.864962] [FATAL] [MAIN ] LEA: Failed to fetch primary data. [2025-10-17T19:54:48.865043] [WARN ] [MAIN ] LEA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:54:48.865128] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-17T19:54:48.865210] [DEBUG] [LOCAL ] LEA: No primary data file found to delete. [2025-10-17T19:54:48.865263] [INFO ] [LOCAL ] LEA: Starting deletion of derivative data. [2025-10-17T19:54:48.865725] [DEBUG] [LOCAL ] LEA: Deleted derivative data file. [2025-10-17T19:54:48.866505] [INFO ] [MAIN ] Update Progress: 1245/2368 symbols completed. LEA took 24.8s. Estimated remaining: 2h 37m 38s. Rate: 7.1 symbols/min [2025-10-17T19:54:49.064372] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:49.123851] [DEBUG] [LOCAL ] LEN: Loaded 53584 existing records from primary storage. [2025-10-17T19:54:49.124247] [INFO ] [MAIN ] LEN: Loaded 53584 existing records. [2025-10-17T19:54:49.317070] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:49.317272] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-17T19:54:49.317318] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-17T19:54:49.317560] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-17T19:54:49.317605] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-17T19:54:49.563169] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-17T19:54:49.662975] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:50.358060] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-17T19:54:50.413620] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T19:54:51.158035] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-17T19:54:51.950560] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:54:51.959596] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-17T19:54:51.998326] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T19:54:52.000263] [INFO ] [REMOTE ] LDP: Full fetch complete (18901 records). [2025-10-17T19:54:52.000351] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-17T19:54:52.351711] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-17T19:54:52.351792] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-17T19:54:52.352151] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-17T19:54:52.352190] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-17T19:54:52.352753] [DEBUG] [LOCAL ] LDP: Trimmed 18901 records to 12949 (keeping 200 days of data) [2025-10-17T19:54:52.432735] [DEBUG] [LOCAL ] LDP: Primary data saved (12949 records). [2025-10-17T19:54:52.432860] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-17T19:54:52.432938] [INFO ] [MAIN ] Update Progress: 1246/2368 symbols completed. LDP took 29.7s. Estimated remaining: 2h 37m 25s. Rate: 7.1 symbols/min [2025-10-17T19:54:52.596869] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:52.614364] [DEBUG] [LOCAL ] LEO: Loaded 16748 existing records from primary storage. [2025-10-17T19:54:52.614579] [INFO ] [MAIN ] LEO: Loaded 16748 existing records. [2025-10-17T19:54:52.762269] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-17T19:54:52.791264] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:52.792228] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-17T19:54:52.792303] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-17T19:54:52.792514] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-17T19:54:52.792579] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-17T19:54:53.137871] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:53.558048] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-17T19:54:53.801741] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:54:54.198129] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T19:54:54.357998] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-17T19:54:54.499678] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T19:54:55.158050] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-17T19:54:55.295627] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T19:54:55.958043] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-17T19:54:56.764742] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-17T19:54:56.767492] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T19:54:57.059939] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T19:54:57.558099] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-17T19:54:58.358053] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-17T19:54:58.505999] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T19:54:58.547463] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:54:59.158067] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-17T19:54:59.935291] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:54:59.958016] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-17T19:55:00.758042] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-17T19:55:01.558020] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-17T19:55:01.747048] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T19:55:02.194524] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-17T19:55:02.358075] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-17T19:55:03.158029] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-17T19:55:03.324075] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-17T19:55:03.654893] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T19:55:03.661291] [INFO ] [REMOTE ] LDOS: Full fetch complete (67022 records). [2025-10-17T19:55:03.661512] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-17T19:55:03.965734] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-17T19:55:04.090275] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-17T19:55:04.090420] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-17T19:55:04.091602] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-17T19:55:04.091878] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-17T19:55:04.093589] [DEBUG] [LOCAL ] LDOS: Trimmed 67022 records to 45546 (keeping 200 days of data) [2025-10-17T19:55:04.321237] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T19:55:04.405190] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T19:55:04.456781] [DEBUG] [LOCAL ] LDOS: Primary data saved (45546 records). [2025-10-17T19:55:04.456912] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-17T19:55:04.457558] [INFO ] [MAIN ] Update Progress: 1247/2368 symbols completed. LDOS took 44.0s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-10-17T19:55:04.648776] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:04.698450] [DEBUG] [LOCAL ] LEVI: Loaded 52170 existing records from primary storage. [2025-10-17T19:55:04.698791] [INFO ] [MAIN ] LEVI: Loaded 52170 existing records. [2025-10-17T19:55:04.763201] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-17T19:55:04.879753] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:04.880039] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-17T19:55:04.880094] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-17T19:55:04.880365] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-17T19:55:04.880422] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-17T19:55:05.224194] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:05.558002] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-17T19:55:05.607730] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:55:06.358014] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-17T19:55:06.834554] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T19:55:07.151238] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:55:07.158002] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-17T19:55:07.958003] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-17T19:55:08.049754] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:55:08.185515] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:55:08.758024] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-17T19:55:09.558074] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-17T19:55:09.588723] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:55:10.358089] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-17T19:55:10.535924] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:55:10.542951] [INFO ] [REMOTE ] LEG: Full fetch complete (72979 records). [2025-10-17T19:55:10.543122] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-17T19:55:10.658101] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T19:55:10.949748] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-17T19:55:10.949843] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-17T19:55:10.950857] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-17T19:55:10.950964] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-17T19:55:10.952435] [DEBUG] [LOCAL ] LEG: Trimmed 72979 records to 50873 (keeping 200 days of data) [2025-10-17T19:55:11.161933] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-17T19:55:11.263919] [DEBUG] [LOCAL ] LEG: Primary data saved (50873 records). [2025-10-17T19:55:11.264068] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-17T19:55:11.264156] [INFO ] [MAIN ] Update Progress: 1248/2368 symbols completed. LEG took 35.5s. Estimated remaining: 2h 37m 10s. Rate: 7.1 symbols/min [2025-10-17T19:55:11.435017] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:11.453497] [DEBUG] [LOCAL ] LFT: Loaded 18440 existing records from primary storage. [2025-10-17T19:55:11.453759] [INFO ] [MAIN ] LFT: Loaded 18440 existing records. [2025-10-17T19:55:11.633263] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:11.633504] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-17T19:55:11.633553] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-17T19:55:11.633764] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-17T19:55:11.633822] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-17T19:55:11.963120] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-17T19:55:12.021518] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:12.057713] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T19:55:12.059215] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:55:12.758089] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-17T19:55:13.558044] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-17T19:55:13.687096] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:55:13.943913] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T19:55:14.358091] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-17T19:55:15.158003] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-17T19:55:15.234682] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:55:15.295038] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T19:55:15.297306] [INFO ] [REMOTE ] LEO: Full fetch complete (26460 records). [2025-10-17T19:55:15.297413] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-17T19:55:15.655332] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-17T19:55:15.655410] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-17T19:55:15.655972] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-17T19:55:15.656034] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-17T19:55:15.656915] [DEBUG] [LOCAL ] LEO: Trimmed 26460 records to 16814 (keeping 200 days of data) [2025-10-17T19:55:15.753009] [DEBUG] [LOCAL ] LEO: Primary data saved (16814 records). [2025-10-17T19:55:15.753151] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-17T19:55:15.753234] [INFO ] [MAIN ] Update Progress: 1249/2368 symbols completed. LEO took 23.3s. Estimated remaining: 2h 36m 58s. Rate: 7.1 symbols/min [2025-10-17T19:55:15.917052] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:15.928628] [DEBUG] [LOCAL ] LGI: Loaded 10147 existing records from primary storage. [2025-10-17T19:55:15.928851] [INFO ] [MAIN ] LGI: Loaded 10147 existing records. [2025-10-17T19:55:15.963191] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-17T19:55:16.108164] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:16.108347] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-17T19:55:16.108393] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-17T19:55:16.108629] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-17T19:55:16.108716] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-17T19:55:16.454245] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:16.758010] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-17T19:55:17.085468] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T19:55:17.086394] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:55:17.558052] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-17T19:55:17.569820] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:55:18.358053] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-17T19:55:18.552224] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T19:55:19.158023] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-17T19:55:19.926788] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:55:19.957980] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-17T19:55:20.758012] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-17T19:55:20.891491] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:55:21.558015] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-17T19:55:21.614140] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T19:55:21.950377] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T19:55:22.358093] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-17T19:55:23.091388] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T19:55:23.157998] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-17T19:55:23.296504] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T19:55:23.958012] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-17T19:55:23.968288] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T19:55:24.758110] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-17T19:55:25.523599] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T19:55:25.557982] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-17T19:55:25.947722] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T19:55:26.357999] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-17T19:55:26.525607] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T19:55:27.158093] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-17T19:55:27.958052] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-17T19:55:28.241035] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T19:55:28.643617] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-17T19:55:28.758050] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-17T19:55:29.475632] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T19:55:29.558002] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-17T19:55:29.638573] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:55:30.358060] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-17T19:55:30.686551] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T19:55:31.158052] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-17T19:55:31.953525] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T19:55:31.957976] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-17T19:55:32.656469] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-17T19:55:32.663782] [INFO ] [REMOTE ] LEN: Full fetch complete (77214 records). [2025-10-17T19:55:32.663909] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-17T19:55:32.758886] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-17T19:55:32.767126] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T19:55:33.062929] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-17T19:55:33.063021] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-17T19:55:33.064076] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-17T19:55:33.064144] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-17T19:55:33.065634] [DEBUG] [LOCAL ] LEN: Trimmed 77214 records to 53973 (keeping 200 days of data) [2025-10-17T19:55:33.396348] [DEBUG] [LOCAL ] LEN: Primary data saved (53973 records). [2025-10-17T19:55:33.396475] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-17T19:55:33.397063] [INFO ] [MAIN ] Update Progress: 1250/2368 symbols completed. LEN took 44.5s. Estimated remaining: 2h 36m 58s. Rate: 7.1 symbols/min [2025-10-17T19:55:33.562778] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:33.562878] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-17T19:55:33.600690] [DEBUG] [LOCAL ] LH: Loaded 37792 existing records from primary storage. [2025-10-17T19:55:33.600973] [INFO ] [MAIN ] LH: Loaded 37792 existing records. [2025-10-17T19:55:33.774394] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:33.774618] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-17T19:55:33.774696] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-17T19:55:33.774903] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-17T19:55:33.774958] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-17T19:55:34.013188] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T19:55:34.151110] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:34.173030] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T19:55:34.358050] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-17T19:55:35.158052] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-17T19:55:35.832188] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:55:35.957999] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-17T19:55:36.250529] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:55:36.758080] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-17T19:55:37.390597] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:55:37.558009] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-17T19:55:37.659688] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T19:55:38.358046] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-17T19:55:38.559023] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T19:55:39.158047] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-17T19:55:39.843844] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:55:39.865082] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T19:55:39.958080] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-17T19:55:40.758057] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-17T19:55:41.559390] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-17T19:55:41.561900] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T19:55:41.666165] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T19:55:41.668260] [INFO ] [REMOTE ] LGI: Full fetch complete (14492 records). [2025-10-17T19:55:41.668363] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-17T19:55:42.033331] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-17T19:55:42.033420] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-17T19:55:42.033786] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-17T19:55:42.033848] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-17T19:55:42.034372] [DEBUG] [LOCAL ] LGI: Trimmed 14492 records to 10171 (keeping 200 days of data) [2025-10-17T19:55:42.102417] [DEBUG] [LOCAL ] LGI: Primary data saved (10171 records). [2025-10-17T19:55:42.102546] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-17T19:55:42.102739] [INFO ] [MAIN ] Update Progress: 1251/2368 symbols completed. LGI took 26.3s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-17T19:55:42.270406] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:42.320716] [DEBUG] [LOCAL ] LHX: Loaded 48970 existing records from primary storage. [2025-10-17T19:55:42.321076] [INFO ] [MAIN ] LHX: Loaded 48970 existing records. [2025-10-17T19:55:42.363132] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-17T19:55:42.506998] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:42.507363] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-17T19:55:42.507530] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-17T19:55:42.516854] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-17T19:55:42.517766] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T19:55:42.517385] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-17T19:55:42.881131] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:43.158042] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-17T19:55:43.958018] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-17T19:55:44.050336] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:55:44.758051] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-17T19:55:44.871729] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:55:44.917623] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T19:55:44.920683] [INFO ] [REMOTE ] LFT: Full fetch complete (23964 records). [2025-10-17T19:55:44.920787] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-17T19:55:45.295109] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-17T19:55:45.295226] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-17T19:55:45.295777] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-17T19:55:45.295839] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-17T19:55:45.296566] [DEBUG] [LOCAL ] LFT: Trimmed 23964 records to 18518 (keeping 200 days of data) [2025-10-17T19:55:45.406962] [DEBUG] [LOCAL ] LFT: Primary data saved (18518 records). [2025-10-17T19:55:45.407097] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-17T19:55:45.407200] [INFO ] [MAIN ] Update Progress: 1252/2368 symbols completed. LFT took 34.1s. Estimated remaining: 2h 36m 36s. Rate: 7.1 symbols/min [2025-10-17T19:55:45.585733] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:45.583121] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-17T19:55:45.614729] [DEBUG] [LOCAL ] LII: Loaded 28004 existing records from primary storage. [2025-10-17T19:55:45.614985] [INFO ] [MAIN ] LII: Loaded 28004 existing records. [2025-10-17T19:55:45.786269] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:45.786497] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-17T19:55:45.786567] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-17T19:55:45.786801] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-17T19:55:45.786868] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-17T19:55:46.138510] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:46.358026] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-17T19:55:46.649429] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T19:55:47.158046] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-17T19:55:47.279800] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:55:47.958004] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-17T19:55:48.062366] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:55:48.758077] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-17T19:55:48.833970] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T19:55:49.146359] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T19:55:49.558027] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-17T19:55:50.358007] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-17T19:55:50.427545] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:55:50.847246] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:55:51.158003] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-17T19:55:51.553009] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T19:55:51.958048] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-17T19:55:52.760502] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-17T19:55:52.765630] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:55:53.532347] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T19:55:53.541806] [INFO ] [REMOTE ] LEVI: Full fetch complete (74934 records). [2025-10-17T19:55:53.542009] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-17T19:55:53.563170] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-17T19:55:53.961692] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-17T19:55:53.961788] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-17T19:55:53.962848] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-17T19:55:53.962914] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-17T19:55:53.964349] [DEBUG] [LOCAL ] LEVI: Trimmed 74934 records to 52559 (keeping 200 days of data) [2025-10-17T19:55:54.286387] [DEBUG] [LOCAL ] LEVI: Primary data saved (52559 records). [2025-10-17T19:55:54.286679] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-17T19:55:54.287541] [INFO ] [MAIN ] Update Progress: 1253/2368 symbols completed. LEVI took 49.8s. Estimated remaining: 2h 36m 28s. Rate: 7.1 symbols/min [2025-10-17T19:55:54.363252] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-17T19:55:54.465363] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:54.499412] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:55:54.547545] [DEBUG] [LOCAL ] LION: Loaded 46694 existing records from primary storage. [2025-10-17T19:55:54.547917] [INFO ] [MAIN ] LION: Loaded 46694 existing records. [2025-10-17T19:55:54.723165] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:54.723365] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-17T19:55:54.723414] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-17T19:55:54.723629] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-17T19:55:54.723719] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-17T19:55:55.086455] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:55.108699] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:55:55.158011] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-17T19:55:55.770707] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T19:55:55.958044] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-17T19:55:56.239094] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T19:55:56.758033] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-17T19:55:57.437393] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:55:57.558006] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-17T19:55:57.862310] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T19:55:58.358090] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-17T19:55:58.906075] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:55:59.158077] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-17T19:55:59.569603] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T19:55:59.958049] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-17T19:56:00.758045] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-17T19:56:01.558076] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-17T19:56:01.578491] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T19:56:01.586105] [INFO ] [REMOTE ] LH: Full fetch complete (54960 records). [2025-10-17T19:56:01.586277] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-17T19:56:01.792358] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-17T19:56:02.047544] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-17T19:56:02.047697] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-17T19:56:02.048752] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-17T19:56:02.048912] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-17T19:56:02.050201] [DEBUG] [LOCAL ] LH: Trimmed 54960 records to 38017 (keeping 200 days of data) [2025-10-17T19:56:02.289025] [DEBUG] [LOCAL ] LH: Primary data saved (38017 records). [2025-10-17T19:56:02.289224] [INFO ] [MAIN ] LH: Full history saved. [2025-10-17T19:56:02.289359] [INFO ] [MAIN ] Update Progress: 1254/2368 symbols completed. LH took 28.9s. Estimated remaining: 2h 36m 20s. Rate: 7.1 symbols/min [2025-10-17T19:56:02.363026] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-17T19:56:02.437592] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:56:02.488309] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:02.495067] [DEBUG] [LOCAL ] LITB: Loaded 4203 existing records from primary storage. [2025-10-17T19:56:02.495261] [INFO ] [MAIN ] LITB: Loaded 4203 existing records. [2025-10-17T19:56:02.676618] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:02.684287] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-17T19:56:02.689311] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-17T19:56:02.689515] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-17T19:56:02.689923] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-17T19:56:02.721736] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T19:56:03.054556] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:03.157985] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-17T19:56:03.577388] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T19:56:03.958050] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-17T19:56:04.314512] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T19:56:04.429112] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T19:56:04.758027] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-17T19:56:05.558021] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-17T19:56:05.974300] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T19:56:06.358053] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-17T19:56:07.158019] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-17T19:56:07.389957] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T19:56:07.449280] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T19:56:07.611940] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T19:56:07.958043] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-17T19:56:08.758042] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-17T19:56:09.564040] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-17T19:56:09.576864] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T19:56:09.717239] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T19:56:10.358036] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-17T19:56:11.158073] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-17T19:56:11.442814] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T19:56:11.497450] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:56:11.811355] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T19:56:11.958049] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-17T19:56:12.758078] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-17T19:56:13.478861] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T19:56:13.558051] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-17T19:56:13.716019] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:56:14.358051] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-17T19:56:14.898028] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:56:15.158061] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-17T19:56:15.640303] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T19:56:15.751393] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:56:15.958077] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-17T19:56:16.758083] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-17T19:56:17.558006] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-17T19:56:17.783959] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T19:56:18.000349] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:56:18.015292] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T19:56:18.358094] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-17T19:56:19.158100] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-17T19:56:19.958034] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-17T19:56:20.145188] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:56:20.151805] [INFO ] [REMOTE ] LHX: Full fetch complete (70797 records). [2025-10-17T19:56:20.151954] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-17T19:56:20.486440] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T19:56:20.539151] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-17T19:56:20.539321] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-17T19:56:20.540370] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-17T19:56:20.540438] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-17T19:56:20.541835] [DEBUG] [LOCAL ] LHX: Trimmed 70797 records to 49301 (keeping 200 days of data) [2025-10-17T19:56:20.758792] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-17T19:56:20.808623] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T19:56:20.907465] [DEBUG] [LOCAL ] LHX: Primary data saved (49301 records). [2025-10-17T19:56:20.907607] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-17T19:56:20.907740] [INFO ] [MAIN ] Update Progress: 1255/2368 symbols completed. LHX took 38.8s. Estimated remaining: 2h 36m 20s. Rate: 7.1 symbols/min [2025-10-17T19:56:21.073716] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:21.126449] [DEBUG] [LOCAL ] LLY: Loaded 53635 existing records from primary storage. [2025-10-17T19:56:21.126799] [INFO ] [MAIN ] LLY: Loaded 53635 existing records. [2025-10-17T19:56:21.220698] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T19:56:21.313090] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:21.313356] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-17T19:56:21.313433] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-17T19:56:21.313744] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-17T19:56:21.313803] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-17T19:56:21.563180] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-17T19:56:21.682747] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:22.358025] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-17T19:56:22.826140] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T19:56:23.158036] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-17T19:56:23.958027] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-17T19:56:24.465921] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:56:24.470194] [INFO ] [REMOTE ] LII: Full fetch complete (41498 records). [2025-10-17T19:56:24.470284] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-17T19:56:24.761576] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-17T19:56:24.879535] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-17T19:56:24.879701] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-17T19:56:24.880624] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-17T19:56:24.880779] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-17T19:56:24.882194] [DEBUG] [LOCAL ] LII: Trimmed 41498 records to 28209 (keeping 200 days of data) [2025-10-17T19:56:24.997897] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T19:56:25.111886] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-17T19:56:25.196691] [DEBUG] [LOCAL ] LII: Primary data saved (28209 records). [2025-10-17T19:56:25.196847] [INFO ] [MAIN ] LII: Full history saved. [2025-10-17T19:56:25.196934] [INFO ] [MAIN ] Update Progress: 1256/2368 symbols completed. LII took 39.8s. Estimated remaining: 2h 36m 8s. Rate: 7.1 symbols/min [2025-10-17T19:56:25.361160] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:25.409744] [DEBUG] [LOCAL ] LMND: Loaded 52452 existing records from primary storage. [2025-10-17T19:56:25.410058] [INFO ] [MAIN ] LMND: Loaded 52452 existing records. [2025-10-17T19:56:25.569712] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-17T19:56:25.589062] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:25.590042] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-17T19:56:25.590100] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-17T19:56:25.590300] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-17T19:56:25.590357] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-17T19:56:25.960386] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:26.185734] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T19:56:26.248692] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T19:56:26.250047] [INFO ] [REMOTE ] LITB: Full fetch complete (5731 records). [2025-10-17T19:56:26.250121] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-17T19:56:26.363150] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-17T19:56:26.639520] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-17T19:56:26.639617] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-17T19:56:26.639845] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-17T19:56:26.639895] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-17T19:56:26.640280] [DEBUG] [LOCAL ] LITB: Trimmed 5731 records to 4239 (keeping 200 days of data) [2025-10-17T19:56:26.665005] [DEBUG] [LOCAL ] LITB: Primary data saved (4239 records). [2025-10-17T19:56:26.665171] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-17T19:56:26.665274] [INFO ] [MAIN ] Update Progress: 1257/2368 symbols completed. LITB took 24.4s. Estimated remaining: 2h 35m 54s. Rate: 7.1 symbols/min [2025-10-17T19:56:26.836406] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:26.881407] [DEBUG] [LOCAL ] LMT: Loaded 49981 existing records from primary storage. [2025-10-17T19:56:26.881765] [INFO ] [MAIN ] LMT: Loaded 49981 existing records. [2025-10-17T19:56:27.060128] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:27.060400] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-17T19:56:27.060453] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-17T19:56:27.060749] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-17T19:56:27.060805] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-17T19:56:27.160543] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-17T19:56:27.415954] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:27.958056] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-17T19:56:28.393083] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T19:56:28.758136] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-17T19:56:29.309472] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:56:29.558031] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-17T19:56:29.609334] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T19:56:30.370259] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-17T19:56:30.379676] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:56:31.158138] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-17T19:56:31.244715] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:56:31.254432] [INFO ] [REMOTE ] LION: Full fetch complete (57532 records). [2025-10-17T19:56:31.254791] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-17T19:56:31.704056] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-17T19:56:31.704149] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-17T19:56:31.705082] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-17T19:56:31.705148] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-17T19:56:31.706503] [DEBUG] [LOCAL ] LION: Trimmed 57532 records to 47066 (keeping 200 days of data) [2025-10-17T19:56:31.959511] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-17T19:56:31.973460] [DEBUG] [LOCAL ] LION: Primary data saved (47066 records). [2025-10-17T19:56:31.973612] [INFO ] [MAIN ] LION: Full history saved. [2025-10-17T19:56:31.974148] [INFO ] [MAIN ] Update Progress: 1258/2368 symbols completed. LION took 37.7s. Estimated remaining: 2h 35m 42s. Rate: 7.1 symbols/min [2025-10-17T19:56:32.143466] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:32.193363] [DEBUG] [LOCAL ] LNC: Loaded 51933 existing records from primary storage. [2025-10-17T19:56:32.193710] [INFO ] [MAIN ] LNC: Loaded 51933 existing records. [2025-10-17T19:56:32.374099] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:32.374376] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-17T19:56:32.374567] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-17T19:56:32.374874] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-17T19:56:32.374950] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-17T19:56:32.726968] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-17T19:56:32.768293] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:32.779175] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-17T19:56:33.008487] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T19:56:33.558025] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-17T19:56:34.333971] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-17T19:56:34.358064] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-17T19:56:34.895900] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T19:56:35.114691] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:56:35.158079] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-17T19:56:35.958051] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-17T19:56:36.758048] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-17T19:56:36.831437] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-17T19:56:37.043575] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:56:37.558010] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-17T19:56:38.031940] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-17T19:56:38.298008] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T19:56:38.358017] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-17T19:56:39.105283] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:56:39.158050] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-17T19:56:39.958055] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-17T19:56:40.038522] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:56:40.758056] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-17T19:56:41.311137] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T19:56:41.558038] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-17T19:56:42.360263] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-17T19:56:42.363540] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-17T19:56:42.427965] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:56:43.158085] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-17T19:56:43.671376] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T19:56:43.958047] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-17T19:56:44.242395] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T19:56:44.758098] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-17T19:56:45.558005] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-17T19:56:45.804009] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-17T19:56:45.994404] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T19:56:46.085518] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-17T19:56:46.358058] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-17T19:56:47.158069] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-17T19:56:47.340770] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:56:47.958084] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-17T19:56:48.756081] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T19:56:48.766521] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-17T19:56:48.828908] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-17T19:56:49.558103] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-17T19:56:50.128610] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-17T19:56:50.358052] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-17T19:56:50.468794] [DEBUG] [REMOTE ] LMT: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T19:56:50.469264] [WARN ] [REMOTE ] LMT: No data returned for month 2025-07 [2025-10-17T19:56:50.469367] [FATAL] [REMOTE ] LMT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:56:50.469465] [FATAL] [MAIN ] LMT: Failed to fetch primary data. [2025-10-17T19:56:50.469529] [WARN ] [MAIN ] LMT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:56:50.469611] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-17T19:56:50.469715] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-10-17T19:56:50.469765] [INFO ] [LOCAL ] LMT: Starting deletion of derivative data. [2025-10-17T19:56:50.470014] [DEBUG] [LOCAL ] LMT: Deleted derivative data file. [2025-10-17T19:56:50.470492] [INFO ] [MAIN ] Update Progress: 1259/2368 symbols completed. LMT took 23.8s. Estimated remaining: 2h 35m 43s. Rate: 7.1 symbols/min [2025-10-17T19:56:50.636806] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:50.645030] [DEBUG] [LOCAL ] LND: Loaded 4994 existing records from primary storage. [2025-10-17T19:56:50.645258] [INFO ] [MAIN ] LND: Loaded 4994 existing records. [2025-10-17T19:56:50.821021] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:50.821267] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-17T19:56:50.821342] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-17T19:56:50.821617] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-17T19:56:50.821709] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-17T19:56:51.180786] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-17T19:56:51.184502] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:51.218944] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T19:56:51.259327] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:56:51.958019] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-17T19:56:52.758035] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-17T19:56:53.558023] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-17T19:56:53.610284] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:56:53.713433] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-17T19:56:53.778399] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T19:56:54.358027] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-17T19:56:55.158005] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-17T19:56:55.308813] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:56:55.600706] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-17T19:56:55.958031] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-17T19:56:56.081423] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T19:56:56.758060] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-17T19:56:57.558028] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-17T19:56:58.358008] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-17T19:56:58.558453] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-17T19:56:58.765373] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T19:56:59.004526] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T19:56:59.011975] [INFO ] [REMOTE ] LMND: Full fetch complete (75466 records). [2025-10-17T19:56:59.012106] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-17T19:56:59.169416] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-17T19:56:59.454525] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-17T19:56:59.454630] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-17T19:56:59.455919] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-17T19:56:59.456001] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-17T19:56:59.458503] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T19:56:59.470499] [DEBUG] [LOCAL ] LMND: Trimmed 75466 records to 52841 (keeping 200 days of data) [2025-10-17T19:56:59.796660] [DEBUG] [LOCAL ] LMND: Primary data saved (52841 records). [2025-10-17T19:56:59.796793] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-17T19:56:59.797035] [INFO ] [MAIN ] Update Progress: 1260/2368 symbols completed. LMND took 34.6s. Estimated remaining: 2h 35m 35s. Rate: 7.1 symbols/min [2025-10-17T19:56:59.903288] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T19:56:59.958016] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-17T19:56:59.976019] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:00.024892] [DEBUG] [LOCAL ] LNG: Loaded 51601 existing records from primary storage. [2025-10-17T19:57:00.025202] [INFO ] [MAIN ] LNG: Loaded 51601 existing records. [2025-10-17T19:57:00.202367] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:00.202606] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-17T19:57:00.202681] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-17T19:57:00.202889] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-17T19:57:00.202947] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-17T19:57:00.556264] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:00.758025] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-17T19:57:01.558037] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-17T19:57:02.358065] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-17T19:57:02.387429] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T19:57:02.682706] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-17T19:57:02.763253] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T19:57:03.158063] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-17T19:57:03.728528] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T19:57:03.951405] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:57:03.961614] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-17T19:57:04.758029] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-17T19:57:05.558061] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-17T19:57:05.946063] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T19:57:06.189123] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T19:57:06.363092] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-17T19:57:06.374392] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T19:57:06.383365] [INFO ] [REMOTE ] LNC: Full fetch complete (74572 records). [2025-10-17T19:57:06.383512] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-17T19:57:06.789175] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-17T19:57:06.789250] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-17T19:57:06.790268] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-17T19:57:06.790447] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-17T19:57:06.792004] [DEBUG] [LOCAL ] LNC: Trimmed 74572 records to 52301 (keeping 200 days of data) [2025-10-17T19:57:07.027807] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T19:57:07.125252] [DEBUG] [LOCAL ] LNC: Primary data saved (52301 records). [2025-10-17T19:57:07.125382] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-17T19:57:07.125918] [INFO ] [MAIN ] Update Progress: 1261/2368 symbols completed. LNC took 35.2s. Estimated remaining: 2h 35m 26s. Rate: 7.1 symbols/min [2025-10-17T19:57:07.163276] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-17T19:57:07.295480] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:07.309589] [DEBUG] [LOCAL ] LNN: Loaded 11521 existing records from primary storage. [2025-10-17T19:57:07.309836] [INFO ] [MAIN ] LNN: Loaded 11521 existing records. [2025-10-17T19:57:07.486952] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:07.487452] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-17T19:57:07.487510] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-17T19:57:07.487810] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-17T19:57:07.487891] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-17T19:57:07.843847] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:07.838738] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-17T19:57:07.957979] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-17T19:57:08.761382] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-17T19:57:08.764151] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:57:09.321597] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T19:57:09.558010] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-17T19:57:10.358058] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-17T19:57:11.135771] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T19:57:11.137052] [INFO ] [REMOTE ] LND: Full fetch complete (7871 records). [2025-10-17T19:57:11.137123] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-17T19:57:11.165995] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-17T19:57:11.526472] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-17T19:57:11.526565] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-17T19:57:11.526821] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-17T19:57:11.526882] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-17T19:57:11.527281] [DEBUG] [LOCAL ] LND: Trimmed 7871 records to 5027 (keeping 200 days of data) [2025-10-17T19:57:11.556669] [DEBUG] [LOCAL ] LND: Primary data saved (5027 records). [2025-10-17T19:57:11.556880] [INFO ] [MAIN ] LND: Full history saved. [2025-10-17T19:57:11.557122] [INFO ] [MAIN ] Update Progress: 1262/2368 symbols completed. LND took 21.1s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-17T19:57:11.689898] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-17T19:57:11.776331] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:11.821923] [DEBUG] [LOCAL ] LOAR: Loaded 42364 existing records from primary storage. [2025-10-17T19:57:11.822247] [INFO ] [MAIN ] LOAR: Loaded 42364 existing records. [2025-10-17T19:57:11.963172] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-17T19:57:12.004977] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:12.005272] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-17T19:57:12.005508] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-17T19:57:12.005823] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-17T19:57:12.005881] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-17T19:57:12.375561] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:12.388717] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T19:57:12.396283] [INFO ] [REMOTE ] LLY: Full fetch complete (77257 records). [2025-10-17T19:57:12.396415] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-17T19:57:12.767563] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-17T19:57:12.793124] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-17T19:57:12.793282] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-17T19:57:12.794858] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-17T19:57:12.795075] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-17T19:57:12.796867] [DEBUG] [LOCAL ] LLY: Trimmed 77257 records to 54022 (keeping 200 days of data) [2025-10-17T19:57:13.038504] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:57:13.165814] [DEBUG] [LOCAL ] LLY: Primary data saved (54022 records). [2025-10-17T19:57:13.165971] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-17T19:57:13.166055] [INFO ] [MAIN ] Update Progress: 1263/2368 symbols completed. LLY took 52.3s. Estimated remaining: 2h 34m 60s. Rate: 7.1 symbols/min [2025-10-17T19:57:13.337006] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:13.364933] [DEBUG] [LOCAL ] LOB: Loaded 26949 existing records from primary storage. [2025-10-17T19:57:13.365211] [INFO ] [MAIN ] LOB: Loaded 26949 existing records. [2025-10-17T19:57:13.552977] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:13.553340] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-17T19:57:13.553400] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-17T19:57:13.553969] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-17T19:57:13.554030] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-17T19:57:13.565411] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-17T19:57:13.962528] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:14.358004] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-17T19:57:14.652956] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:57:15.054271] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T19:57:15.157999] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-17T19:57:15.403896] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:57:15.958042] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-17T19:57:16.758059] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-17T19:57:17.096093] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T19:57:17.159926] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T19:57:17.316561] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T19:57:17.558040] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-17T19:57:18.358003] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-17T19:57:18.590110] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T19:57:19.158027] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-17T19:57:19.958039] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-17T19:57:20.244767] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T19:57:20.463809] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:57:20.757991] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-17T19:57:20.866216] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T19:57:21.558080] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-17T19:57:22.233341] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:57:22.357992] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-17T19:57:22.717226] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:57:23.158070] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-17T19:57:23.612451] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T19:57:23.958099] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-17T19:57:24.203466] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T19:57:24.758078] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-17T19:57:25.558080] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-17T19:57:25.766917] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:57:26.038479] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:57:26.321530] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:57:26.358064] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-17T19:57:27.158024] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-17T19:57:27.693745] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T19:57:27.958098] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-17T19:57:28.239055] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T19:57:28.758057] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-17T19:57:29.505082] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:57:29.558007] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-17T19:57:30.358012] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-17T19:57:30.547057] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T19:57:30.710364] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:57:31.158016] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-17T19:57:31.460836] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T19:57:31.958068] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-17T19:57:32.758006] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-17T19:57:33.036049] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T19:57:33.169935] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T19:57:33.558058] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-17T19:57:34.358040] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-17T19:57:34.527468] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T19:57:34.675625] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:57:35.158090] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-17T19:57:35.958018] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-17T19:57:36.139320] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:57:36.498308] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T19:57:36.612732] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T19:57:36.758018] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-17T19:57:37.563147] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-17T19:57:37.572507] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T19:57:37.579858] [INFO ] [REMOTE ] LNG: Full fetch complete (74785 records). [2025-10-17T19:57:37.580006] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-17T19:57:37.967190] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-17T19:57:37.967273] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-17T19:57:37.968338] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-17T19:57:37.968423] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-17T19:57:37.969899] [DEBUG] [LOCAL ] LNG: Trimmed 74785 records to 51953 (keeping 200 days of data) [2025-10-17T19:57:38.303763] [DEBUG] [LOCAL ] LNG: Primary data saved (51953 records). [2025-10-17T19:57:38.303918] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-17T19:57:38.304064] [INFO ] [MAIN ] Update Progress: 1264/2368 symbols completed. LNG took 38.5s. Estimated remaining: 2h 35m 6s. Rate: 7.1 symbols/min [2025-10-17T19:57:38.369695] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-17T19:57:38.483306] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:38.491045] [DEBUG] [LOCAL ] LOCL: Loaded 3809 existing records from primary storage. [2025-10-17T19:57:38.491268] [INFO ] [MAIN ] LOCL: Loaded 3809 existing records. [2025-10-17T19:57:38.683014] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:38.683256] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-17T19:57:38.683304] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-17T19:57:38.683438] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-17T19:57:38.683475] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-17T19:57:39.126562] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:39.158872] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T19:57:39.159002] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-17T19:57:39.186705] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:57:39.775992] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-17T19:57:39.958020] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-17T19:57:40.758036] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-17T19:57:40.780535] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:57:41.558057] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-17T19:57:41.994079] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:57:41.998135] [INFO ] [REMOTE ] LOB: Full fetch complete (38381 records). [2025-10-17T19:57:41.998276] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-17T19:57:42.344332] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:57:42.368855] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-17T19:57:42.388182] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-17T19:57:42.389527] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-17T19:57:42.385777] [INFO ] [REMOTE ] LNN: Full fetch complete (15817 records). [2025-10-17T19:57:42.390810] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-17T19:57:42.390425] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-17T19:57:42.391239] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-17T19:57:42.514588] [DEBUG] [LOCAL ] LOB: Trimmed 38381 records to 27202 (keeping 200 days of data) [2025-10-17T19:57:42.929391] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-17T19:57:42.929864] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-17T19:57:42.931725] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-17T19:57:42.932149] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-17T19:57:42.934806] [DEBUG] [LOCAL ] LNN: Trimmed 15817 records to 11624 (keeping 200 days of data) [2025-10-17T19:57:43.028599] [DEBUG] [LOCAL ] LNN: Primary data saved (11624 records). [2025-10-17T19:57:43.029678] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-17T19:57:43.030174] [INFO ] [MAIN ] Update Progress: 1265/2368 symbols completed. LNN took 35.9s. Estimated remaining: 2h 34m 54s. Rate: 7.1 symbols/min [2025-10-17T19:57:43.173755] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-17T19:57:43.270039] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:43.280411] [DEBUG] [LOCAL ] LOB: Primary data saved (27202 records). [2025-10-17T19:57:43.280696] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-17T19:57:43.280833] [INFO ] [MAIN ] Update Progress: 1266/2368 symbols completed. LOB took 30.1s. Estimated remaining: 2h 34m 39s. Rate: 7.1 symbols/min [2025-10-17T19:57:43.466996] [DEBUG] [LOCAL ] LOMA: Loaded 32954 existing records from primary storage. [2025-10-17T19:57:43.484879] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:43.485288] [INFO ] [MAIN ] LOMA: Loaded 32954 existing records. [2025-10-17T19:57:43.676523] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:43.677134] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-17T19:57:43.677196] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-17T19:57:43.677454] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-17T19:57:43.677522] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-17T19:57:43.789170] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T19:57:43.963139] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-17T19:57:44.030483] [DEBUG] [LOCAL ] LOW: Loaded 53379 existing records from primary storage. [2025-10-17T19:57:44.099475] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:44.067049] [INFO ] [MAIN ] LOW: Loaded 53379 existing records. [2025-10-17T19:57:44.238603] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T19:57:44.336945] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:44.337169] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-17T19:57:44.337218] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-17T19:57:44.337732] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-17T19:57:44.337790] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-17T19:57:44.425214] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T19:57:44.715758] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:44.758025] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-17T19:57:45.558036] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-17T19:57:45.994095] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T19:57:46.100571] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T19:57:46.358036] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-17T19:57:47.158034] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-17T19:57:47.930383] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T19:57:47.958078] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-17T19:57:48.198301] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:57:48.758081] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-17T19:57:49.521341] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T19:57:49.526515] [INFO ] [REMOTE ] LOAR: Full fetch complete (55946 records). [2025-10-17T19:57:49.526612] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-17T19:57:49.563249] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-17T19:57:49.911056] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-17T19:57:49.911139] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-17T19:57:49.912120] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-17T19:57:49.912183] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-17T19:57:49.913405] [DEBUG] [LOCAL ] LOAR: Trimmed 55946 records to 42593 (keeping 200 days of data) [2025-10-17T19:57:50.092683] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T19:57:50.169498] [DEBUG] [LOCAL ] LOAR: Primary data saved (42593 records). [2025-10-17T19:57:50.169626] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-17T19:57:50.169742] [INFO ] [MAIN ] Update Progress: 1267/2368 symbols completed. LOAR took 38.6s. Estimated remaining: 2h 34m 29s. Rate: 7.1 symbols/min [2025-10-17T19:57:50.365722] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:50.364388] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-17T19:57:50.405413] [DEBUG] [LOCAL ] LPG: Loaded 39877 existing records from primary storage. [2025-10-17T19:57:50.405742] [INFO ] [MAIN ] LPG: Loaded 39877 existing records. [2025-10-17T19:57:50.583561] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:50.584082] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-17T19:57:50.584249] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-17T19:57:50.584611] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-17T19:57:50.584714] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-17T19:57:50.891689] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T19:57:50.977315] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:50.981094] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:57:51.158045] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-17T19:57:51.958060] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-17T19:57:52.709342] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:57:52.758040] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-17T19:57:53.427048] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T19:57:53.558030] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-17T19:57:54.363207] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-17T19:57:54.381264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:57:55.004094] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T19:57:55.009709] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:57:55.158006] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-17T19:57:55.958038] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-17T19:57:56.534528] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:57:56.556808] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T19:57:56.758023] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-17T19:57:57.558029] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-17T19:57:58.358019] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-17T19:57:58.656910] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T19:57:58.809130] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T19:57:59.158062] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-17T19:57:59.811777] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T19:57:59.957989] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-17T19:58:00.402951] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T19:58:00.620417] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T19:58:00.758034] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-17T19:58:01.485545] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T19:58:01.486698] [INFO ] [REMOTE ] LOCL: Full fetch complete (4549 records). [2025-10-17T19:58:01.486777] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-17T19:58:01.563128] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-17T19:58:01.844718] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-17T19:58:01.844999] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-17T19:58:01.845146] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-17T19:58:01.845185] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-17T19:58:01.845769] [DEBUG] [LOCAL ] LOCL: Trimmed 4549 records to 3843 (keeping 200 days of data) [2025-10-17T19:58:01.869282] [DEBUG] [LOCAL ] LOCL: Primary data saved (3843 records). [2025-10-17T19:58:01.869413] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-17T19:58:01.869510] [INFO ] [MAIN ] Update Progress: 1268/2368 symbols completed. LOCL took 23.6s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-17T19:58:02.036704] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:02.066626] [DEBUG] [LOCAL ] LPL: Loaded 28587 existing records from primary storage. [2025-10-17T19:58:02.066925] [INFO ] [MAIN ] LPL: Loaded 28587 existing records. [2025-10-17T19:58:02.243464] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:02.243739] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-17T19:58:02.243795] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-17T19:58:02.243961] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-17T19:58:02.244000] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-17T19:58:02.363129] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-17T19:58:02.604212] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:03.158020] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-17T19:58:03.248893] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:58:03.705155] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T19:58:03.958032] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-17T19:58:04.011321] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:58:04.758063] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-17T19:58:05.456572] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:58:05.558031] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-17T19:58:06.357995] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-17T19:58:06.554044] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T19:58:06.870138] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:58:07.158007] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-17T19:58:07.430795] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T19:58:07.958009] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-17T19:58:08.349412] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T19:58:08.758044] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-17T19:58:09.558012] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-17T19:58:09.881630] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:58:10.292931] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T19:58:10.357992] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-17T19:58:10.815450] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:58:11.158033] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-17T19:58:11.401271] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:58:11.958015] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-17T19:58:12.598427] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T19:58:12.758053] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-17T19:58:13.272595] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:58:13.558081] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-17T19:58:13.769290] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:58:14.358033] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-17T19:58:15.158075] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-17T19:58:15.472595] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T19:58:15.534874] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:58:15.958112] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-17T19:58:16.445525] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:58:16.758112] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-17T19:58:17.385029] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:58:17.558043] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-17T19:58:17.782500] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T19:58:18.358039] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-17T19:58:19.158001] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-17T19:58:19.566702] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:58:19.594491] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:58:19.599917] [INFO ] [REMOTE ] LOMA: Full fetch complete (47840 records). [2025-10-17T19:58:19.600057] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-17T19:58:19.963278] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-17T19:58:20.050459] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-17T19:58:20.050563] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-17T19:58:20.051578] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-17T19:58:20.051668] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-17T19:58:20.052926] [DEBUG] [LOCAL ] LOMA: Trimmed 47840 records to 33150 (keeping 200 days of data) [2025-10-17T19:58:20.264019] [DEBUG] [LOCAL ] LOMA: Primary data saved (33150 records). [2025-10-17T19:58:20.269547] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-17T19:58:20.277423] [INFO ] [MAIN ] Update Progress: 1269/2368 symbols completed. LOMA took 37.2s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-17T19:58:20.284515] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:58:20.459376] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:20.502613] [DEBUG] [LOCAL ] LPX: Loaded 40611 existing records from primary storage. [2025-10-17T19:58:20.503054] [INFO ] [MAIN ] LPX: Loaded 40611 existing records. [2025-10-17T19:58:20.686060] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:20.686348] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-17T19:58:20.686402] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-17T19:58:20.686919] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-17T19:58:20.686981] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-17T19:58:20.763188] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-17T19:58:21.054036] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:21.558034] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-17T19:58:21.699261] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T19:58:21.725673] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T19:58:22.358035] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-17T19:58:23.005800] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:58:23.158052] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-17T19:58:23.957876] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:58:23.958052] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-17T19:58:24.631943] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:58:24.758049] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-17T19:58:25.512542] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:58:25.558028] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-17T19:58:25.747413] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T19:58:26.358058] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-17T19:58:27.167781] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-17T19:58:27.172671] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T19:58:27.891062] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:58:27.958113] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-17T19:58:28.758040] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-17T19:58:29.001761] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T19:58:29.558031] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-17T19:58:29.587905] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T19:58:29.593491] [INFO ] [REMOTE ] LPL: Full fetch complete (37068 records). [2025-10-17T19:58:29.593629] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-17T19:58:29.962609] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-17T19:58:29.962920] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-17T19:58:29.963737] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-17T19:58:29.963826] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-17T19:58:29.964890] [DEBUG] [LOCAL ] LPL: Trimmed 37068 records to 28863 (keeping 200 days of data) [2025-10-17T19:58:30.069636] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:58:30.161790] [DEBUG] [LOCAL ] LPL: Primary data saved (28863 records). [2025-10-17T19:58:30.161915] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-17T19:58:30.162015] [INFO ] [MAIN ] Update Progress: 1270/2368 symbols completed. LPL took 28.3s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-17T19:58:30.332501] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:30.358091] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-17T19:58:30.372233] [DEBUG] [LOCAL ] LRN: Loaded 39819 existing records from primary storage. [2025-10-17T19:58:30.372513] [INFO ] [MAIN ] LRN: Loaded 39819 existing records. [2025-10-17T19:58:30.506558] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:58:30.554239] [INFO ] [REMOTE ] LOW: Full fetch complete (76711 records). [2025-10-17T19:58:30.556597] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-17T19:58:30.575903] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:30.644050] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-17T19:58:30.649688] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-17T19:58:30.680913] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-17T19:58:30.691263] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-17T19:58:31.173729] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-17T19:58:31.327693] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-17T19:58:31.333018] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-17T19:58:31.339632] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-17T19:58:31.339742] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-17T19:58:31.338560] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:31.341120] [DEBUG] [LOCAL ] LOW: Trimmed 76711 records to 53762 (keeping 200 days of data) [2025-10-17T19:58:31.674615] [DEBUG] [LOCAL ] LOW: Primary data saved (53762 records). [2025-10-17T19:58:31.674768] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-17T19:58:31.674851] [INFO ] [MAIN ] Update Progress: 1271/2368 symbols completed. LOW took 48.4s. Estimated remaining: 2h 34m 2s. Rate: 7.1 symbols/min [2025-10-17T19:58:31.855179] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:31.870028] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T19:58:31.875741] [INFO ] [REMOTE ] LPG: Full fetch complete (59151 records). [2025-10-17T19:58:31.875849] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-17T19:58:31.961423] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-17T19:58:32.215449] [DEBUG] [LOCAL ] LSPD: Loaded 42885 existing records from primary storage. [2025-10-17T19:58:32.226482] [INFO ] [MAIN ] LSPD: Loaded 42885 existing records. [2025-10-17T19:58:32.413717] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-17T19:58:32.429307] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-17T19:58:32.440480] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-17T19:58:32.453100] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-17T19:58:32.493939] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:32.494375] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-17T19:58:32.494623] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-17T19:58:32.494923] [DEBUG] [LOCAL ] LPG: Trimmed 59151 records to 40105 (keeping 200 days of data) [2025-10-17T19:58:32.495764] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-17T19:58:32.495826] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-17T19:58:33.101269] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:33.105514] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-17T19:58:33.148575] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T19:58:33.174429] [DEBUG] [LOCAL ] LPG: Primary data saved (40105 records). [2025-10-17T19:58:33.174776] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-17T19:58:33.175509] [INFO ] [MAIN ] Update Progress: 1272/2368 symbols completed. LPG took 43.0s. Estimated remaining: 2h 33m 47s. Rate: 7.1 symbols/min [2025-10-17T19:58:33.267889] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:58:33.376729] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:33.406908] [DEBUG] [LOCAL ] LTC: Loaded 30810 existing records from primary storage. [2025-10-17T19:58:33.407154] [INFO ] [MAIN ] LTC: Loaded 30810 existing records. [2025-10-17T19:58:33.566667] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-17T19:58:33.589164] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:33.589395] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-17T19:58:33.589446] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-17T19:58:33.589954] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-17T19:58:33.590015] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-17T19:58:33.940205] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:34.358005] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-17T19:58:34.505868] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:58:35.158084] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-17T19:58:35.262266] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:58:35.794194] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T19:58:35.958075] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-17T19:58:36.348402] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T19:58:36.758047] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-17T19:58:37.471957] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:58:37.558049] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-17T19:58:38.272074] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:58:38.358065] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-17T19:58:38.990600] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:58:39.158064] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-17T19:58:39.708235] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:58:39.958034] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-17T19:58:40.687136] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:58:40.758084] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-17T19:58:41.273202] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:58:41.558085] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-17T19:58:42.175938] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:58:42.358101] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-17T19:58:43.113199] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:58:43.157986] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-17T19:58:43.595934] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:58:43.601909] [INFO ] [REMOTE ] LPX: Full fetch complete (58918 records). [2025-10-17T19:58:43.602059] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-17T19:58:43.965385] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-17T19:58:43.986174] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-17T19:58:43.986248] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-17T19:58:43.987173] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-17T19:58:43.987389] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-17T19:58:43.988699] [DEBUG] [LOCAL ] LPX: Trimmed 58918 records to 40820 (keeping 200 days of data) [2025-10-17T19:58:44.234917] [DEBUG] [LOCAL ] LPX: Primary data saved (40820 records). [2025-10-17T19:58:44.235044] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-17T19:58:44.235554] [INFO ] [MAIN ] Update Progress: 1273/2368 symbols completed. LPX took 24.0s. Estimated remaining: 2h 33m 41s. Rate: 7.1 symbols/min [2025-10-17T19:58:44.401402] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:44.449018] [DEBUG] [LOCAL ] LTH: Loaded 52110 existing records from primary storage. [2025-10-17T19:58:44.449318] [INFO ] [MAIN ] LTH: Loaded 52110 existing records. [2025-10-17T19:58:44.624446] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:44.624695] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-17T19:58:44.624753] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-17T19:58:44.625546] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-17T19:58:44.625604] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-17T19:58:44.763333] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-17T19:58:44.998123] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:45.025263] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T19:58:45.412166] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T19:58:45.558048] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-17T19:58:46.265787] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:58:46.358050] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-17T19:58:46.804805] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T19:58:47.158089] [INFO ] [REMOTE